2025-09-07T06:38:45.2560890Z Current runner version: '2.328.0' 2025-09-07T06:38:45.2564440Z Runner name: 'linux.rocm.gpu.gfx942.1-xb8kr-runner-wp76s' 2025-09-07T06:38:45.2564809Z Runner group name: 'default' 2025-09-07T06:38:45.2565290Z Machine name: 'linux' 2025-09-07T06:38:45.2566376Z ##[group]GITHUB_TOKEN Permissions 2025-09-07T06:38:45.2567723Z Contents: read 2025-09-07T06:38:45.2567942Z Metadata: read 2025-09-07T06:38:45.2568153Z ##[endgroup] 2025-09-07T06:38:45.2569454Z Secret source: Actions 2025-09-07T06:38:45.2569732Z Prepare workflow directory 2025-09-07T06:38:45.2847848Z Prepare all required actions 2025-09-07T06:38:45.2869715Z Getting action download info 2025-09-07T06:38:45.5483534Z Download action repository 'pytorch/pytorch@main' (SHA:93fb23d6fae7c4e82c4239a1033e522088742634) 2025-09-07T06:38:47.6455195Z Download action repository 'aws-actions/configure-aws-credentials@ececac1a45f3b08a01d2dd070d28d111c5fe6722' (SHA:ececac1a45f3b08a01d2dd070d28d111c5fe6722) 2025-09-07T06:38:47.9843689Z Download action repository 'aws-actions/amazon-ecr-login@062b18b96a7aff071d4dc91bc00c4c1a7945b076' (SHA:062b18b96a7aff071d4dc91bc00c4c1a7945b076) 2025-09-07T06:38:48.3005351Z Download action repository 'pytorch/test-infra@main' (SHA:548a4bc624d43a01cdf165a63b041f0ae014ddbd) 2025-09-07T06:38:48.8077067Z Download action repository 'actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02' (SHA:ea165f8d65b6e75b540449e92b4886f43607fa02) 2025-09-07T06:38:49.2066051Z Getting action download info 2025-09-07T06:38:49.3395867Z Download action repository 'actions/checkout@v4' (SHA:08eba0b27e820071cde6df949e0beb9ba4906955) 2025-09-07T06:38:49.7217724Z Getting action download info 2025-09-07T06:38:49.8520199Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2025-09-07T06:38:50.2157936Z Getting action download info 2025-09-07T06:38:50.3581737Z Uses: pytorch/pytorch/.github/workflows/_rocm-test.yml@refs/heads/main (93fb23d6fae7c4e82c4239a1033e522088742634) 2025-09-07T06:38:50.3584488Z ##[group] Inputs 2025-09-07T06:38:50.3584655Z build-environment: linux-noble-rocm-py3.12-mi300 2025-09-07T06:38:50.3585288Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}]} 2025-09-07T06:38:50.3586057Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:38:50.3586335Z sync-tag: 2025-09-07T06:38:50.3589767Z timeout-minutes: 300 2025-09-07T06:38:50.3589882Z tests-to-include: 2025-09-07T06:38:50.3589979Z dashboard-tag: 2025-09-07T06:38:50.3590225Z disable-monitor: true 2025-09-07T06:38:50.3590340Z monitor-log-interval: 5 2025-09-07T06:38:50.3590453Z monitor-data-collect-interval: 1 2025-09-07T06:38:50.3590574Z ##[endgroup] 2025-09-07T06:38:50.3590751Z Complete job name: linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:38:50.3886512Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2025-09-07T06:38:50.3886757Z with: 2025-09-07T06:38:50.3886850Z no-sudo: true 2025-09-07T06:38:50.3886945Z submodules: recursive 2025-09-07T06:38:50.3887046Z fetch-depth: 0 2025-09-07T06:38:50.3887177Z env: 2025-09-07T06:38:50.3887273Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:38:50.3887407Z ##[endgroup] 2025-09-07T06:38:50.3941663Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T06:38:50.3942022Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-09-07T06:38:50.3950312Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:38:50.3950461Z env: 2025-09-07T06:38:50.3950545Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:38:50.3950641Z ##[endgroup] 2025-09-07T06:38:50.4082189Z ##[group]Run # Use all available CPUs for fetching 2025-09-07T06:38:50.4082432Z # Use all available CPUs for fetching 2025-09-07T06:38:50.4082565Z cd "${GITHUB_WORKSPACE}" 2025-09-07T06:38:50.4082696Z git config --global fetch.parallel 0 2025-09-07T06:38:50.4082836Z git config --global submodule.fetchJobs 0 2025-09-07T06:38:50.4082959Z  2025-09-07T06:38:50.4083199Z # Clean workspace. The default checkout action should also do this, but 2025-09-07T06:38:50.4083365Z # do it here as well just in case 2025-09-07T06:38:50.4085843Z if [[ -d .git ]]; then 2025-09-07T06:38:50.4085969Z  if [ -z "${NO_SUDO}" ]; then 2025-09-07T06:38:50.4086095Z  sudo git clean -ffdx 2025-09-07T06:38:50.4086198Z  else 2025-09-07T06:38:50.4086287Z  git clean -ffdx 2025-09-07T06:38:50.4086380Z  fi 2025-09-07T06:38:50.4086459Z fi 2025-09-07T06:38:50.4091998Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:38:50.4092134Z env: 2025-09-07T06:38:50.4092216Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:38:50.4092308Z NO_SUDO: true 2025-09-07T06:38:50.4092518Z ##[endgroup] 2025-09-07T06:38:50.4217101Z ##[group]Run actions/checkout@v4 2025-09-07T06:38:50.4217226Z with: 2025-09-07T06:38:50.4217326Z ref: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:38:50.4217449Z fetch-depth: 0 2025-09-07T06:38:50.4217541Z submodules: recursive 2025-09-07T06:38:50.4219886Z show-progress: false 2025-09-07T06:38:50.4219988Z repository: pytorch/pytorch 2025-09-07T06:38:50.4220170Z token: *** 2025-09-07T06:38:50.4220251Z ssh-strict: true 2025-09-07T06:38:50.4220344Z ssh-user: git 2025-09-07T06:38:50.4220434Z persist-credentials: true 2025-09-07T06:38:50.4220536Z clean: true 2025-09-07T06:38:50.4220627Z sparse-checkout-cone-mode: true 2025-09-07T06:38:50.4220737Z fetch-tags: false 2025-09-07T06:38:50.4220819Z lfs: false 2025-09-07T06:38:50.4220902Z set-safe-directory: true 2025-09-07T06:38:50.4220997Z env: 2025-09-07T06:38:50.4222855Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:38:50.4222959Z ##[endgroup] 2025-09-07T06:38:50.4773518Z Syncing repository: pytorch/pytorch 2025-09-07T06:38:50.4774116Z ##[group]Getting Git version info 2025-09-07T06:38:50.4774280Z Working directory is '/home/runner/_work/pytorch/pytorch' 2025-09-07T06:38:50.4774494Z [command]/usr/bin/git version 2025-09-07T06:38:50.4774616Z git version 2.51.0 2025-09-07T06:38:50.4785896Z ##[endgroup] 2025-09-07T06:38:50.4791867Z Copying '/home/runner/.gitconfig' to '/home/runner/_work/_temp/bf5a03ca-a417-4764-bccd-1902adb11a95/.gitconfig' 2025-09-07T06:38:50.4796372Z Temporarily overriding HOME='/home/runner/_work/_temp/bf5a03ca-a417-4764-bccd-1902adb11a95' before making global git config changes 2025-09-07T06:38:50.4796717Z Adding repository directory to the temporary git global config as a safe directory 2025-09-07T06:38:50.4804481Z [command]/usr/bin/git config --global --add safe.directory /home/runner/_work/pytorch/pytorch 2025-09-07T06:38:50.4827235Z Deleting the contents of '/home/runner/_work/pytorch/pytorch' 2025-09-07T06:38:50.4829215Z ##[group]Initializing the repository 2025-09-07T06:38:50.4831590Z [command]/usr/bin/git init /home/runner/_work/pytorch/pytorch 2025-09-07T06:38:50.4858089Z hint: Using 'master' as the name for the initial branch. This default branch name 2025-09-07T06:38:50.4858343Z hint: is subject to change. To configure the initial branch name to use in all 2025-09-07T06:38:50.4858546Z hint: of your new repositories, which will suppress this warning, call: 2025-09-07T06:38:50.4858695Z hint: 2025-09-07T06:38:50.4858826Z hint: git config --global init.defaultBranch 2025-09-07T06:38:50.4859140Z hint: 2025-09-07T06:38:50.4859264Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2025-09-07T06:38:50.4859462Z hint: 'development'. The just-created branch can be renamed via this command: 2025-09-07T06:38:50.4859613Z hint: 2025-09-07T06:38:50.4859710Z hint: git branch -m 2025-09-07T06:38:50.4859818Z hint: 2025-09-07T06:38:50.4859962Z hint: Disable this message with "git config set advice.defaultBranchName false" 2025-09-07T06:38:50.4860179Z Initialized empty Git repository in /home/runner/_work/pytorch/pytorch/.git/ 2025-09-07T06:38:50.4863902Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2025-09-07T06:38:50.4888625Z ##[endgroup] 2025-09-07T06:38:50.4888972Z ##[group]Disabling automatic garbage collection 2025-09-07T06:38:50.4889313Z [command]/usr/bin/git config --local gc.auto 0 2025-09-07T06:38:50.4905779Z ##[endgroup] 2025-09-07T06:38:50.4905953Z ##[group]Setting up auth 2025-09-07T06:38:50.4909033Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-09-07T06:38:50.4931991Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-09-07T06:38:50.5166077Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-09-07T06:38:50.5184414Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-09-07T06:38:50.5357964Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-09-07T06:38:50.5384197Z ##[endgroup] 2025-09-07T06:38:50.5384450Z ##[group]Fetching the repository 2025-09-07T06:38:50.5394944Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2025-09-07T06:39:15.2547405Z From https://github.com/pytorch/pytorch 2025-09-07T06:39:15.2548292Z * [new branch] 160583 -> origin/160583 2025-09-07T06:39:15.2548577Z * [new branch] 2.6.0.dev20241004+ -> origin/2.6.0.dev20241004+ 2025-09-07T06:39:15.2548773Z * [new branch] 5addvllmbuild -> origin/5addvllmbuild 2025-09-07T06:39:15.2548999Z * [new branch] AaronWang04_addmmfusion_perftest -> origin/AaronWang04_addmmfusion_perftest 2025-09-07T06:39:15.2556679Z * [new branch] HDCharles-2.6.0-release-notes -> origin/HDCharles-2.6.0-release-notes 2025-09-07T06:39:15.2556932Z * [new branch] ISSUE-154849 -> origin/ISSUE-154849 2025-09-07T06:39:15.2557226Z * [new branch] JackCaoG/dynamo_make_fx_non_core_aten_ops -> origin/JackCaoG/dynamo_make_fx_non_core_aten_ops 2025-09-07T06:39:15.2557472Z * [new branch] NicoshevSVE128 -> origin/NicoshevSVE128 2025-09-07T06:39:15.2557704Z * [new branch] PR-AOTInductorNoneBug -> origin/PR-AOTInductorNoneBug 2025-09-07T06:39:15.2557937Z * [new branch] PR-AOTInductorNoneBugFix -> origin/PR-AOTInductorNoneBugFix 2025-09-07T06:39:15.2558798Z * [new branch] PR-FixConfigsIssue -> origin/PR-FixConfigsIssue 2025-09-07T06:39:15.2559019Z * [new branch] PR-NoneBugFix-viable -> origin/PR-NoneBugFix-viable 2025-09-07T06:39:15.2559205Z * [new branch] PR-ResetToZero -> origin/PR-ResetToZero 2025-09-07T06:39:15.2559413Z * [new branch] Update-Flash-Packaging -> origin/Update-Flash-Packaging 2025-09-07T06:39:15.2559634Z * [new branch] VLA_exp -> origin/VLA_exp 2025-09-07T06:39:15.2559843Z * [new branch] actually-run-mps-aot-inductor -> origin/actually-run-mps-aot-inductor 2025-09-07T06:39:15.2560215Z * [new branch] add-missing-args-normalization -> origin/add-missing-args-normalization 2025-09-07T06:39:15.2560453Z * [new branch] add-user-guide-structure -> origin/add-user-guide-structure 2025-09-07T06:39:15.2560678Z * [new branch] add-vllm-nightly-build -> origin/add-vllm-nightly-build 2025-09-07T06:39:15.2560899Z * [new branch] add_compile_benchmarking -> origin/add_compile_benchmarking 2025-09-07T06:39:15.2561125Z * [new branch] addmm-heuristic -> origin/addmm-heuristic 2025-09-07T06:39:15.2561305Z * [new branch] addsimde -> origin/addsimde 2025-09-07T06:39:15.2561473Z * [new branch] addvllmtest -> origin/addvllmtest 2025-09-07T06:39:15.2561677Z * [new branch] adi/acl_upgrade -> origin/adi/acl_upgrade 2025-09-07T06:39:15.2561849Z * [new branch] adi/test -> origin/adi/test 2025-09-07T06:39:15.2562028Z * [new branch] adi/test_bgemm -> origin/adi/test_bgemm 2025-09-07T06:39:15.2562210Z * [new branch] adi/test_fusions -> origin/adi/test_fusions 2025-09-07T06:39:15.2562427Z * [new branch] adi/test_onednn_v3.9 -> origin/adi/test_onednn_v3.9 2025-09-07T06:39:15.2562938Z * [new branch] adi/test_presve_change -> origin/adi/test_presve_change 2025-09-07T06:39:15.2563327Z * [new branch] adi/test_timm -> origin/adi/test_timm 2025-09-07T06:39:15.2563516Z * [new branch] adi/testpresve_change -> origin/adi/testpresve_change 2025-09-07T06:39:15.2563713Z * [new branch] aditew01/test/vec_bf16 -> origin/aditew01/test/vec_bf16 2025-09-07T06:39:15.2563921Z * [new branch] ah-globalfeedback-hook -> origin/ah-globalfeedback-hook 2025-09-07T06:39:15.2564114Z * [new branch] alt-disable -> origin/alt-disable 2025-09-07T06:39:15.2564328Z * [new branch] angelayi/aoti_additional_files -> origin/angelayi/aoti_additional_files 2025-09-07T06:39:15.2564554Z * [new branch] angelayi/aoti_inductor_fx -> origin/angelayi/aoti_inductor_fx 2025-09-07T06:39:15.2564760Z * [new branch] angelayi/benchmark -> origin/angelayi/benchmark 2025-09-07T06:39:15.2564966Z * [new branch] angelayi/benchmark2 -> origin/angelayi/benchmark2 2025-09-07T06:39:15.2565199Z * [new branch] angelayi/change_pytree_serialization -> origin/angelayi/change_pytree_serialization 2025-09-07T06:39:15.2565435Z * [new branch] angelayi/cpp_loader -> origin/angelayi/cpp_loader 2025-09-07T06:39:15.2565647Z * [new branch] angelayi/custom_op_subgraph -> origin/angelayi/custom_op_subgraph 2025-09-07T06:39:15.2565854Z * [new branch] angelayi/customop -> origin/angelayi/customop 2025-09-07T06:39:15.2566057Z * [new branch] angelayi/fake_cache_empty -> origin/angelayi/fake_cache_empty 2025-09-07T06:39:15.2566275Z * [new branch] angelayi/is_symbolic_tracing -> origin/angelayi/is_symbolic_tracing 2025-09-07T06:39:15.2566478Z * [new branch] angelayi/item -> origin/angelayi/item 2025-09-07T06:39:15.2566733Z * [new branch] angelayi/no_so_weight -> origin/angelayi/no_so_weight 2025-09-07T06:39:15.2566935Z * [new branch] angelayi/opoverload -> origin/angelayi/opoverload 2025-09-07T06:39:15.2567139Z * [new branch] angelayi/pattern -> origin/angelayi/pattern 2025-09-07T06:39:15.2567325Z * [new branch] angelayi/pytree -> origin/angelayi/pytree 2025-09-07T06:39:15.2567519Z * [new branch] angelayi/scan_layers -> origin/angelayi/scan_layers 2025-09-07T06:39:15.2567720Z * [new branch] angelayi/symint_input -> origin/angelayi/symint_input 2025-09-07T06:39:15.2567966Z * [new branch] angelayi/test_cpp -> origin/angelayi/test_cpp 2025-09-07T06:39:15.2568159Z * [new branch] angelayi/torch_size -> origin/angelayi/torch_size 2025-09-07T06:39:15.2568444Z * [new branch] aoti-cuda-alloc -> origin/aoti-cuda-alloc 2025-09-07T06:39:15.2568641Z * [new branch] aoti_target_windows -> origin/aoti_target_windows 2025-09-07T06:39:15.2568827Z * [new branch] aoti_weight_sharing -> origin/aoti_weight_sharing 2025-09-07T06:39:15.2569049Z * [new branch] atalman-inductor-perf-cu124 -> origin/atalman-inductor-perf-cu124 2025-09-07T06:39:15.2569302Z * [new branch] atalman-inductor-perf-cu124.1 -> origin/atalman-inductor-perf-cu124.1 2025-09-07T06:39:15.2569519Z * [new branch] atalman-patch-1 -> origin/atalman-patch-1 2025-09-07T06:39:15.2569708Z * [new branch] atalman-patch-3 -> origin/atalman-patch-3 2025-09-07T06:39:15.2569895Z * [new branch] atalman-patch-4 -> origin/atalman-patch-4 2025-09-07T06:39:15.2570083Z * [new branch] atalman-patch-5 -> origin/atalman-patch-5 2025-09-07T06:39:15.2570265Z * [new branch] atalman-patch-6 -> origin/atalman-patch-6 2025-09-07T06:39:15.2570463Z * [new branch] atalman_inductor_2.3.0 -> origin/atalman_inductor_2.3.0 2025-09-07T06:39:15.2570753Z * [new branch] atalman_inductor_2.3.1 -> origin/atalman_inductor_2.3.1 2025-09-07T06:39:15.2570983Z * [new branch] atalman_inductor_2.4.0 -> origin/atalman_inductor_2.4.0 2025-09-07T06:39:15.2571182Z * [new branch] atalman_inductor_2.4.x -> origin/atalman_inductor_2.4.x 2025-09-07T06:39:15.2571429Z * [new branch] autoupdate-transformers-pin-via-pr -> origin/autoupdate-transformers-pin-via-pr 2025-09-07T06:39:15.2571668Z * [new branch] bahuang/dtensor_demo -> origin/bahuang/dtensor_demo 2025-09-07T06:39:15.2571863Z * [new branch] bahuang/test -> origin/bahuang/test 2025-09-07T06:39:15.2572035Z * [new branch] base/1.5 -> origin/base/1.5 2025-09-07T06:39:15.2572242Z * [new branch] batching_sdpa_efficient_attention -> origin/batching_sdpa_efficient_attention 2025-09-07T06:39:15.2572460Z * [new branch] bc-lint-config -> origin/bc-lint-config 2025-09-07T06:39:15.2572661Z * [new branch] bc-lint-test-new-config -> origin/bc-lint-test-new-config 2025-09-07T06:39:15.2572870Z * [new branch] benchmark-updates -> origin/benchmark-updates 2025-09-07T06:39:15.2573205Z * [new branch] benchmarker_compat_with_do_bench -> origin/benchmarker_compat_with_do_bench 2025-09-07T06:39:15.2573431Z * [new branch] benchmarking-script -> origin/benchmarking-script 2025-09-07T06:39:15.2573651Z * [new branch] bertmaher/pinbump26 -> origin/bertmaher/pinbump26 2025-09-07T06:39:15.2573849Z * [new branch] bertrand/cutlass -> origin/bertrand/cutlass 2025-09-07T06:39:15.2574053Z * [new branch] bf/cg-custom-wrapper -> origin/bf/cg-custom-wrapper 2025-09-07T06:39:15.2574298Z * [new branch] bf/cg-or-error -> origin/bf/cg-or-error 2025-09-07T06:39:15.2574480Z * [new branch] bf/cg-remove-check -> origin/bf/cg-remove-check 2025-09-07T06:39:15.2574673Z * [new branch] bf/cg-skip-1-kernel -> origin/bf/cg-skip-1-kernel 2025-09-07T06:39:15.2574859Z * [new branch] bf/cudagraph -> origin/bf/cudagraph 2025-09-07T06:39:15.2575094Z * [new branch] bf/cudagraph-disable-input-mutation -> origin/bf/cudagraph-disable-input-mutation 2025-09-07T06:39:15.2575446Z * [new branch] bf/cudagraph-enable-input-mutation-support-benchmark -> origin/bf/cudagraph-enable-input-mutation-support-benchmark 2025-09-07T06:39:15.2575801Z * [new branch] bf/cudagraph-partition -> origin/bf/cudagraph-partition 2025-09-07T06:39:15.2576031Z * [new branch] bf/default-recompile-reason -> origin/bf/default-recompile-reason 2025-09-07T06:39:15.2576254Z * [new branch] bf/donated-buffer-bench -> origin/bf/donated-buffer-bench 2025-09-07T06:39:15.2576447Z * [new branch] bf/exp -> origin/bf/exp 2025-09-07T06:39:15.2576629Z * [new branch] bf/pa-non-divisible -> origin/bf/pa-non-divisible 2025-09-07T06:39:15.2576836Z * [new branch] bf/partition-move-cpu -> origin/bf/partition-move-cpu 2025-09-07T06:39:15.2577053Z * [new branch] bf/partition-turn-on -> origin/bf/partition-turn-on 2025-09-07T06:39:15.2577259Z * [new branch] bf/remove-check-55b0c39d -> origin/bf/remove-check-55b0c39d 2025-09-07T06:39:15.2577462Z * [new branch] bf/rope -> origin/bf/rope 2025-09-07T06:39:15.2577656Z * [new branch] bisect_perf_hf_T5_3acc6eac492 -> origin/bisect_perf_hf_T5_3acc6eac492 2025-09-07T06:39:15.2577884Z * [new branch] bisect_perf_hf_T5_3fcf66f61fb -> origin/bisect_perf_hf_T5_3fcf66f61fb 2025-09-07T06:39:15.2578108Z * [new branch] bisect_perf_hf_T5_4009d154129 -> origin/bisect_perf_hf_T5_4009d154129 2025-09-07T06:39:15.2578324Z * [new branch] bisect_perf_hf_T5_40d0740e73d -> origin/bisect_perf_hf_T5_40d0740e73d 2025-09-07T06:39:15.2578541Z * [new branch] bisect_perf_hf_T5_5268754e -> origin/bisect_perf_hf_T5_5268754e 2025-09-07T06:39:15.2578755Z * [new branch] bisect_perf_hf_T5_7d89a8d385c -> origin/bisect_perf_hf_T5_7d89a8d385c 2025-09-07T06:39:15.2578970Z * [new branch] bisect_perf_hf_T5_b7a25c1ee7c -> origin/bisect_perf_hf_T5_b7a25c1ee7c 2025-09-07T06:39:15.2579188Z * [new branch] bisect_perf_hf_T5_c25b201583f -> origin/bisect_perf_hf_T5_c25b201583f 2025-09-07T06:39:15.2579403Z * [new branch] bisect_perf_hf_T5_c93e57efac0 -> origin/bisect_perf_hf_T5_c93e57efac0 2025-09-07T06:39:15.2579616Z * [new branch] bisect_perf_hf_T5_ca9813ea149 -> origin/bisect_perf_hf_T5_ca9813ea149 2025-09-07T06:39:15.2579824Z * [new branch] bisect_perf_hf_T5_d65f194a -> origin/bisect_perf_hf_T5_d65f194a 2025-09-07T06:39:15.2580031Z * [new branch] bisect_perf_hf_T5_da94ab0b -> origin/bisect_perf_hf_T5_da94ab0b 2025-09-07T06:39:15.2580250Z * [new branch] bisect_perf_hf_T5_da94ab0b_new -> origin/bisect_perf_hf_T5_da94ab0b_new 2025-09-07T06:39:15.2580467Z * [new branch] bisect_perf_hf_T5_db4e8a1d8a8 -> origin/bisect_perf_hf_T5_db4e8a1d8a8 2025-09-07T06:39:15.2580683Z * [new branch] bisect_perf_hf_T5_e0d97e936a2 -> origin/bisect_perf_hf_T5_e0d97e936a2 2025-09-07T06:39:15.2580891Z * [new branch] bisect_perf_hf_T5_f23621ec563 -> origin/bisect_perf_hf_T5_f23621ec563 2025-09-07T06:39:15.2581115Z * [new branch] bowbao/bench_updates_stage -> origin/bowbao/bench_updates_stage 2025-09-07T06:39:15.2581325Z * [new branch] bowbao/dort_rewriter -> origin/bowbao/dort_rewriter 2025-09-07T06:39:15.2581547Z * [new branch] bowbao/wip_prs -> origin/bowbao/wip_prs 2025-09-07T06:39:15.2581747Z * [new branch] brister/break_tensorbox -> origin/brister/break_tensorbox 2025-09-07T06:39:15.2581960Z * [new branch] brister/custom_fx_backend -> origin/brister/custom_fx_backend 2025-09-07T06:39:15.2582171Z * [new branch] brister/fx_custom_triton -> origin/brister/fx_custom_triton 2025-09-07T06:39:15.2582381Z * [new branch] brister/tensor_box_output -> origin/brister/tensor_box_output 2025-09-07T06:39:15.2582618Z * [new branch] brister/tiled_reduction_no_numel_check -> origin/brister/tiled_reduction_no_numel_check 2025-09-07T06:39:15.2582927Z * [new branch] c57382a49 -> origin/c57382a49 2025-09-07T06:39:15.2583193Z * [new branch] ca_0431d47eaa -> origin/ca_0431d47eaa 2025-09-07T06:39:15.2583380Z * [new branch] ca_fix_0431d47eaa -> origin/ca_fix_0431d47eaa 2025-09-07T06:39:15.2583735Z * [new branch] camyll/revert-94bc900da97ad7f3c35b3b819bb53b23c74b581a-for-release-2.8 -> origin/camyll/revert-94bc900da97ad7f3c35b3b819bb53b23c74b581a-for-release-2.8 2025-09-07T06:39:15.2584099Z * [new branch] camyllh/test_setup_hooks_push -> origin/camyllh/test_setup_hooks_push 2025-09-07T06:39:15.2584379Z * [new branch] cherry-pick-149654-by-pytorch_bot_bot_ -> origin/cherry-pick-149654-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2584670Z * [new branch] cherry-pick-151939-by-pytorch_bot_bot_ -> origin/cherry-pick-151939-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2584945Z * [new branch] cherry-pick-154174-by-pytorch_bot_bot_ -> origin/cherry-pick-154174-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2585231Z * [new branch] cherry-pick-156260-by-pytorch_bot_bot_ -> origin/cherry-pick-156260-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2585502Z * [new branch] cherry-pick-157453-by-pytorch_bot_bot_ -> origin/cherry-pick-157453-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2585776Z * [new branch] cherry-pick-157513-by-pytorch_bot_bot_ -> origin/cherry-pick-157513-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2586043Z * [new branch] cherry-pick-157695-by-pytorch_bot_bot_ -> origin/cherry-pick-157695-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2586318Z * [new branch] cherry-pick-157732-by-pytorch_bot_bot_ -> origin/cherry-pick-157732-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2586600Z * [new branch] cherry-pick-158537-by-pytorch_bot_bot_ -> origin/cherry-pick-158537-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2586869Z * [new branch] cherry-pick-159969-by-pytorch_bot_bot_ -> origin/cherry-pick-159969-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2587145Z * [new branch] cherry-pick-160586-by-pytorch_bot_bot_ -> origin/cherry-pick-160586-by-pytorch_bot_bot_ 2025-09-07T06:39:15.2587378Z * [new branch] chilli/flex_vllm -> origin/chilli/flex_vllm 2025-09-07T06:39:15.2587618Z * [new branch] cleanup-inductor-benchmark-images -> origin/cleanup-inductor-benchmark-images 2025-09-07T06:39:15.2587852Z * [new branch] codex-testing -> origin/codex-testing 2025-09-07T06:39:15.2588098Z * [new branch] codex/add-helper-function-to-sizevars.py -> origin/codex/add-helper-function-to-sizevars.py 2025-09-07T06:39:15.2591888Z * [new branch] codex/add-helper-function-to-sizevars.py_2025-09-05 -> origin/codex/add-helper-function-to-sizevars.py_2025-09-05 2025-09-07T06:39:15.2592263Z * [new branch] codex/add-metadata-field-for-file-path -> origin/codex/add-metadata-field-for-file-path 2025-09-07T06:39:15.2592606Z * [new branch] codex/add-test-for-inductor-local-cache-behavior -> origin/codex/add-test-for-inductor-local-cache-behavior 2025-09-07T06:39:15.2593166Z * [new branch] codex/create-test-for-tensor-memory-leak-in-cudagraph -> origin/codex/create-test-for-tensor-memory-leak-in-cudagraph 2025-09-07T06:39:15.2593504Z * [new branch] codex/fix-issue-121219-in-pytorch -> origin/codex/fix-issue-121219-in-pytorch 2025-09-07T06:39:15.2593749Z * [new branch] codex/fix-issue-160415-in-pytorch -> origin/codex/fix-issue-160415-in-pytorch 2025-09-07T06:39:15.2594045Z * [new branch] codex/fix-noqengine-quantized-engine-support -> origin/codex/fix-noqengine-quantized-engine-support 2025-09-07T06:39:15.2594359Z * [new branch] codex/fix-pin_memory-error-handling -> origin/codex/fix-pin_memory-error-handling 2025-09-07T06:39:15.2594632Z * [new branch] codex/propose-fix-for-issue-160332 -> origin/codex/propose-fix-for-issue-160332 2025-09-07T06:39:15.2594988Z * [new branch] codex/refactor-lintrunner-config-to-use-uv-run -> origin/codex/refactor-lintrunner-config-to-use-uv-run 2025-09-07T06:39:15.2595354Z * [new branch] codex/remove-allow-untyped-defs-and-fix-type-errors -> origin/codex/remove-allow-untyped-defs-and-fix-type-errors 2025-09-07T06:39:15.2595695Z * [new branch] compile_fsdp2_disable_stream_and_event -> origin/compile_fsdp2_disable_stream_and_event 2025-09-07T06:39:15.2595920Z * [new branch] context_test -> origin/context_test 2025-09-07T06:39:15.2596101Z * [new branch] copilot/fix-157446 -> origin/copilot/fix-157446 2025-09-07T06:39:15.2596280Z * [new branch] copy_graph -> origin/copy_graph 2025-09-07T06:39:15.2596456Z * [new branch] cpio/fix_new_ami_tests -> origin/cpio/fix_new_ami_tests 2025-09-07T06:39:15.2596654Z * [new branch] csl/always_produce_xml -> origin/csl/always_produce_xml 2025-09-07T06:39:15.2596861Z * [new branch] csl/build_test_more_procs -> origin/csl/build_test_more_procs 2025-09-07T06:39:15.2597070Z * [new branch] csl/build_test_more_procs2 -> origin/csl/build_test_more_procs2 2025-09-07T06:39:15.2597279Z * [new branch] csl/disable_flaky_cpp_test -> origin/csl/disable_flaky_cpp_test 2025-09-07T06:39:15.2597485Z * [new branch] csl/disable_periodic_test -> origin/csl/disable_periodic_test 2025-09-07T06:39:15.2597701Z * [new branch] csl/exclude_rocm_viable_strict -> origin/csl/exclude_rocm_viable_strict 2025-09-07T06:39:15.2597899Z * [new branch] csl/katex -> origin/csl/katex 2025-09-07T06:39:15.2598076Z * [new branch] csl/larger_runner -> origin/csl/larger_runner 2025-09-07T06:39:15.2598266Z * [new branch] csl/lintrunner_stuff -> origin/csl/lintrunner_stuff 2025-09-07T06:39:15.2598458Z * [new branch] csl/mps_sharding -> origin/csl/mps_sharding 2025-09-07T06:39:15.2598646Z * [new branch] csl/multistage_docker -> origin/csl/multistage_docker 2025-09-07T06:39:15.2598848Z * [new branch] csl/name_link_check_job -> origin/csl/name_link_check_job 2025-09-07T06:39:15.2599037Z * [new branch] csl/no_keep_goin_rocm -> origin/csl/no_keep_goin_rocm 2025-09-07T06:39:15.2599224Z * [new branch] csl/not_600_timeout -> origin/csl/not_600_timeout 2025-09-07T06:39:15.2599402Z * [new branch] csl/revert_open -> origin/csl/revert_open 2025-09-07T06:39:15.2599583Z * [new branch] csl/skip_build -> origin/csl/skip_build 2025-09-07T06:39:15.2599785Z * [new branch] csl/test_cuda_build_large_runner -> origin/csl/test_cuda_build_large_runner 2025-09-07T06:39:15.2599985Z * [new branch] csl/win_sccache -> origin/csl/win_sccache 2025-09-07T06:39:15.2600166Z * [new branch] cublasltrelax2 -> origin/cublasltrelax2 2025-09-07T06:39:15.2600342Z * [new branch] cublasrelax2 -> origin/cublasrelax2 2025-09-07T06:39:15.2600566Z * [new branch] cudnnsdparefactor -> origin/cudnnsdparefactor 2025-09-07T06:39:15.2600761Z * [new branch] custom_lowering_dict -> origin/custom_lowering_dict 2025-09-07T06:39:15.2600943Z * [new branch] czhuge_muon_dev -> origin/czhuge_muon_dev 2025-09-07T06:39:15.2601117Z * [new branch] d4l3k/delete_hook -> origin/d4l3k/delete_hook 2025-09-07T06:39:15.2601288Z * [new branch] dcp_zoc -> origin/dcp_zoc 2025-09-07T06:39:15.2601453Z * [new branch] debug-guard -> origin/debug-guard 2025-09-07T06:39:15.2601628Z * [new branch] delete-quant-docs -> origin/delete-quant-docs 2025-09-07T06:39:15.2601984Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.2 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.2 2025-09-07T06:39:15.2602428Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.3 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.3 2025-09-07T06:39:15.2602861Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.4 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.55.4 2025-09-07T06:39:15.2603401Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.56.0 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.56.0 2025-09-07T06:39:15.2603770Z * [new branch] dependabot/pip/dot-ci/docker/protobuf-5.29.5 -> origin/dependabot/pip/dot-ci/docker/protobuf-5.29.5 2025-09-07T06:39:15.2604113Z * [new branch] dependabot/pip/dot-github/requirements/protobuf-5.29.5 -> origin/dependabot/pip/dot-github/requirements/protobuf-5.29.5 2025-09-07T06:39:15.2604416Z * [new branch] desertfire/test_cpp_wrapper -> origin/desertfire/test_cpp_wrapper 2025-09-07T06:39:15.2604662Z * [new branch] desertfire/triton-cpu-for-aarch64 -> origin/desertfire/triton-cpu-for-aarch64 2025-09-07T06:39:15.2605052Z * [new branch] dev/joona/MPSNDArrayAdd -> origin/dev/joona/MPSNDArrayAdd 2025-09-07T06:39:15.2605253Z * [new branch] dev/joona/Unranked -> origin/dev/joona/Unranked 2025-09-07T06:39:15.2605449Z * [new branch] dev/joona/cat -> origin/dev/joona/cat 2025-09-07T06:39:15.2605642Z * [new branch] dev/joona/cat_remove_graph -> origin/dev/joona/cat_remove_graph 2025-09-07T06:39:15.2605853Z * [new branch] dev/joona/embeddingbag -> origin/dev/joona/embeddingbag 2025-09-07T06:39:15.2606074Z * [new branch] dev/joona/getTensorsString -> origin/dev/joona/getTensorsString 2025-09-07T06:39:15.2606322Z * [new branch] dev/joona/maxpool2dwithindices_errmsg -> origin/dev/joona/maxpool2dwithindices_errmsg 2025-09-07T06:39:15.2606573Z * [new branch] dev/joona/mps_linear_macos14 -> origin/dev/joona/mps_linear_macos14 2025-09-07T06:39:15.2606765Z * [new branch] dev/joona/sdpa -> origin/dev/joona/sdpa 2025-09-07T06:39:15.2606957Z * [new branch] dev/joona/topk_newapi -> origin/dev/joona/topk_newapi 2025-09-07T06:39:15.2607151Z * [new branch] dev/joona/type_inf -> origin/dev/joona/type_inf 2025-09-07T06:39:15.2607337Z * [new branch] dev/joona/upsize3d -> origin/dev/joona/upsize3d 2025-09-07T06:39:15.2607510Z * [new branch] disable -> origin/disable 2025-09-07T06:39:15.2607671Z * [new branch] e2e-baseline -> origin/e2e-baseline 2025-09-07T06:39:15.2607857Z * [new branch] eigen_for_sparse_addmm_v2 -> origin/eigen_for_sparse_addmm_v2 2025-09-07T06:39:15.2608061Z * [new branch] embg/test_inductor_ci_128B -> origin/embg/test_inductor_ci_128B 2025-09-07T06:39:15.2608390Z * [new branch] embg/test_inductor_ci_base -> origin/embg/test_inductor_ci_base 2025-09-07T06:39:15.2608603Z * [new branch] embg/test_inductor_ci_control -> origin/embg/test_inductor_ci_control 2025-09-07T06:39:15.2611401Z * [new branch] embg/triton_l2_prefetch_128B -> origin/embg/triton_l2_prefetch_128B 2025-09-07T06:39:15.2611628Z * [new branch] embg/triton_l2_prefetch_256B -> origin/embg/triton_l2_prefetch_256B 2025-09-07T06:39:15.2611830Z * [new branch] eqy-patch-1 -> origin/eqy-patch-1 2025-09-07T06:39:15.2612001Z * [new branch] eqy-patch-2 -> origin/eqy-patch-2 2025-09-07T06:39:15.2612235Z * [new branch] eqy-patch-3 -> origin/eqy-patch-3 2025-09-07T06:39:15.2612397Z * [new branch] eqy-patch-4 -> origin/eqy-patch-4 2025-09-07T06:39:15.2612592Z * [new branch] example-convert-torch.nn -> origin/example-convert-torch.nn 2025-09-07T06:39:15.2612852Z * [new branch] exclamaforte/add-contiguous-threshold -> origin/exclamaforte/add-contiguous-threshold 2025-09-07T06:39:15.2613177Z * [new branch] exclamaforte/amd-ma -> origin/exclamaforte/amd-ma 2025-09-07T06:39:15.2613419Z * [new branch] exclamaforte/bump-transformer-version -> origin/exclamaforte/bump-transformer-version 2025-09-07T06:39:15.2613696Z * [new branch] exclamaforte/clear-feedback-savers -> origin/exclamaforte/clear-feedback-savers 2025-09-07T06:39:15.2613969Z * [new branch] exclamaforte/combo-kernels-perf-run -> origin/exclamaforte/combo-kernels-perf-run 2025-09-07T06:39:15.2614230Z * [new branch] exclamaforte/do_bench_refactor -> origin/exclamaforte/do_bench_refactor 2025-09-07T06:39:15.2614481Z * [new branch] exclamaforte/enable-mem-dep-fusion -> origin/exclamaforte/enable-mem-dep-fusion 2025-09-07T06:39:15.2614759Z * [new branch] exclamaforte/fix-exhaustive-autotuning -> origin/exclamaforte/fix-exhaustive-autotuning 2025-09-07T06:39:15.2615075Z * [new branch] exclamaforte/fix-exhuastive-autotuning-reland -> origin/exclamaforte/fix-exhuastive-autotuning-reland 2025-09-07T06:39:15.2615385Z * [new branch] exclamaforte/fix-trace-parsing-fx-svg -> origin/exclamaforte/fix-trace-parsing-fx-svg 2025-09-07T06:39:15.2615679Z * [new branch] exclamaforte/force-pointwise-cat-perf-run -> origin/exclamaforte/force-pointwise-cat-perf-run 2025-09-07T06:39:15.2615947Z * [new branch] exclamaforte/fusion-data -> origin/exclamaforte/fusion-data 2025-09-07T06:39:15.2616177Z * [new branch] exclamaforte/gemm-benchmark-run -> origin/exclamaforte/gemm-benchmark-run 2025-09-07T06:39:15.2616422Z * [new branch] exclamaforte/gemm-export-model -> origin/exclamaforte/gemm-export-model 2025-09-07T06:39:15.2616650Z * [new branch] exclamaforte/gemm-model -> origin/exclamaforte/gemm-model 2025-09-07T06:39:15.2616922Z * [new branch] exclamaforte/gemm-model-all-data-collection -> origin/exclamaforte/gemm-model-all-data-collection 2025-09-07T06:39:15.2617192Z * [new branch] exclamaforte/gemm-to-amd -> origin/exclamaforte/gemm-to-amd 2025-09-07T06:39:15.2617409Z * [new branch] exclamaforte/just-gemm-model -> origin/exclamaforte/just-gemm-model 2025-09-07T06:39:15.2617677Z * [new branch] exclamaforte/just-gemm-model-no-refactor -> origin/exclamaforte/just-gemm-model-no-refactor 2025-09-07T06:39:15.2617941Z * [new branch] exclamaforte/max-autotune-ieee -> origin/exclamaforte/max-autotune-ieee 2025-09-07T06:39:15.2618175Z * [new branch] exclamaforte/memory-counter -> origin/exclamaforte/memory-counter 2025-09-07T06:39:15.2618405Z * [new branch] exclamaforte/profile-diff-algo -> origin/exclamaforte/profile-diff-algo 2025-09-07T06:39:15.2618721Z * [new branch] exclamaforte/profiler-combo -> origin/exclamaforte/profiler-combo 2025-09-07T06:39:15.2618955Z * [new branch] exclamaforte/test_cpp_wrapper_mode -> origin/exclamaforte/test_cpp_wrapper_mode 2025-09-07T06:39:15.2619216Z * [new branch] exclamaforte/update-autotune-configs -> origin/exclamaforte/update-autotune-configs 2025-09-07T06:39:15.2619498Z * [new branch] exclamaforte/update-autotune-configs-2 -> origin/exclamaforte/update-autotune-configs-2 2025-09-07T06:39:15.2619755Z * [new branch] exclamforte/gemm-model-final -> origin/exclamforte/gemm-model-final 2025-09-07T06:39:15.2619951Z * [new branch] exec -> origin/exec 2025-09-07T06:39:15.2620177Z * [new branch] executorch-module-shim -> origin/executorch-module-shim 2025-09-07T06:39:15.2620381Z * [new branch] experimental-mosaic -> origin/experimental-mosaic 2025-09-07T06:39:15.2620575Z * [new branch] export-D58091437 -> origin/export-D58091437 2025-09-07T06:39:15.2620757Z * [new branch] export-D61047529 -> origin/export-D61047529 2025-09-07T06:39:15.2620935Z * [new branch] export-D70112642 -> origin/export-D70112642 2025-09-07T06:39:15.2621107Z * [new branch] export-D71412006 -> origin/export-D71412006 2025-09-07T06:39:15.2621288Z * [new branch] export-D73042989 -> origin/export-D73042989 2025-09-07T06:39:15.2621463Z * [new branch] export-D75183591 -> origin/export-D75183591 2025-09-07T06:39:15.2621634Z * [new branch] export-D75617432 -> origin/export-D75617432 2025-09-07T06:39:15.2624150Z * [new branch] export-D75659965 -> origin/export-D75659965 2025-09-07T06:39:15.2624364Z * [new branch] export-D76080931 -> origin/export-D76080931 2025-09-07T06:39:15.2624544Z * [new branch] export-D76797250 -> origin/export-D76797250 2025-09-07T06:39:15.2624723Z * [new branch] export-D76885271 -> origin/export-D76885271 2025-09-07T06:39:15.2624904Z * [new branch] export-D76885620 -> origin/export-D76885620 2025-09-07T06:39:15.2625082Z * [new branch] export-D76936623 -> origin/export-D76936623 2025-09-07T06:39:15.2625256Z * [new branch] export-D76958268 -> origin/export-D76958268 2025-09-07T06:39:15.2625431Z * [new branch] export-D78375400 -> origin/export-D78375400 2025-09-07T06:39:15.2625611Z * [new branch] export-D78431305 -> origin/export-D78431305 2025-09-07T06:39:15.2625790Z * [new branch] export-D78580107 -> origin/export-D78580107 2025-09-07T06:39:15.2625964Z * [new branch] export-D78822171 -> origin/export-D78822171 2025-09-07T06:39:15.2626137Z * [new branch] export-D78822351 -> origin/export-D78822351 2025-09-07T06:39:15.2626313Z * [new branch] export-D78822507 -> origin/export-D78822507 2025-09-07T06:39:15.2626488Z * [new branch] export-D78826994 -> origin/export-D78826994 2025-09-07T06:39:15.2626670Z * [new branch] export-D78894324 -> origin/export-D78894324 2025-09-07T06:39:15.2626852Z * [new branch] export-D78929245 -> origin/export-D78929245 2025-09-07T06:39:15.2627028Z * [new branch] export-D78934925 -> origin/export-D78934925 2025-09-07T06:39:15.2627199Z * [new branch] export-D78953203 -> origin/export-D78953203 2025-09-07T06:39:15.2627375Z * [new branch] export-D78953229 -> origin/export-D78953229 2025-09-07T06:39:15.2627550Z * [new branch] export-D78957093 -> origin/export-D78957093 2025-09-07T06:39:15.2627723Z * [new branch] export-D78957389 -> origin/export-D78957389 2025-09-07T06:39:15.2627949Z * [new branch] export-D78996107 -> origin/export-D78996107 2025-09-07T06:39:15.2628130Z * [new branch] export-D79026433 -> origin/export-D79026433 2025-09-07T06:39:15.2628303Z * [new branch] export-D79230339 -> origin/export-D79230339 2025-09-07T06:39:15.2628478Z * [new branch] export-D79319835 -> origin/export-D79319835 2025-09-07T06:39:15.2635449Z * [new branch] export-D79328456 -> origin/export-D79328456 2025-09-07T06:39:15.2635700Z * [new branch] export-D79534608 -> origin/export-D79534608 2025-09-07T06:39:15.2636591Z * [new branch] export-D79785974 -> origin/export-D79785974 2025-09-07T06:39:15.2636873Z * [new branch] export-D80025417 -> origin/export-D80025417 2025-09-07T06:39:15.2637138Z * [new branch] export-D80120333 -> origin/export-D80120333 2025-09-07T06:39:15.2637359Z * [new branch] export-D80214882 -> origin/export-D80214882 2025-09-07T06:39:15.2637565Z * [new branch] export-D80319069 -> origin/export-D80319069 2025-09-07T06:39:15.2637784Z * [new branch] export-D80321215 -> origin/export-D80321215 2025-09-07T06:39:15.2638007Z * [new branch] export-D80503451 -> origin/export-D80503451 2025-09-07T06:39:15.2638206Z * [new branch] export-D80771648 -> origin/export-D80771648 2025-09-07T06:39:15.2640448Z * [new branch] export-D80823877 -> origin/export-D80823877 2025-09-07T06:39:15.2640665Z * [new branch] export-D80948073 -> origin/export-D80948073 2025-09-07T06:39:15.2640853Z * [new branch] export-D80958642 -> origin/export-D80958642 2025-09-07T06:39:15.2641039Z * [new branch] export-D80970483 -> origin/export-D80970483 2025-09-07T06:39:15.2641220Z * [new branch] export-D81054193 -> origin/export-D81054193 2025-09-07T06:39:15.2641402Z * [new branch] export-D81060182 -> origin/export-D81060182 2025-09-07T06:39:15.2641585Z * [new branch] export-D81078973 -> origin/export-D81078973 2025-09-07T06:39:15.2641763Z * [new branch] export-D81204584 -> origin/export-D81204584 2025-09-07T06:39:15.2641935Z * [new branch] export-D81284190 -> origin/export-D81284190 2025-09-07T06:39:15.2642108Z * [new branch] export-D81299840 -> origin/export-D81299840 2025-09-07T06:39:15.2642283Z * [new branch] export-D81429090 -> origin/export-D81429090 2025-09-07T06:39:15.2642459Z * [new branch] export-D81698719 -> origin/export-D81698719 2025-09-07T06:39:15.2642711Z * [new branch] export-D81747409 -> origin/export-D81747409 2025-09-07T06:39:15.2642971Z * [new branch] exported-model-train-idempotent -> origin/exported-model-train-idempotent 2025-09-07T06:39:15.2643345Z * [new branch] ezyang/wip-aot-descriptors -> origin/ezyang/wip-aot-descriptors 2025-09-07T06:39:15.2643598Z * [new branch] fa_u8_brgemm -> origin/fa_u8_brgemm 2025-09-07T06:39:15.2643814Z * [new branch] fastmath_baseline -> origin/fastmath_baseline 2025-09-07T06:39:15.2644024Z * [new branch] fbcode/warm -> origin/fbcode/warm 2025-09-07T06:39:15.2644256Z * [new branch] fca -> origin/fca 2025-09-07T06:39:15.2644444Z * [new branch] fca2_ca5984c -> origin/fca2_ca5984c 2025-09-07T06:39:15.2644669Z * [new branch] fca5 -> origin/fca5 2025-09-07T06:39:15.2646403Z * [new branch] feature/function-numa-binding -> origin/feature/function-numa-binding 2025-09-07T06:39:15.2646759Z * [new branch] feature/function-numa-binding-take2 -> origin/feature/function-numa-binding-take2 2025-09-07T06:39:15.2647010Z * [new branch] feature/numa-nproc-fix -> origin/feature/numa-nproc-fix 2025-09-07T06:39:15.2647238Z * [new branch] feature/numa-signpost-serialize -> origin/feature/numa-signpost-serialize 2025-09-07T06:39:15.2647493Z * [new branch] feature/parallel-numa-binding -> origin/feature/parallel-numa-binding 2025-09-07T06:39:15.2647732Z * [new branch] fengyuan/external-proj -> origin/fengyuan/external-proj 2025-09-07T06:39:15.2648000Z * [new branch] fengyuan/out-of-tree-xpu-ops-improve-test -> origin/fengyuan/out-of-tree-xpu-ops-improve-test 2025-09-07T06:39:15.2648434Z * [new branch] fengyuan/out-of-tree-xpu-ops-remove-dtype -> origin/fengyuan/out-of-tree-xpu-ops-remove-dtype 2025-09-07T06:39:15.2648681Z * [new branch] fengyuan/test-xpu -> origin/fengyuan/test-xpu 2025-09-07T06:39:15.2648872Z * [new branch] ffast_math_baseline -> origin/ffast_math_baseline 2025-09-07T06:39:15.2649053Z * [new branch] ffast_math_target -> origin/ffast_math_target 2025-09-07T06:39:15.2649235Z * [new branch] findhao/base_commit -> origin/findhao/base_commit 2025-09-07T06:39:15.2650864Z * [new branch] findhao/base_commit1 -> origin/findhao/base_commit1 2025-09-07T06:39:15.2651073Z * [new branch] findhao/multistream2 -> origin/findhao/multistream2 2025-09-07T06:39:15.2651276Z * [new branch] findhao/multistream5 -> origin/findhao/multistream5 2025-09-07T06:39:15.2651474Z * [new branch] findhao/multistream6 -> origin/findhao/multistream6 2025-09-07T06:39:15.2651673Z * [new branch] findhao/operatorbench3 -> origin/findhao/operatorbench3 2025-09-07T06:39:15.2651886Z * [new branch] findhao/operatorbench5 -> origin/findhao/operatorbench5 2025-09-07T06:39:15.2652086Z * [new branch] findhao/tritonparse -> origin/findhao/tritonparse 2025-09-07T06:39:15.2652269Z * [new branch] fix -> origin/fix 2025-09-07T06:39:15.2652460Z * [new branch] fix-ck-gemm-template-format -> origin/fix-ck-gemm-template-format 2025-09-07T06:39:15.2652669Z * [new branch] fix-config-ignore -> origin/fix-config-ignore 2025-09-07T06:39:15.2652848Z * [new branch] fix-dict-guard -> origin/fix-dict-guard 2025-09-07T06:39:15.2653161Z * [new branch] fix-inductor-periodic-0528 -> origin/fix-inductor-periodic-0528 2025-09-07T06:39:15.2653373Z * [new branch] fix-mps-benchmark -> origin/fix-mps-benchmark 2025-09-07T06:39:15.2653581Z * [new branch] fix-rlease-feature-template -> origin/fix-rlease-feature-template 2025-09-07T06:39:15.2653830Z * [new branch] fix-run-condition-upload-results -> origin/fix-run-condition-upload-results 2025-09-07T06:39:15.2654048Z * [new branch] fix-torchbench -> origin/fix-torchbench 2025-09-07T06:39:15.2654219Z * [new branch] fix_153389 -> origin/fix_153389 2025-09-07T06:39:15.2654391Z * [new branch] fix_fsdp_rs_bucket2 -> origin/fix_fsdp_rs_bucket2 2025-09-07T06:39:15.2654589Z * [new branch] fix_inductor_peridic_tests -> origin/fix_inductor_peridic_tests 2025-09-07T06:39:15.2654794Z * [new branch] fix_ubn_159469 -> origin/fix_ubn_159469 2025-09-07T06:39:15.2654996Z * [new branch] fixes-triage -> origin/fixes-triage 2025-09-07T06:39:15.2655217Z * [new branch] fixflashinfer -> origin/fixflashinfer 2025-09-07T06:39:15.2655426Z * [new branch] flash_decoding_cpu -> origin/flash_decoding_cpu 2025-09-07T06:39:15.2657164Z * [new branch] flex-flash -> origin/flex-flash 2025-09-07T06:39:15.2657346Z * [new branch] flex-lowering -> origin/flex-lowering 2025-09-07T06:39:15.2657520Z * [new branch] flex-warning -> origin/flex-warning 2025-09-07T06:39:15.2657719Z * [new branch] flex_attention_functorch_grad -> origin/flex_attention_functorch_grad 2025-09-07T06:39:15.2657911Z * [new branch] flex_flash -> origin/flex_flash 2025-09-07T06:39:15.2658100Z * [new branch] flexdecode-gqa-groups -> origin/flexdecode-gqa-groups 2025-09-07T06:39:15.2658322Z * [new branch] fmassa/fix_memeff_sharding_rule -> origin/fmassa/fix_memeff_sharding_rule 2025-09-07T06:39:15.2658567Z * [new branch] fsdp2_trace_rules -> origin/fsdp2_trace_rules 2025-09-07T06:39:15.2658738Z * [new branch] fsdpv2_3d -> origin/fsdpv2_3d 2025-09-07T06:39:15.2658904Z * [new branch] fsdpv2_3d_m1 -> origin/fsdpv2_3d_m1 2025-09-07T06:39:15.2659080Z * [new branch] fx_cpp -> origin/fx_cpp 2025-09-07T06:39:15.2659243Z * [new branch] fy/fix-win -> origin/fy/fix-win 2025-09-07T06:39:15.2659422Z * [new branch] gh/AlnisM/1/base -> origin/gh/AlnisM/1/base 2025-09-07T06:39:15.2659602Z * [new branch] gh/AlnisM/1/head -> origin/gh/AlnisM/1/head 2025-09-07T06:39:15.2659775Z * [new branch] gh/CaoE/2/base -> origin/gh/CaoE/2/base 2025-09-07T06:39:15.2659944Z * [new branch] gh/CaoE/2/head -> origin/gh/CaoE/2/head 2025-09-07T06:39:15.2660116Z * [new branch] gh/CaoE/2/orig -> origin/gh/CaoE/2/orig 2025-09-07T06:39:15.2660308Z * [new branch] gh/ColinPeppler/79/base -> origin/gh/ColinPeppler/79/base 2025-09-07T06:39:15.2660518Z * [new branch] gh/ColinPeppler/79/head -> origin/gh/ColinPeppler/79/head 2025-09-07T06:39:15.2660717Z * [new branch] gh/ColinPeppler/79/orig -> origin/gh/ColinPeppler/79/orig 2025-09-07T06:39:15.2660923Z * [new branch] gh/ColinPeppler/80/base -> origin/gh/ColinPeppler/80/base 2025-09-07T06:39:15.2661118Z * [new branch] gh/ColinPeppler/80/head -> origin/gh/ColinPeppler/80/head 2025-09-07T06:39:15.2661314Z * [new branch] gh/ColinPeppler/80/orig -> origin/gh/ColinPeppler/80/orig 2025-09-07T06:39:15.2661510Z * [new branch] gh/EikanWang/67/base -> origin/gh/EikanWang/67/base 2025-09-07T06:39:15.2661789Z * [new branch] gh/EikanWang/67/head -> origin/gh/EikanWang/67/head 2025-09-07T06:39:15.2662016Z * [new branch] gh/EikanWang/80/base -> origin/gh/EikanWang/80/base 2025-09-07T06:39:15.2662221Z * [new branch] gh/EikanWang/80/head -> origin/gh/EikanWang/80/head 2025-09-07T06:39:15.2662475Z * [new branch] gh/EikanWang/80/orig -> origin/gh/EikanWang/80/orig 2025-09-07T06:39:15.2664228Z * [new branch] gh/EikanWang/81/base -> origin/gh/EikanWang/81/base 2025-09-07T06:39:15.2664440Z * [new branch] gh/EikanWang/81/head -> origin/gh/EikanWang/81/head 2025-09-07T06:39:15.2664624Z * [new branch] gh/EikanWang/81/orig -> origin/gh/EikanWang/81/orig 2025-09-07T06:39:15.2664814Z * [new branch] gh/EikanWang/82/base -> origin/gh/EikanWang/82/base 2025-09-07T06:39:15.2665003Z * [new branch] gh/EikanWang/82/head -> origin/gh/EikanWang/82/head 2025-09-07T06:39:15.2665194Z * [new branch] gh/EikanWang/82/orig -> origin/gh/EikanWang/82/orig 2025-09-07T06:39:15.2665383Z * [new branch] gh/Gasoonjia/1/base -> origin/gh/Gasoonjia/1/base 2025-09-07T06:39:15.2665568Z * [new branch] gh/Gasoonjia/1/head -> origin/gh/Gasoonjia/1/head 2025-09-07T06:39:15.2665808Z * [new branch] gh/H-Huang/131/base -> origin/gh/H-Huang/131/base 2025-09-07T06:39:15.2665986Z * [new branch] gh/H-Huang/131/head -> origin/gh/H-Huang/131/head 2025-09-07T06:39:15.2666170Z * [new branch] gh/H-Huang/131/orig -> origin/gh/H-Huang/131/orig 2025-09-07T06:39:15.2666347Z * [new branch] gh/H-Huang/132/base -> origin/gh/H-Huang/132/base 2025-09-07T06:39:15.2668213Z * [new branch] gh/H-Huang/132/head -> origin/gh/H-Huang/132/head 2025-09-07T06:39:15.2668428Z * [new branch] gh/H-Huang/132/orig -> origin/gh/H-Huang/132/orig 2025-09-07T06:39:15.2668661Z * [new branch] gh/H-Huang/180/base -> origin/gh/H-Huang/180/base 2025-09-07T06:39:15.2668835Z * [new branch] gh/H-Huang/180/head -> origin/gh/H-Huang/180/head 2025-09-07T06:39:15.2669012Z * [new branch] gh/H-Huang/180/orig -> origin/gh/H-Huang/180/orig 2025-09-07T06:39:15.2669190Z * [new branch] gh/H-Huang/182/base -> origin/gh/H-Huang/182/base 2025-09-07T06:39:15.2669368Z * [new branch] gh/H-Huang/182/head -> origin/gh/H-Huang/182/head 2025-09-07T06:39:15.2669542Z * [new branch] gh/H-Huang/182/orig -> origin/gh/H-Huang/182/orig 2025-09-07T06:39:15.2669718Z * [new branch] gh/H-Huang/187/base -> origin/gh/H-Huang/187/base 2025-09-07T06:39:15.2669894Z * [new branch] gh/H-Huang/187/head -> origin/gh/H-Huang/187/head 2025-09-07T06:39:15.2670070Z * [new branch] gh/H-Huang/187/orig -> origin/gh/H-Huang/187/orig 2025-09-07T06:39:15.2670252Z * [new branch] gh/H-Huang/202/base -> origin/gh/H-Huang/202/base 2025-09-07T06:39:15.2670430Z * [new branch] gh/H-Huang/202/head -> origin/gh/H-Huang/202/head 2025-09-07T06:39:15.2670608Z * [new branch] gh/H-Huang/202/orig -> origin/gh/H-Huang/202/orig 2025-09-07T06:39:15.2670784Z * [new branch] gh/H-Huang/203/base -> origin/gh/H-Huang/203/base 2025-09-07T06:39:15.2670963Z * [new branch] gh/H-Huang/203/head -> origin/gh/H-Huang/203/head 2025-09-07T06:39:15.2671138Z * [new branch] gh/H-Huang/203/orig -> origin/gh/H-Huang/203/orig 2025-09-07T06:39:15.2671315Z * [new branch] gh/H-Huang/204/base -> origin/gh/H-Huang/204/base 2025-09-07T06:39:15.2671491Z * [new branch] gh/H-Huang/204/head -> origin/gh/H-Huang/204/head 2025-09-07T06:39:15.2673003Z * [new branch] gh/H-Huang/204/orig -> origin/gh/H-Huang/204/orig 2025-09-07T06:39:15.2673287Z * [new branch] gh/H-Huang/205/base -> origin/gh/H-Huang/205/base 2025-09-07T06:39:15.2673465Z * [new branch] gh/H-Huang/205/head -> origin/gh/H-Huang/205/head 2025-09-07T06:39:15.2673644Z * [new branch] gh/H-Huang/205/orig -> origin/gh/H-Huang/205/orig 2025-09-07T06:39:15.2673818Z * [new branch] gh/H-Huang/206/base -> origin/gh/H-Huang/206/base 2025-09-07T06:39:15.2673995Z * [new branch] gh/H-Huang/206/head -> origin/gh/H-Huang/206/head 2025-09-07T06:39:15.2674171Z * [new branch] gh/H-Huang/206/orig -> origin/gh/H-Huang/206/orig 2025-09-07T06:39:15.2674346Z * [new branch] gh/H-Huang/207/base -> origin/gh/H-Huang/207/base 2025-09-07T06:39:15.2674522Z * [new branch] gh/H-Huang/207/head -> origin/gh/H-Huang/207/head 2025-09-07T06:39:15.2674697Z * [new branch] gh/H-Huang/207/orig -> origin/gh/H-Huang/207/orig 2025-09-07T06:39:15.2674882Z * [new branch] gh/H-Huang/208/base -> origin/gh/H-Huang/208/base 2025-09-07T06:39:15.2676265Z * [new branch] gh/H-Huang/208/head -> origin/gh/H-Huang/208/head 2025-09-07T06:39:15.2676530Z * [new branch] gh/H-Huang/208/orig -> origin/gh/H-Huang/208/orig 2025-09-07T06:39:15.2676708Z * [new branch] gh/H-Huang/209/base -> origin/gh/H-Huang/209/base 2025-09-07T06:39:15.2676883Z * [new branch] gh/H-Huang/209/head -> origin/gh/H-Huang/209/head 2025-09-07T06:39:15.2677060Z * [new branch] gh/H-Huang/209/orig -> origin/gh/H-Huang/209/orig 2025-09-07T06:39:15.2677239Z * [new branch] gh/H-Huang/210/base -> origin/gh/H-Huang/210/base 2025-09-07T06:39:15.2677413Z * [new branch] gh/H-Huang/210/head -> origin/gh/H-Huang/210/head 2025-09-07T06:39:15.2677628Z * [new branch] gh/H-Huang/210/orig -> origin/gh/H-Huang/210/orig 2025-09-07T06:39:15.2677803Z * [new branch] gh/H-Huang/211/base -> origin/gh/H-Huang/211/base 2025-09-07T06:39:15.2677982Z * [new branch] gh/H-Huang/211/head -> origin/gh/H-Huang/211/head 2025-09-07T06:39:15.2678163Z * [new branch] gh/H-Huang/211/orig -> origin/gh/H-Huang/211/orig 2025-09-07T06:39:15.2678339Z * [new branch] gh/H-Huang/212/base -> origin/gh/H-Huang/212/base 2025-09-07T06:39:15.2679828Z * [new branch] gh/H-Huang/212/head -> origin/gh/H-Huang/212/head 2025-09-07T06:39:15.2680041Z * [new branch] gh/H-Huang/212/orig -> origin/gh/H-Huang/212/orig 2025-09-07T06:39:15.2680228Z * [new branch] gh/H-Huang/213/base -> origin/gh/H-Huang/213/base 2025-09-07T06:39:15.2680405Z * [new branch] gh/H-Huang/213/head -> origin/gh/H-Huang/213/head 2025-09-07T06:39:15.2680588Z * [new branch] gh/H-Huang/213/orig -> origin/gh/H-Huang/213/orig 2025-09-07T06:39:15.2680768Z * [new branch] gh/H-Huang/214/base -> origin/gh/H-Huang/214/base 2025-09-07T06:39:15.2680947Z * [new branch] gh/H-Huang/214/head -> origin/gh/H-Huang/214/head 2025-09-07T06:39:15.2681145Z * [new branch] gh/H-Huang/214/orig -> origin/gh/H-Huang/214/orig 2025-09-07T06:39:15.2681338Z * [new branch] gh/IvanKobzarev/112/base -> origin/gh/IvanKobzarev/112/base 2025-09-07T06:39:15.2681548Z * [new branch] gh/IvanKobzarev/112/head -> origin/gh/IvanKobzarev/112/head 2025-09-07T06:39:15.2681750Z * [new branch] gh/IvanKobzarev/112/orig -> origin/gh/IvanKobzarev/112/orig 2025-09-07T06:39:15.2681949Z * [new branch] gh/IvanKobzarev/115/base -> origin/gh/IvanKobzarev/115/base 2025-09-07T06:39:15.2682163Z * [new branch] gh/IvanKobzarev/115/head -> origin/gh/IvanKobzarev/115/head 2025-09-07T06:39:15.2682366Z * [new branch] gh/IvanKobzarev/115/orig -> origin/gh/IvanKobzarev/115/orig 2025-09-07T06:39:15.2682566Z * [new branch] gh/IvanKobzarev/116/base -> origin/gh/IvanKobzarev/116/base 2025-09-07T06:39:15.2682766Z * [new branch] gh/IvanKobzarev/116/head -> origin/gh/IvanKobzarev/116/head 2025-09-07T06:39:15.2682966Z * [new branch] gh/IvanKobzarev/116/orig -> origin/gh/IvanKobzarev/116/orig 2025-09-07T06:39:15.2683281Z * [new branch] gh/IvanKobzarev/118/base -> origin/gh/IvanKobzarev/118/base 2025-09-07T06:39:15.2684881Z * [new branch] gh/IvanKobzarev/118/head -> origin/gh/IvanKobzarev/118/head 2025-09-07T06:39:15.2685094Z * [new branch] gh/IvanKobzarev/118/orig -> origin/gh/IvanKobzarev/118/orig 2025-09-07T06:39:15.2685291Z * [new branch] gh/IvanKobzarev/126/base -> origin/gh/IvanKobzarev/126/base 2025-09-07T06:39:15.2685499Z * [new branch] gh/IvanKobzarev/126/head -> origin/gh/IvanKobzarev/126/head 2025-09-07T06:39:15.2685704Z * [new branch] gh/IvanKobzarev/126/orig -> origin/gh/IvanKobzarev/126/orig 2025-09-07T06:39:15.2685944Z * [new branch] gh/IvanKobzarev/127/base -> origin/gh/IvanKobzarev/127/base 2025-09-07T06:39:15.2686235Z * [new branch] gh/IvanKobzarev/127/head -> origin/gh/IvanKobzarev/127/head 2025-09-07T06:39:15.2686440Z * [new branch] gh/IvanKobzarev/127/orig -> origin/gh/IvanKobzarev/127/orig 2025-09-07T06:39:15.2686641Z * [new branch] gh/IvanKobzarev/128/base -> origin/gh/IvanKobzarev/128/base 2025-09-07T06:39:15.2686838Z * [new branch] gh/IvanKobzarev/128/head -> origin/gh/IvanKobzarev/128/head 2025-09-07T06:39:15.2687040Z * [new branch] gh/IvanKobzarev/128/orig -> origin/gh/IvanKobzarev/128/orig 2025-09-07T06:39:15.2688932Z * [new branch] gh/IvanKobzarev/132/base -> origin/gh/IvanKobzarev/132/base 2025-09-07T06:39:15.2689215Z * [new branch] gh/IvanKobzarev/132/head -> origin/gh/IvanKobzarev/132/head 2025-09-07T06:39:15.2689415Z * [new branch] gh/IvanKobzarev/132/orig -> origin/gh/IvanKobzarev/132/orig 2025-09-07T06:39:15.2689617Z * [new branch] gh/IvanKobzarev/133/base -> origin/gh/IvanKobzarev/133/base 2025-09-07T06:39:15.2689816Z * [new branch] gh/IvanKobzarev/133/head -> origin/gh/IvanKobzarev/133/head 2025-09-07T06:39:15.2690022Z * [new branch] gh/IvanKobzarev/133/orig -> origin/gh/IvanKobzarev/133/orig 2025-09-07T06:39:15.2690224Z * [new branch] gh/IvanKobzarev/134/base -> origin/gh/IvanKobzarev/134/base 2025-09-07T06:39:15.2690423Z * [new branch] gh/IvanKobzarev/134/head -> origin/gh/IvanKobzarev/134/head 2025-09-07T06:39:15.2690622Z * [new branch] gh/IvanKobzarev/134/orig -> origin/gh/IvanKobzarev/134/orig 2025-09-07T06:39:15.2690826Z * [new branch] gh/IvanKobzarev/135/base -> origin/gh/IvanKobzarev/135/base 2025-09-07T06:39:15.2691023Z * [new branch] gh/IvanKobzarev/135/head -> origin/gh/IvanKobzarev/135/head 2025-09-07T06:39:15.2691223Z * [new branch] gh/IvanKobzarev/135/orig -> origin/gh/IvanKobzarev/135/orig 2025-09-07T06:39:15.2691434Z * [new branch] gh/IvanKobzarev/136/base -> origin/gh/IvanKobzarev/136/base 2025-09-07T06:39:15.2691630Z * [new branch] gh/IvanKobzarev/136/head -> origin/gh/IvanKobzarev/136/head 2025-09-07T06:39:15.2691834Z * [new branch] gh/IvanKobzarev/136/orig -> origin/gh/IvanKobzarev/136/orig 2025-09-07T06:39:15.2692032Z * [new branch] gh/IvanKobzarev/137/base -> origin/gh/IvanKobzarev/137/base 2025-09-07T06:39:15.2692231Z * [new branch] gh/IvanKobzarev/137/head -> origin/gh/IvanKobzarev/137/head 2025-09-07T06:39:15.2692429Z * [new branch] gh/IvanKobzarev/137/orig -> origin/gh/IvanKobzarev/137/orig 2025-09-07T06:39:15.2692633Z * [new branch] gh/IvanKobzarev/138/base -> origin/gh/IvanKobzarev/138/base 2025-09-07T06:39:15.2692831Z * [new branch] gh/IvanKobzarev/138/head -> origin/gh/IvanKobzarev/138/head 2025-09-07T06:39:15.2693030Z * [new branch] gh/IvanKobzarev/138/orig -> origin/gh/IvanKobzarev/138/orig 2025-09-07T06:39:15.2693332Z * [new branch] gh/IvanKobzarev/139/base -> origin/gh/IvanKobzarev/139/base 2025-09-07T06:39:15.2693537Z * [new branch] gh/IvanKobzarev/139/head -> origin/gh/IvanKobzarev/139/head 2025-09-07T06:39:15.2693743Z * [new branch] gh/IvanKobzarev/139/orig -> origin/gh/IvanKobzarev/139/orig 2025-09-07T06:39:15.2693953Z * [new branch] gh/IvanKobzarev/140/base -> origin/gh/IvanKobzarev/140/base 2025-09-07T06:39:15.2694162Z * [new branch] gh/IvanKobzarev/140/head -> origin/gh/IvanKobzarev/140/head 2025-09-07T06:39:15.2695816Z * [new branch] gh/IvanKobzarev/140/orig -> origin/gh/IvanKobzarev/140/orig 2025-09-07T06:39:15.2696031Z * [new branch] gh/IvanKobzarev/141/base -> origin/gh/IvanKobzarev/141/base 2025-09-07T06:39:15.2696282Z * [new branch] gh/IvanKobzarev/141/head -> origin/gh/IvanKobzarev/141/head 2025-09-07T06:39:15.2696489Z * [new branch] gh/IvanKobzarev/141/orig -> origin/gh/IvanKobzarev/141/orig 2025-09-07T06:39:15.2696691Z * [new branch] gh/IvanKobzarev/142/base -> origin/gh/IvanKobzarev/142/base 2025-09-07T06:39:15.2696894Z * [new branch] gh/IvanKobzarev/142/head -> origin/gh/IvanKobzarev/142/head 2025-09-07T06:39:15.2697092Z * [new branch] gh/IvanKobzarev/142/orig -> origin/gh/IvanKobzarev/142/orig 2025-09-07T06:39:15.2697290Z * [new branch] gh/IvanKobzarev/143/base -> origin/gh/IvanKobzarev/143/base 2025-09-07T06:39:15.2697490Z * [new branch] gh/IvanKobzarev/143/head -> origin/gh/IvanKobzarev/143/head 2025-09-07T06:39:15.2697726Z * [new branch] gh/IvanKobzarev/143/orig -> origin/gh/IvanKobzarev/143/orig 2025-09-07T06:39:15.2697933Z * [new branch] gh/IvanKobzarev/144/base -> origin/gh/IvanKobzarev/144/base 2025-09-07T06:39:15.2698137Z * [new branch] gh/IvanKobzarev/144/head -> origin/gh/IvanKobzarev/144/head 2025-09-07T06:39:15.2700003Z * [new branch] gh/IvanKobzarev/144/orig -> origin/gh/IvanKobzarev/144/orig 2025-09-07T06:39:15.2700218Z * [new branch] gh/IvanKobzarev/145/base -> origin/gh/IvanKobzarev/145/base 2025-09-07T06:39:15.2700426Z * [new branch] gh/IvanKobzarev/145/head -> origin/gh/IvanKobzarev/145/head 2025-09-07T06:39:15.2700625Z * [new branch] gh/IvanKobzarev/145/orig -> origin/gh/IvanKobzarev/145/orig 2025-09-07T06:39:15.2700833Z * [new branch] gh/IvanKobzarev/146/base -> origin/gh/IvanKobzarev/146/base 2025-09-07T06:39:15.2701040Z * [new branch] gh/IvanKobzarev/146/head -> origin/gh/IvanKobzarev/146/head 2025-09-07T06:39:15.2701240Z * [new branch] gh/IvanKobzarev/146/orig -> origin/gh/IvanKobzarev/146/orig 2025-09-07T06:39:15.2701454Z * [new branch] gh/NikhilAPatel/1/base -> origin/gh/NikhilAPatel/1/base 2025-09-07T06:39:15.2701660Z * [new branch] gh/NikhilAPatel/1/head -> origin/gh/NikhilAPatel/1/head 2025-09-07T06:39:15.2701862Z * [new branch] gh/NikhilAPatel/2/base -> origin/gh/NikhilAPatel/2/base 2025-09-07T06:39:15.2702061Z * [new branch] gh/NikhilAPatel/2/head -> origin/gh/NikhilAPatel/2/head 2025-09-07T06:39:15.2703616Z * [new branch] gh/NikhilAPatel/4/base -> origin/gh/NikhilAPatel/4/base 2025-09-07T06:39:15.2703850Z * [new branch] gh/NikhilAPatel/4/head -> origin/gh/NikhilAPatel/4/head 2025-09-07T06:39:15.2704046Z * [new branch] gh/PaliC/1/base -> origin/gh/PaliC/1/base 2025-09-07T06:39:15.2704232Z * [new branch] gh/PaliC/1/head -> origin/gh/PaliC/1/head 2025-09-07T06:39:15.2704417Z * [new branch] gh/PaliC/1/orig -> origin/gh/PaliC/1/orig 2025-09-07T06:39:15.2704603Z * [new branch] gh/PaliC/17/base -> origin/gh/PaliC/17/base 2025-09-07T06:39:15.2704785Z * [new branch] gh/PaliC/17/head -> origin/gh/PaliC/17/head 2025-09-07T06:39:15.2704961Z * [new branch] gh/PaliC/17/orig -> origin/gh/PaliC/17/orig 2025-09-07T06:39:15.2705135Z * [new branch] gh/PaliC/18/base -> origin/gh/PaliC/18/base 2025-09-07T06:39:15.2705314Z * [new branch] gh/PaliC/18/head -> origin/gh/PaliC/18/head 2025-09-07T06:39:15.2705486Z * [new branch] gh/PaliC/18/orig -> origin/gh/PaliC/18/orig 2025-09-07T06:39:15.2705662Z * [new branch] gh/PaliC/2/base -> origin/gh/PaliC/2/base 2025-09-07T06:39:15.2707159Z * [new branch] gh/PaliC/2/head -> origin/gh/PaliC/2/head 2025-09-07T06:39:15.2707357Z * [new branch] gh/PaliC/2/orig -> origin/gh/PaliC/2/orig 2025-09-07T06:39:15.2707608Z * [new branch] gh/PaliC/20/base -> origin/gh/PaliC/20/base 2025-09-07T06:39:15.2707787Z * [new branch] gh/PaliC/20/head -> origin/gh/PaliC/20/head 2025-09-07T06:39:15.2707961Z * [new branch] gh/PaliC/20/orig -> origin/gh/PaliC/20/orig 2025-09-07T06:39:15.2708136Z * [new branch] gh/PaliC/21/base -> origin/gh/PaliC/21/base 2025-09-07T06:39:15.2708312Z * [new branch] gh/PaliC/21/head -> origin/gh/PaliC/21/head 2025-09-07T06:39:15.2708493Z * [new branch] gh/PaliC/21/orig -> origin/gh/PaliC/21/orig 2025-09-07T06:39:15.2708666Z * [new branch] gh/PaliC/22/base -> origin/gh/PaliC/22/base 2025-09-07T06:39:15.2708887Z * [new branch] gh/PaliC/22/head -> origin/gh/PaliC/22/head 2025-09-07T06:39:15.2709059Z * [new branch] gh/PaliC/22/orig -> origin/gh/PaliC/22/orig 2025-09-07T06:39:15.2709237Z * [new branch] gh/PaliC/23/base -> origin/gh/PaliC/23/base 2025-09-07T06:39:15.2709410Z * [new branch] gh/PaliC/23/head -> origin/gh/PaliC/23/head 2025-09-07T06:39:15.2709584Z * [new branch] gh/PaliC/23/orig -> origin/gh/PaliC/23/orig 2025-09-07T06:39:15.2709770Z * [new branch] gh/PaliC/24/base -> origin/gh/PaliC/24/base 2025-09-07T06:39:15.2709948Z * [new branch] gh/PaliC/24/head -> origin/gh/PaliC/24/head 2025-09-07T06:39:15.2711514Z * [new branch] gh/PaliC/24/orig -> origin/gh/PaliC/24/orig 2025-09-07T06:39:15.2711715Z * [new branch] gh/PaulZhang12/17/base -> origin/gh/PaulZhang12/17/base 2025-09-07T06:39:15.2711925Z * [new branch] gh/PaulZhang12/17/head -> origin/gh/PaulZhang12/17/head 2025-09-07T06:39:15.2712129Z * [new branch] gh/PaulZhang12/20/base -> origin/gh/PaulZhang12/20/base 2025-09-07T06:39:15.2712337Z * [new branch] gh/PaulZhang12/20/head -> origin/gh/PaulZhang12/20/head 2025-09-07T06:39:15.2712537Z * [new branch] gh/PaulZhang12/20/orig -> origin/gh/PaulZhang12/20/orig 2025-09-07T06:39:15.2712728Z * [new branch] gh/PaulZhang12/21/base -> origin/gh/PaulZhang12/21/base 2025-09-07T06:39:15.2712921Z * [new branch] gh/PaulZhang12/21/head -> origin/gh/PaulZhang12/21/head 2025-09-07T06:39:15.2713197Z * [new branch] gh/PaulZhang12/21/orig -> origin/gh/PaulZhang12/21/orig 2025-09-07T06:39:15.2713389Z * [new branch] gh/PaulZhang12/22/base -> origin/gh/PaulZhang12/22/base 2025-09-07T06:39:15.2713578Z * [new branch] gh/PaulZhang12/22/head -> origin/gh/PaulZhang12/22/head 2025-09-07T06:39:15.2715060Z * [new branch] gh/PaulZhang12/22/orig -> origin/gh/PaulZhang12/22/orig 2025-09-07T06:39:15.2715279Z * [new branch] gh/PaulZhang12/23/base -> origin/gh/PaulZhang12/23/base 2025-09-07T06:39:15.2715486Z * [new branch] gh/PaulZhang12/23/head -> origin/gh/PaulZhang12/23/head 2025-09-07T06:39:15.2715677Z * [new branch] gh/PaulZhang12/23/orig -> origin/gh/PaulZhang12/23/orig 2025-09-07T06:39:15.2715869Z * [new branch] gh/PaulZhang12/24/base -> origin/gh/PaulZhang12/24/base 2025-09-07T06:39:15.2716064Z * [new branch] gh/PaulZhang12/24/head -> origin/gh/PaulZhang12/24/head 2025-09-07T06:39:15.2716257Z * [new branch] gh/PaulZhang12/24/orig -> origin/gh/PaulZhang12/24/orig 2025-09-07T06:39:15.2716448Z * [new branch] gh/PaulZhang12/25/base -> origin/gh/PaulZhang12/25/base 2025-09-07T06:39:15.2716649Z * [new branch] gh/PaulZhang12/25/head -> origin/gh/PaulZhang12/25/head 2025-09-07T06:39:15.2716847Z * [new branch] gh/PaulZhang12/25/orig -> origin/gh/PaulZhang12/25/orig 2025-09-07T06:39:15.2717098Z * [new branch] gh/SamGinzburg/11/base -> origin/gh/SamGinzburg/11/base 2025-09-07T06:39:15.2717290Z * [new branch] gh/SamGinzburg/11/head -> origin/gh/SamGinzburg/11/head 2025-09-07T06:39:15.2717498Z * [new branch] gh/Sidharth123-cpu/24/base -> origin/gh/Sidharth123-cpu/24/base 2025-09-07T06:39:15.2717707Z * [new branch] gh/Sidharth123-cpu/25/base -> origin/gh/Sidharth123-cpu/25/base 2025-09-07T06:39:15.2717915Z * [new branch] gh/Sidharth123-cpu/26/base -> origin/gh/Sidharth123-cpu/26/base 2025-09-07T06:39:15.2718122Z * [new branch] gh/Sidharth123-cpu/27/base -> origin/gh/Sidharth123-cpu/27/base 2025-09-07T06:39:15.2718324Z * [new branch] gh/StrongerXi/1/base -> origin/gh/StrongerXi/1/base 2025-09-07T06:39:15.2718563Z * [new branch] gh/StrongerXi/1/head -> origin/gh/StrongerXi/1/head 2025-09-07T06:39:15.2718757Z * [new branch] gh/StrongerXi/133/base -> origin/gh/StrongerXi/133/base 2025-09-07T06:39:15.2718952Z * [new branch] gh/StrongerXi/133/head -> origin/gh/StrongerXi/133/head 2025-09-07T06:39:15.2719146Z * [new branch] gh/StrongerXi/133/orig -> origin/gh/StrongerXi/133/orig 2025-09-07T06:39:15.2720726Z * [new branch] gh/StrongerXi/134/base -> origin/gh/StrongerXi/134/base 2025-09-07T06:39:15.2720937Z * [new branch] gh/StrongerXi/134/head -> origin/gh/StrongerXi/134/head 2025-09-07T06:39:15.2721134Z * [new branch] gh/StrongerXi/134/orig -> origin/gh/StrongerXi/134/orig 2025-09-07T06:39:15.2721330Z * [new branch] gh/StrongerXi/136/base -> origin/gh/StrongerXi/136/base 2025-09-07T06:39:15.2721529Z * [new branch] gh/StrongerXi/136/head -> origin/gh/StrongerXi/136/head 2025-09-07T06:39:15.2721721Z * [new branch] gh/StrongerXi/136/orig -> origin/gh/StrongerXi/136/orig 2025-09-07T06:39:15.2721919Z * [new branch] gh/StrongerXi/137/base -> origin/gh/StrongerXi/137/base 2025-09-07T06:39:15.2722114Z * [new branch] gh/StrongerXi/137/head -> origin/gh/StrongerXi/137/head 2025-09-07T06:39:15.2722317Z * [new branch] gh/StrongerXi/137/orig -> origin/gh/StrongerXi/137/orig 2025-09-07T06:39:15.2722515Z * [new branch] gh/StrongerXi/138/base -> origin/gh/StrongerXi/138/base 2025-09-07T06:39:15.2722708Z * [new branch] gh/StrongerXi/138/head -> origin/gh/StrongerXi/138/head 2025-09-07T06:39:15.2724289Z * [new branch] gh/StrongerXi/138/orig -> origin/gh/StrongerXi/138/orig 2025-09-07T06:39:15.2724511Z * [new branch] gh/StrongerXi/139/base -> origin/gh/StrongerXi/139/base 2025-09-07T06:39:15.2724716Z * [new branch] gh/StrongerXi/139/head -> origin/gh/StrongerXi/139/head 2025-09-07T06:39:15.2724911Z * [new branch] gh/StrongerXi/139/orig -> origin/gh/StrongerXi/139/orig 2025-09-07T06:39:15.2725104Z * [new branch] gh/StrongerXi/140/base -> origin/gh/StrongerXi/140/base 2025-09-07T06:39:15.2725304Z * [new branch] gh/StrongerXi/140/head -> origin/gh/StrongerXi/140/head 2025-09-07T06:39:15.2725499Z * [new branch] gh/StrongerXi/140/orig -> origin/gh/StrongerXi/140/orig 2025-09-07T06:39:15.2725689Z * [new branch] gh/StrongerXi/71/base -> origin/gh/StrongerXi/71/base 2025-09-07T06:39:15.2725882Z * [new branch] gh/StrongerXi/71/head -> origin/gh/StrongerXi/71/head 2025-09-07T06:39:15.2726071Z * [new branch] gh/StrongerXi/72/base -> origin/gh/StrongerXi/72/base 2025-09-07T06:39:15.2726260Z * [new branch] gh/StrongerXi/72/head -> origin/gh/StrongerXi/72/head 2025-09-07T06:39:15.2726462Z * [new branch] gh/XilunWu/133/base -> origin/gh/XilunWu/133/base 2025-09-07T06:39:15.2726652Z * [new branch] gh/XilunWu/133/head -> origin/gh/XilunWu/133/head 2025-09-07T06:39:15.2726901Z * [new branch] gh/XilunWu/133/orig -> origin/gh/XilunWu/133/orig 2025-09-07T06:39:15.2727090Z * [new branch] gh/XilunWu/139/base -> origin/gh/XilunWu/139/base 2025-09-07T06:39:15.2727279Z * [new branch] gh/XilunWu/139/head -> origin/gh/XilunWu/139/head 2025-09-07T06:39:15.2727458Z * [new branch] gh/XilunWu/139/orig -> origin/gh/XilunWu/139/orig 2025-09-07T06:39:15.2727639Z * [new branch] gh/XilunWu/143/base -> origin/gh/XilunWu/143/base 2025-09-07T06:39:15.2727821Z * [new branch] gh/XilunWu/143/head -> origin/gh/XilunWu/143/head 2025-09-07T06:39:15.2728039Z * [new branch] gh/XilunWu/143/orig -> origin/gh/XilunWu/143/orig 2025-09-07T06:39:15.2728224Z * [new branch] gh/XilunWu/144/base -> origin/gh/XilunWu/144/base 2025-09-07T06:39:15.2729767Z * [new branch] gh/XilunWu/144/head -> origin/gh/XilunWu/144/head 2025-09-07T06:39:15.2729969Z * [new branch] gh/XilunWu/144/orig -> origin/gh/XilunWu/144/orig 2025-09-07T06:39:15.2730155Z * [new branch] gh/XilunWu/145/base -> origin/gh/XilunWu/145/base 2025-09-07T06:39:15.2730338Z * [new branch] gh/XilunWu/145/head -> origin/gh/XilunWu/145/head 2025-09-07T06:39:15.2730518Z * [new branch] gh/XilunWu/145/orig -> origin/gh/XilunWu/145/orig 2025-09-07T06:39:15.2730706Z * [new branch] gh/XilunWu/146/base -> origin/gh/XilunWu/146/base 2025-09-07T06:39:15.2730886Z * [new branch] gh/XilunWu/146/head -> origin/gh/XilunWu/146/head 2025-09-07T06:39:15.2731080Z * [new branch] gh/XilunWu/146/orig -> origin/gh/XilunWu/146/orig 2025-09-07T06:39:15.2731261Z * [new branch] gh/XilunWu/147/base -> origin/gh/XilunWu/147/base 2025-09-07T06:39:15.2731449Z * [new branch] gh/XilunWu/147/head -> origin/gh/XilunWu/147/head 2025-09-07T06:39:15.2731637Z * [new branch] gh/XilunWu/147/orig -> origin/gh/XilunWu/147/orig 2025-09-07T06:39:15.2731817Z * [new branch] gh/XilunWu/148/base -> origin/gh/XilunWu/148/base 2025-09-07T06:39:15.2733817Z * [new branch] gh/XilunWu/148/head -> origin/gh/XilunWu/148/head 2025-09-07T06:39:15.2734313Z * [new branch] gh/XilunWu/148/orig -> origin/gh/XilunWu/148/orig 2025-09-07T06:39:15.2734498Z * [new branch] gh/XilunWu/149/base -> origin/gh/XilunWu/149/base 2025-09-07T06:39:15.2734685Z * [new branch] gh/XilunWu/149/head -> origin/gh/XilunWu/149/head 2025-09-07T06:39:15.2734874Z * [new branch] gh/XilunWu/149/orig -> origin/gh/XilunWu/149/orig 2025-09-07T06:39:15.2735059Z * [new branch] gh/XilunWu/150/base -> origin/gh/XilunWu/150/base 2025-09-07T06:39:15.2735242Z * [new branch] gh/XilunWu/150/head -> origin/gh/XilunWu/150/head 2025-09-07T06:39:15.2735425Z * [new branch] gh/XilunWu/150/orig -> origin/gh/XilunWu/150/orig 2025-09-07T06:39:15.2735606Z * [new branch] gh/XilunWu/151/base -> origin/gh/XilunWu/151/base 2025-09-07T06:39:15.2737106Z * [new branch] gh/XilunWu/151/head -> origin/gh/XilunWu/151/head 2025-09-07T06:39:15.2737317Z * [new branch] gh/XilunWu/151/orig -> origin/gh/XilunWu/151/orig 2025-09-07T06:39:15.2737510Z * [new branch] gh/XilunWu/152/base -> origin/gh/XilunWu/152/base 2025-09-07T06:39:15.2737692Z * [new branch] gh/XilunWu/152/head -> origin/gh/XilunWu/152/head 2025-09-07T06:39:15.2737888Z * [new branch] gh/XilunWu/152/orig -> origin/gh/XilunWu/152/orig 2025-09-07T06:39:15.2738081Z * [new branch] gh/XilunWu/153/base -> origin/gh/XilunWu/153/base 2025-09-07T06:39:15.2738322Z * [new branch] gh/XilunWu/153/head -> origin/gh/XilunWu/153/head 2025-09-07T06:39:15.2738503Z * [new branch] gh/XilunWu/153/orig -> origin/gh/XilunWu/153/orig 2025-09-07T06:39:15.2738682Z * [new branch] gh/XilunWu/160/base -> origin/gh/XilunWu/160/base 2025-09-07T06:39:15.2738864Z * [new branch] gh/XilunWu/160/head -> origin/gh/XilunWu/160/head 2025-09-07T06:39:15.2739052Z * [new branch] gh/XilunWu/160/orig -> origin/gh/XilunWu/160/orig 2025-09-07T06:39:15.2739239Z * [new branch] gh/XilunWu/161/base -> origin/gh/XilunWu/161/base 2025-09-07T06:39:15.2739424Z * [new branch] gh/XilunWu/161/head -> origin/gh/XilunWu/161/head 2025-09-07T06:39:15.2739640Z * [new branch] gh/XilunWu/161/orig -> origin/gh/XilunWu/161/orig 2025-09-07T06:39:15.2739820Z * [new branch] gh/XilunWu/163/base -> origin/gh/XilunWu/163/base 2025-09-07T06:39:15.2740009Z * [new branch] gh/XilunWu/163/head -> origin/gh/XilunWu/163/head 2025-09-07T06:39:15.2740188Z * [new branch] gh/XilunWu/163/orig -> origin/gh/XilunWu/163/orig 2025-09-07T06:39:15.2740370Z * [new branch] gh/XilunWu/164/base -> origin/gh/XilunWu/164/base 2025-09-07T06:39:15.2740549Z * [new branch] gh/XilunWu/164/head -> origin/gh/XilunWu/164/head 2025-09-07T06:39:15.2740731Z * [new branch] gh/XilunWu/164/orig -> origin/gh/XilunWu/164/orig 2025-09-07T06:39:15.2740909Z * [new branch] gh/XilunWu/165/base -> origin/gh/XilunWu/165/base 2025-09-07T06:39:15.2741093Z * [new branch] gh/XilunWu/165/head -> origin/gh/XilunWu/165/head 2025-09-07T06:39:15.2741273Z * [new branch] gh/XilunWu/165/orig -> origin/gh/XilunWu/165/orig 2025-09-07T06:39:15.2741451Z * [new branch] gh/XilunWu/166/base -> origin/gh/XilunWu/166/base 2025-09-07T06:39:15.2741637Z * [new branch] gh/XilunWu/166/head -> origin/gh/XilunWu/166/head 2025-09-07T06:39:15.2741818Z * [new branch] gh/XilunWu/166/orig -> origin/gh/XilunWu/166/orig 2025-09-07T06:39:15.2743436Z * [new branch] gh/XilunWu/167/base -> origin/gh/XilunWu/167/base 2025-09-07T06:39:15.2743630Z * [new branch] gh/XilunWu/167/head -> origin/gh/XilunWu/167/head 2025-09-07T06:39:15.2743818Z * [new branch] gh/XilunWu/167/orig -> origin/gh/XilunWu/167/orig 2025-09-07T06:39:15.2744002Z * [new branch] gh/XilunWu/168/base -> origin/gh/XilunWu/168/base 2025-09-07T06:39:15.2744199Z * [new branch] gh/XilunWu/168/head -> origin/gh/XilunWu/168/head 2025-09-07T06:39:15.2744387Z * [new branch] gh/XilunWu/168/orig -> origin/gh/XilunWu/168/orig 2025-09-07T06:39:15.2744569Z * [new branch] gh/XilunWu/169/base -> origin/gh/XilunWu/169/base 2025-09-07T06:39:15.2744750Z * [new branch] gh/XilunWu/169/head -> origin/gh/XilunWu/169/head 2025-09-07T06:39:15.2744931Z * [new branch] gh/XilunWu/169/orig -> origin/gh/XilunWu/169/orig 2025-09-07T06:39:15.2745110Z * [new branch] gh/XilunWu/170/base -> origin/gh/XilunWu/170/base 2025-09-07T06:39:15.2745293Z * [new branch] gh/XilunWu/170/head -> origin/gh/XilunWu/170/head 2025-09-07T06:39:15.2746805Z * [new branch] gh/XilunWu/170/orig -> origin/gh/XilunWu/170/orig 2025-09-07T06:39:15.2747018Z * [new branch] gh/XuehaiPan/14/base -> origin/gh/XuehaiPan/14/base 2025-09-07T06:39:15.2747215Z * [new branch] gh/XuehaiPan/14/head -> origin/gh/XuehaiPan/14/head 2025-09-07T06:39:15.2747407Z * [new branch] gh/XuehaiPan/14/orig -> origin/gh/XuehaiPan/14/orig 2025-09-07T06:39:15.2747681Z * [new branch] gh/XuehaiPan/179/base -> origin/gh/XuehaiPan/179/base 2025-09-07T06:39:15.2747883Z * [new branch] gh/XuehaiPan/179/head -> origin/gh/XuehaiPan/179/head 2025-09-07T06:39:15.2748078Z * [new branch] gh/XuehaiPan/179/orig -> origin/gh/XuehaiPan/179/orig 2025-09-07T06:39:15.2748267Z * [new branch] gh/XuehaiPan/189/base -> origin/gh/XuehaiPan/189/base 2025-09-07T06:39:15.2748461Z * [new branch] gh/XuehaiPan/189/head -> origin/gh/XuehaiPan/189/head 2025-09-07T06:39:15.2748652Z * [new branch] gh/XuehaiPan/189/orig -> origin/gh/XuehaiPan/189/orig 2025-09-07T06:39:15.2748843Z * [new branch] gh/XuehaiPan/232/base -> origin/gh/XuehaiPan/232/base 2025-09-07T06:39:15.2749073Z * [new branch] gh/XuehaiPan/232/head -> origin/gh/XuehaiPan/232/head 2025-09-07T06:39:15.2750595Z * [new branch] gh/XuehaiPan/232/orig -> origin/gh/XuehaiPan/232/orig 2025-09-07T06:39:15.2750806Z * [new branch] gh/XuehaiPan/249/base -> origin/gh/XuehaiPan/249/base 2025-09-07T06:39:15.2750994Z * [new branch] gh/XuehaiPan/249/head -> origin/gh/XuehaiPan/249/head 2025-09-07T06:39:15.2751183Z * [new branch] gh/XuehaiPan/249/orig -> origin/gh/XuehaiPan/249/orig 2025-09-07T06:39:15.2751373Z * [new branch] gh/XuehaiPan/253/base -> origin/gh/XuehaiPan/253/base 2025-09-07T06:39:15.2751566Z * [new branch] gh/XuehaiPan/253/head -> origin/gh/XuehaiPan/253/head 2025-09-07T06:39:15.2751755Z * [new branch] gh/XuehaiPan/253/orig -> origin/gh/XuehaiPan/253/orig 2025-09-07T06:39:15.2751952Z * [new branch] gh/XuehaiPan/254/base -> origin/gh/XuehaiPan/254/base 2025-09-07T06:39:15.2752144Z * [new branch] gh/XuehaiPan/254/head -> origin/gh/XuehaiPan/254/head 2025-09-07T06:39:15.2752333Z * [new branch] gh/XuehaiPan/254/orig -> origin/gh/XuehaiPan/254/orig 2025-09-07T06:39:15.2752524Z * [new branch] gh/XuehaiPan/255/base -> origin/gh/XuehaiPan/255/base 2025-09-07T06:39:15.2752716Z * [new branch] gh/XuehaiPan/255/head -> origin/gh/XuehaiPan/255/head 2025-09-07T06:39:15.2752906Z * [new branch] gh/XuehaiPan/255/orig -> origin/gh/XuehaiPan/255/orig 2025-09-07T06:39:15.2753184Z * [new branch] gh/XuehaiPan/257/base -> origin/gh/XuehaiPan/257/base 2025-09-07T06:39:15.2753377Z * [new branch] gh/XuehaiPan/257/head -> origin/gh/XuehaiPan/257/head 2025-09-07T06:39:15.2753571Z * [new branch] gh/XuehaiPan/257/orig -> origin/gh/XuehaiPan/257/orig 2025-09-07T06:39:15.2753772Z * [new branch] gh/XuehaiPan/271/base -> origin/gh/XuehaiPan/271/base 2025-09-07T06:39:15.2753959Z * [new branch] gh/XuehaiPan/271/head -> origin/gh/XuehaiPan/271/head 2025-09-07T06:39:15.2754147Z * [new branch] gh/XuehaiPan/271/orig -> origin/gh/XuehaiPan/271/orig 2025-09-07T06:39:15.2754334Z * [new branch] gh/XuehaiPan/290/base -> origin/gh/XuehaiPan/290/base 2025-09-07T06:39:15.2754524Z * [new branch] gh/XuehaiPan/290/head -> origin/gh/XuehaiPan/290/head 2025-09-07T06:39:15.2756013Z * [new branch] gh/XuehaiPan/290/orig -> origin/gh/XuehaiPan/290/orig 2025-09-07T06:39:15.2756220Z * [new branch] gh/XuehaiPan/343/base -> origin/gh/XuehaiPan/343/base 2025-09-07T06:39:15.2756410Z * [new branch] gh/XuehaiPan/343/head -> origin/gh/XuehaiPan/343/head 2025-09-07T06:39:15.2756599Z * [new branch] gh/XuehaiPan/343/orig -> origin/gh/XuehaiPan/343/orig 2025-09-07T06:39:15.2756793Z * [new branch] gh/XuehaiPan/347/base -> origin/gh/XuehaiPan/347/base 2025-09-07T06:39:15.2756996Z * [new branch] gh/XuehaiPan/347/head -> origin/gh/XuehaiPan/347/head 2025-09-07T06:39:15.2757246Z * [new branch] gh/XuehaiPan/347/orig -> origin/gh/XuehaiPan/347/orig 2025-09-07T06:39:15.2757434Z * [new branch] gh/XuehaiPan/348/base -> origin/gh/XuehaiPan/348/base 2025-09-07T06:39:15.2757624Z * [new branch] gh/XuehaiPan/348/head -> origin/gh/XuehaiPan/348/head 2025-09-07T06:39:15.2757810Z * [new branch] gh/XuehaiPan/348/orig -> origin/gh/XuehaiPan/348/orig 2025-09-07T06:39:15.2758000Z * [new branch] gh/XuehaiPan/350/base -> origin/gh/XuehaiPan/350/base 2025-09-07T06:39:15.2759373Z * [new branch] gh/XuehaiPan/350/head -> origin/gh/XuehaiPan/350/head 2025-09-07T06:39:15.2759588Z * [new branch] gh/XuehaiPan/350/orig -> origin/gh/XuehaiPan/350/orig 2025-09-07T06:39:15.2759845Z * [new branch] gh/XuehaiPan/356/base -> origin/gh/XuehaiPan/356/base 2025-09-07T06:39:15.2760033Z * [new branch] gh/XuehaiPan/356/head -> origin/gh/XuehaiPan/356/head 2025-09-07T06:39:15.2760223Z * [new branch] gh/XuehaiPan/356/orig -> origin/gh/XuehaiPan/356/orig 2025-09-07T06:39:15.2760413Z * [new branch] gh/XuehaiPan/357/base -> origin/gh/XuehaiPan/357/base 2025-09-07T06:39:15.2760603Z * [new branch] gh/XuehaiPan/357/head -> origin/gh/XuehaiPan/357/head 2025-09-07T06:39:15.2760807Z * [new branch] gh/XuehaiPan/357/orig -> origin/gh/XuehaiPan/357/orig 2025-09-07T06:39:15.2760994Z * [new branch] gh/XuehaiPan/358/base -> origin/gh/XuehaiPan/358/base 2025-09-07T06:39:15.2761191Z * [new branch] gh/XuehaiPan/358/head -> origin/gh/XuehaiPan/358/head 2025-09-07T06:39:15.2761383Z * [new branch] gh/XuehaiPan/358/orig -> origin/gh/XuehaiPan/358/orig 2025-09-07T06:39:15.2761581Z * [new branch] gh/XuehaiPan/359/base -> origin/gh/XuehaiPan/359/base 2025-09-07T06:39:15.2761770Z * [new branch] gh/XuehaiPan/359/head -> origin/gh/XuehaiPan/359/head 2025-09-07T06:39:15.2761959Z * [new branch] gh/XuehaiPan/359/orig -> origin/gh/XuehaiPan/359/orig 2025-09-07T06:39:15.2762146Z * [new branch] gh/XuehaiPan/360/base -> origin/gh/XuehaiPan/360/base 2025-09-07T06:39:15.2762333Z * [new branch] gh/XuehaiPan/360/head -> origin/gh/XuehaiPan/360/head 2025-09-07T06:39:15.2762523Z * [new branch] gh/XuehaiPan/360/orig -> origin/gh/XuehaiPan/360/orig 2025-09-07T06:39:15.2762710Z * [new branch] gh/XuehaiPan/365/base -> origin/gh/XuehaiPan/365/base 2025-09-07T06:39:15.2762897Z * [new branch] gh/XuehaiPan/365/head -> origin/gh/XuehaiPan/365/head 2025-09-07T06:39:15.2763184Z * [new branch] gh/XuehaiPan/365/orig -> origin/gh/XuehaiPan/365/orig 2025-09-07T06:39:15.2763374Z * [new branch] gh/XuehaiPan/366/base -> origin/gh/XuehaiPan/366/base 2025-09-07T06:39:15.2764994Z * [new branch] gh/XuehaiPan/366/head -> origin/gh/XuehaiPan/366/head 2025-09-07T06:39:15.2765213Z * [new branch] gh/XuehaiPan/369/base -> origin/gh/XuehaiPan/369/base 2025-09-07T06:39:15.2765407Z * [new branch] gh/XuehaiPan/369/head -> origin/gh/XuehaiPan/369/head 2025-09-07T06:39:15.2765605Z * [new branch] gh/XuehaiPan/369/orig -> origin/gh/XuehaiPan/369/orig 2025-09-07T06:39:15.2765797Z * [new branch] gh/XuehaiPan/370/base -> origin/gh/XuehaiPan/370/base 2025-09-07T06:39:15.2765984Z * [new branch] gh/XuehaiPan/370/head -> origin/gh/XuehaiPan/370/head 2025-09-07T06:39:15.2766177Z * [new branch] gh/XuehaiPan/370/orig -> origin/gh/XuehaiPan/370/orig 2025-09-07T06:39:15.2766370Z * [new branch] gh/XuehaiPan/380/base -> origin/gh/XuehaiPan/380/base 2025-09-07T06:39:15.2766557Z * [new branch] gh/XuehaiPan/380/head -> origin/gh/XuehaiPan/380/head 2025-09-07T06:39:15.2766798Z * [new branch] gh/XuehaiPan/380/orig -> origin/gh/XuehaiPan/380/orig 2025-09-07T06:39:15.2766993Z * [new branch] gh/XuehaiPan/381/base -> origin/gh/XuehaiPan/381/base 2025-09-07T06:39:15.2767187Z * [new branch] gh/XuehaiPan/381/head -> origin/gh/XuehaiPan/381/head 2025-09-07T06:39:15.2769419Z * [new branch] gh/XuehaiPan/382/base -> origin/gh/XuehaiPan/382/base 2025-09-07T06:39:15.2769647Z * [new branch] gh/XuehaiPan/382/head -> origin/gh/XuehaiPan/382/head 2025-09-07T06:39:15.2769850Z * [new branch] gh/XuehaiPan/382/orig -> origin/gh/XuehaiPan/382/orig 2025-09-07T06:39:15.2770114Z * [new branch] gh/XuehaiPan/383/base -> origin/gh/XuehaiPan/383/base 2025-09-07T06:39:15.2770307Z * [new branch] gh/XuehaiPan/383/head -> origin/gh/XuehaiPan/383/head 2025-09-07T06:39:15.2770494Z * [new branch] gh/XuehaiPan/383/orig -> origin/gh/XuehaiPan/383/orig 2025-09-07T06:39:15.2770692Z * [new branch] gh/XuehaiPan/384/base -> origin/gh/XuehaiPan/384/base 2025-09-07T06:39:15.2770881Z * [new branch] gh/XuehaiPan/384/head -> origin/gh/XuehaiPan/384/head 2025-09-07T06:39:15.2771068Z * [new branch] gh/XuehaiPan/384/orig -> origin/gh/XuehaiPan/384/orig 2025-09-07T06:39:15.2771255Z * [new branch] gh/XuehaiPan/385/base -> origin/gh/XuehaiPan/385/base 2025-09-07T06:39:15.2771445Z * [new branch] gh/XuehaiPan/385/head -> origin/gh/XuehaiPan/385/head 2025-09-07T06:39:15.2771633Z * [new branch] gh/XuehaiPan/385/orig -> origin/gh/XuehaiPan/385/orig 2025-09-07T06:39:15.2773221Z * [new branch] gh/XuehaiPan/386/base -> origin/gh/XuehaiPan/386/base 2025-09-07T06:39:15.2773432Z * [new branch] gh/XuehaiPan/386/head -> origin/gh/XuehaiPan/386/head 2025-09-07T06:39:15.2773636Z * [new branch] gh/XuehaiPan/386/orig -> origin/gh/XuehaiPan/386/orig 2025-09-07T06:39:15.2773824Z * [new branch] gh/XuehaiPan/387/base -> origin/gh/XuehaiPan/387/base 2025-09-07T06:39:15.2774013Z * [new branch] gh/XuehaiPan/387/head -> origin/gh/XuehaiPan/387/head 2025-09-07T06:39:15.2774202Z * [new branch] gh/XuehaiPan/387/orig -> origin/gh/XuehaiPan/387/orig 2025-09-07T06:39:15.2774393Z * [new branch] gh/ZainRizvi/1/base -> origin/gh/ZainRizvi/1/base 2025-09-07T06:39:15.2774581Z * [new branch] gh/ZainRizvi/1/head -> origin/gh/ZainRizvi/1/head 2025-09-07T06:39:15.2774764Z * [new branch] gh/ZainRizvi/2/base -> origin/gh/ZainRizvi/2/base 2025-09-07T06:39:15.2774953Z * [new branch] gh/ZainRizvi/2/head -> origin/gh/ZainRizvi/2/head 2025-09-07T06:39:15.2775148Z * [new branch] gh/ZainRizvi/3/base -> origin/gh/ZainRizvi/3/base 2025-09-07T06:39:15.2775332Z * [new branch] gh/ZainRizvi/3/head -> origin/gh/ZainRizvi/3/head 2025-09-07T06:39:15.2776839Z * [new branch] gh/ZainRizvi/4/base -> origin/gh/ZainRizvi/4/base 2025-09-07T06:39:15.2777024Z * [new branch] gh/ZainRizvi/4/head -> origin/gh/ZainRizvi/4/head 2025-09-07T06:39:15.2777205Z * [new branch] gh/ZainRizvi/5/base -> origin/gh/ZainRizvi/5/base 2025-09-07T06:39:15.2777387Z * [new branch] gh/ZainRizvi/5/head -> origin/gh/ZainRizvi/5/head 2025-09-07T06:39:15.2777575Z * [new branch] gh/ZainRizvi/6/base -> origin/gh/ZainRizvi/6/base 2025-09-07T06:39:15.2777764Z * [new branch] gh/ZainRizvi/6/head -> origin/gh/ZainRizvi/6/head 2025-09-07T06:39:15.2777946Z * [new branch] gh/ZainRizvi/6/orig -> origin/gh/ZainRizvi/6/orig 2025-09-07T06:39:15.2778126Z * [new branch] gh/ZainRizvi/7/base -> origin/gh/ZainRizvi/7/base 2025-09-07T06:39:15.2778361Z * [new branch] gh/ZainRizvi/7/head -> origin/gh/ZainRizvi/7/head 2025-09-07T06:39:15.2778544Z * [new branch] gh/ZainRizvi/7/orig -> origin/gh/ZainRizvi/7/orig 2025-09-07T06:39:15.2778728Z * [new branch] gh/ZainRizvi/8/base -> origin/gh/ZainRizvi/8/base 2025-09-07T06:39:15.2778915Z * [new branch] gh/ZainRizvi/8/head -> origin/gh/ZainRizvi/8/head 2025-09-07T06:39:15.2779098Z * [new branch] gh/ZainRizvi/9/base -> origin/gh/ZainRizvi/9/base 2025-09-07T06:39:15.2779279Z * [new branch] gh/ZainRizvi/9/head -> origin/gh/ZainRizvi/9/head 2025-09-07T06:39:15.2779504Z * [new branch] gh/ZainRizvi/9/orig -> origin/gh/ZainRizvi/9/orig 2025-09-07T06:39:15.2779711Z * [new branch] gh/ZhiweiYan-96/39/base -> origin/gh/ZhiweiYan-96/39/base 2025-09-07T06:39:15.2779907Z * [new branch] gh/ZhiweiYan-96/39/head -> origin/gh/ZhiweiYan-96/39/head 2025-09-07T06:39:15.2780100Z * [new branch] gh/ZhiweiYan-96/39/orig -> origin/gh/ZhiweiYan-96/39/orig 2025-09-07T06:39:15.2780298Z * [new branch] gh/ZhiweiYan-96/44/base -> origin/gh/ZhiweiYan-96/44/base 2025-09-07T06:39:15.2780492Z * [new branch] gh/ZhiweiYan-96/44/head -> origin/gh/ZhiweiYan-96/44/head 2025-09-07T06:39:15.2780689Z * [new branch] gh/ZhiweiYan-96/45/base -> origin/gh/ZhiweiYan-96/45/base 2025-09-07T06:39:15.2782226Z * [new branch] gh/ZhiweiYan-96/45/head -> origin/gh/ZhiweiYan-96/45/head 2025-09-07T06:39:15.2782430Z * [new branch] gh/ZhiweiYan-96/49/base -> origin/gh/ZhiweiYan-96/49/base 2025-09-07T06:39:15.2782627Z * [new branch] gh/ZhiweiYan-96/49/head -> origin/gh/ZhiweiYan-96/49/head 2025-09-07T06:39:15.2782825Z * [new branch] gh/ZhiweiYan-96/62/base -> origin/gh/ZhiweiYan-96/62/base 2025-09-07T06:39:15.2783024Z * [new branch] gh/ZhiweiYan-96/62/head -> origin/gh/ZhiweiYan-96/62/head 2025-09-07T06:39:15.2783338Z * [new branch] gh/ZhiweiYan-96/64/base -> origin/gh/ZhiweiYan-96/64/base 2025-09-07T06:39:15.2783533Z * [new branch] gh/ZhiweiYan-96/64/head -> origin/gh/ZhiweiYan-96/64/head 2025-09-07T06:39:15.2783722Z * [new branch] gh/ZhiweiYan-96/64/orig -> origin/gh/ZhiweiYan-96/64/orig 2025-09-07T06:39:15.2783912Z * [new branch] gh/ZhiweiYan-96/65/base -> origin/gh/ZhiweiYan-96/65/base 2025-09-07T06:39:15.2784102Z * [new branch] gh/ZhiweiYan-96/65/head -> origin/gh/ZhiweiYan-96/65/head 2025-09-07T06:39:15.2784296Z * [new branch] gh/ZhiweiYan-96/65/orig -> origin/gh/ZhiweiYan-96/65/orig 2025-09-07T06:39:15.2785644Z * [new branch] gh/ZhiweiYan-96/66/base -> origin/gh/ZhiweiYan-96/66/base 2025-09-07T06:39:15.2785856Z * [new branch] gh/ZhiweiYan-96/66/head -> origin/gh/ZhiweiYan-96/66/head 2025-09-07T06:39:15.2786050Z * [new branch] gh/ZhiweiYan-96/67/base -> origin/gh/ZhiweiYan-96/67/base 2025-09-07T06:39:15.2786238Z * [new branch] gh/ZhiweiYan-96/67/head -> origin/gh/ZhiweiYan-96/67/head 2025-09-07T06:39:15.2786428Z * [new branch] gh/ZhiweiYan-96/68/base -> origin/gh/ZhiweiYan-96/68/base 2025-09-07T06:39:15.2786629Z * [new branch] gh/ZhiweiYan-96/68/head -> origin/gh/ZhiweiYan-96/68/head 2025-09-07T06:39:15.2786818Z * [new branch] gh/ZhiweiYan-96/68/orig -> origin/gh/ZhiweiYan-96/68/orig 2025-09-07T06:39:15.2787007Z * [new branch] gh/aakhundov/1/base -> origin/gh/aakhundov/1/base 2025-09-07T06:39:15.2787196Z * [new branch] gh/aakhundov/1/head -> origin/gh/aakhundov/1/head 2025-09-07T06:39:15.2787379Z * [new branch] gh/aakhundov/2/base -> origin/gh/aakhundov/2/base 2025-09-07T06:39:15.2787626Z * [new branch] gh/aakhundov/2/head -> origin/gh/aakhundov/2/head 2025-09-07T06:39:15.2787815Z * [new branch] gh/aditew01/openblas -> origin/gh/aditew01/openblas 2025-09-07T06:39:15.2789211Z * [new branch] gh/aditew01/sbgemm -> origin/gh/aditew01/sbgemm 2025-09-07T06:39:15.2789407Z * [new branch] gh/aditew01/vecbf16 -> origin/gh/aditew01/vecbf16 2025-09-07T06:39:15.2789676Z * [new branch] gh/alexbrauckmann/paddedtensor_faketensor_init -> origin/gh/alexbrauckmann/paddedtensor_faketensor_init 2025-09-07T06:39:15.2789944Z * [new branch] gh/alexsamardzic/9/base -> origin/gh/alexsamardzic/9/base 2025-09-07T06:39:15.2790200Z * [new branch] gh/alexsamardzic/9/head -> origin/gh/alexsamardzic/9/head 2025-09-07T06:39:15.2790404Z * [new branch] gh/alexsamardzic/9/orig -> origin/gh/alexsamardzic/9/orig 2025-09-07T06:39:15.2790593Z * [new branch] gh/amjames/18/base -> origin/gh/amjames/18/base 2025-09-07T06:39:15.2790781Z * [new branch] gh/amjames/18/head -> origin/gh/amjames/18/head 2025-09-07T06:39:15.2790961Z * [new branch] gh/amjames/18/orig -> origin/gh/amjames/18/orig 2025-09-07T06:39:15.2791147Z * [new branch] gh/andrewor14/35/base -> origin/gh/andrewor14/35/base 2025-09-07T06:39:15.2791336Z * [new branch] gh/andrewor14/35/head -> origin/gh/andrewor14/35/head 2025-09-07T06:39:15.2791528Z * [new branch] gh/andrewor14/35/orig -> origin/gh/andrewor14/35/orig 2025-09-07T06:39:15.2791728Z * [new branch] gh/andrewor14/50/base -> origin/gh/andrewor14/50/base 2025-09-07T06:39:15.2791917Z * [new branch] gh/andrewor14/50/head -> origin/gh/andrewor14/50/head 2025-09-07T06:39:15.2792102Z * [new branch] gh/andrewor14/50/orig -> origin/gh/andrewor14/50/orig 2025-09-07T06:39:15.2792290Z * [new branch] gh/andrewor14/51/base -> origin/gh/andrewor14/51/base 2025-09-07T06:39:15.2792476Z * [new branch] gh/andrewor14/51/orig -> origin/gh/andrewor14/51/orig 2025-09-07T06:39:15.2794350Z * [new branch] gh/andyanwang/1/base -> origin/gh/andyanwang/1/base 2025-09-07T06:39:15.2794550Z * [new branch] gh/andyanwang/1/head -> origin/gh/andyanwang/1/head 2025-09-07T06:39:15.2794745Z * [new branch] gh/andyanwang/1/orig -> origin/gh/andyanwang/1/orig 2025-09-07T06:39:15.2794940Z * [new branch] gh/andyanwang/13/base -> origin/gh/andyanwang/13/base 2025-09-07T06:39:15.2795132Z * [new branch] gh/andyanwang/13/head -> origin/gh/andyanwang/13/head 2025-09-07T06:39:15.2795335Z * [new branch] gh/andyanwang/13/orig -> origin/gh/andyanwang/13/orig 2025-09-07T06:39:15.2795527Z * [new branch] gh/andyanwang/2/base -> origin/gh/andyanwang/2/base 2025-09-07T06:39:15.2795720Z * [new branch] gh/andyanwang/2/head -> origin/gh/andyanwang/2/head 2025-09-07T06:39:15.2795909Z * [new branch] gh/andyanwang/2/orig -> origin/gh/andyanwang/2/orig 2025-09-07T06:39:15.2796097Z * [new branch] gh/andyanwang/28/base -> origin/gh/andyanwang/28/base 2025-09-07T06:39:15.2796286Z * [new branch] gh/andyanwang/28/head -> origin/gh/andyanwang/28/head 2025-09-07T06:39:15.2797771Z * [new branch] gh/andyanwang/28/orig -> origin/gh/andyanwang/28/orig 2025-09-07T06:39:15.2797981Z * [new branch] gh/andyanwang/3/base -> origin/gh/andyanwang/3/base 2025-09-07T06:39:15.2798185Z * [new branch] gh/andyanwang/3/head -> origin/gh/andyanwang/3/head 2025-09-07T06:39:15.2798379Z * [new branch] gh/andyanwang/3/orig -> origin/gh/andyanwang/3/orig 2025-09-07T06:39:15.2798570Z * [new branch] gh/andyanwang/30/base -> origin/gh/andyanwang/30/base 2025-09-07T06:39:15.2798822Z * [new branch] gh/andyanwang/30/orig -> origin/gh/andyanwang/30/orig 2025-09-07T06:39:15.2799023Z * [new branch] gh/andyanwang/31/base -> origin/gh/andyanwang/31/base 2025-09-07T06:39:15.2799214Z * [new branch] gh/andyanwang/31/orig -> origin/gh/andyanwang/31/orig 2025-09-07T06:39:15.2799403Z * [new branch] gh/andyanwang/32/base -> origin/gh/andyanwang/32/base 2025-09-07T06:39:15.2799590Z * [new branch] gh/andyanwang/32/head -> origin/gh/andyanwang/32/head 2025-09-07T06:39:15.2799780Z * [new branch] gh/andyanwang/32/orig -> origin/gh/andyanwang/32/orig 2025-09-07T06:39:15.2800011Z * [new branch] gh/andyanwang/39/base -> origin/gh/andyanwang/39/base 2025-09-07T06:39:15.2801502Z * [new branch] gh/andyanwang/39/head -> origin/gh/andyanwang/39/head 2025-09-07T06:39:15.2801706Z * [new branch] gh/andyanwang/39/orig -> origin/gh/andyanwang/39/orig 2025-09-07T06:39:15.2801910Z * [new branch] gh/andyanwang/4/base -> origin/gh/andyanwang/4/base 2025-09-07T06:39:15.2802098Z * [new branch] gh/andyanwang/4/head -> origin/gh/andyanwang/4/head 2025-09-07T06:39:15.2802289Z * [new branch] gh/andyanwang/4/orig -> origin/gh/andyanwang/4/orig 2025-09-07T06:39:15.2802478Z * [new branch] gh/angelayi/107/base -> origin/gh/angelayi/107/base 2025-09-07T06:39:15.2802668Z * [new branch] gh/angelayi/107/head -> origin/gh/angelayi/107/head 2025-09-07T06:39:15.2802853Z * [new branch] gh/angelayi/111/base -> origin/gh/angelayi/111/base 2025-09-07T06:39:15.2803042Z * [new branch] gh/angelayi/111/head -> origin/gh/angelayi/111/head 2025-09-07T06:39:15.2803319Z * [new branch] gh/angelayi/111/orig -> origin/gh/angelayi/111/orig 2025-09-07T06:39:15.2803505Z * [new branch] gh/angelayi/112/base -> origin/gh/angelayi/112/base 2025-09-07T06:39:15.2803699Z * [new branch] gh/angelayi/112/head -> origin/gh/angelayi/112/head 2025-09-07T06:39:15.2803885Z * [new branch] gh/angelayi/112/orig -> origin/gh/angelayi/112/orig 2025-09-07T06:39:15.2804086Z * [new branch] gh/angelayi/113/base -> origin/gh/angelayi/113/base 2025-09-07T06:39:15.2804269Z * [new branch] gh/angelayi/113/head -> origin/gh/angelayi/113/head 2025-09-07T06:39:15.2804459Z * [new branch] gh/angelayi/113/orig -> origin/gh/angelayi/113/orig 2025-09-07T06:39:15.2804642Z * [new branch] gh/angelayi/114/base -> origin/gh/angelayi/114/base 2025-09-07T06:39:15.2806173Z * [new branch] gh/angelayi/114/head -> origin/gh/angelayi/114/head 2025-09-07T06:39:15.2806381Z * [new branch] gh/angelayi/114/orig -> origin/gh/angelayi/114/orig 2025-09-07T06:39:15.2806582Z * [new branch] gh/angelayi/115/base -> origin/gh/angelayi/115/base 2025-09-07T06:39:15.2806767Z * [new branch] gh/angelayi/115/head -> origin/gh/angelayi/115/head 2025-09-07T06:39:15.2806950Z * [new branch] gh/angelayi/115/orig -> origin/gh/angelayi/115/orig 2025-09-07T06:39:15.2807142Z * [new branch] gh/anijain2305/753/base -> origin/gh/anijain2305/753/base 2025-09-07T06:39:15.2807336Z * [new branch] gh/anijain2305/753/head -> origin/gh/anijain2305/753/head 2025-09-07T06:39:15.2807535Z * [new branch] gh/anijain2305/753/orig -> origin/gh/anijain2305/753/orig 2025-09-07T06:39:15.2807731Z * [new branch] gh/anijain2305/766/base -> origin/gh/anijain2305/766/base 2025-09-07T06:39:15.2807921Z * [new branch] gh/anijain2305/766/head -> origin/gh/anijain2305/766/head 2025-09-07T06:39:15.2808111Z * [new branch] gh/anijain2305/766/orig -> origin/gh/anijain2305/766/orig 2025-09-07T06:39:15.2808447Z * [new branch] gh/anijain2305/790/base -> origin/gh/anijain2305/790/base 2025-09-07T06:39:15.2809909Z * [new branch] gh/anijain2305/790/head -> origin/gh/anijain2305/790/head 2025-09-07T06:39:15.2810123Z * [new branch] gh/anijain2305/790/orig -> origin/gh/anijain2305/790/orig 2025-09-07T06:39:15.2810336Z * [new branch] gh/anijain2305/792/base -> origin/gh/anijain2305/792/base 2025-09-07T06:39:15.2810527Z * [new branch] gh/anijain2305/792/head -> origin/gh/anijain2305/792/head 2025-09-07T06:39:15.2810718Z * [new branch] gh/anijain2305/792/orig -> origin/gh/anijain2305/792/orig 2025-09-07T06:39:15.2810977Z * [new branch] gh/anijain2305/803/base -> origin/gh/anijain2305/803/base 2025-09-07T06:39:15.2811173Z * [new branch] gh/anijain2305/803/head -> origin/gh/anijain2305/803/head 2025-09-07T06:39:15.2811368Z * [new branch] gh/anijain2305/803/orig -> origin/gh/anijain2305/803/orig 2025-09-07T06:39:15.2811559Z * [new branch] gh/anijain2305/804/base -> origin/gh/anijain2305/804/base 2025-09-07T06:39:15.2811749Z * [new branch] gh/anijain2305/804/head -> origin/gh/anijain2305/804/head 2025-09-07T06:39:15.2811940Z * [new branch] gh/anijain2305/804/orig -> origin/gh/anijain2305/804/orig 2025-09-07T06:39:15.2812134Z * [new branch] gh/anijain2305/805/base -> origin/gh/anijain2305/805/base 2025-09-07T06:39:15.2812324Z * [new branch] gh/anijain2305/805/head -> origin/gh/anijain2305/805/head 2025-09-07T06:39:15.2812527Z * [new branch] gh/anijain2305/805/orig -> origin/gh/anijain2305/805/orig 2025-09-07T06:39:15.2812718Z * [new branch] gh/anijain2305/810/base -> origin/gh/anijain2305/810/base 2025-09-07T06:39:15.2812916Z * [new branch] gh/anijain2305/810/head -> origin/gh/anijain2305/810/head 2025-09-07T06:39:15.2813203Z * [new branch] gh/anijain2305/810/orig -> origin/gh/anijain2305/810/orig 2025-09-07T06:39:15.2813395Z * [new branch] gh/anijain2305/812/base -> origin/gh/anijain2305/812/base 2025-09-07T06:39:15.2813586Z * [new branch] gh/anijain2305/812/head -> origin/gh/anijain2305/812/head 2025-09-07T06:39:15.2813776Z * [new branch] gh/anijain2305/812/orig -> origin/gh/anijain2305/812/orig 2025-09-07T06:39:15.2815990Z * [new branch] gh/anijain2305/838/base -> origin/gh/anijain2305/838/base 2025-09-07T06:39:15.2816214Z * [new branch] gh/anijain2305/838/head -> origin/gh/anijain2305/838/head 2025-09-07T06:39:15.2816418Z * [new branch] gh/anijain2305/838/orig -> origin/gh/anijain2305/838/orig 2025-09-07T06:39:15.2816615Z * [new branch] gh/anijain2305/839/base -> origin/gh/anijain2305/839/base 2025-09-07T06:39:15.2816818Z * [new branch] gh/anijain2305/839/head -> origin/gh/anijain2305/839/head 2025-09-07T06:39:15.2817010Z * [new branch] gh/anijain2305/839/orig -> origin/gh/anijain2305/839/orig 2025-09-07T06:39:15.2817202Z * [new branch] gh/anijain2305/843/base -> origin/gh/anijain2305/843/base 2025-09-07T06:39:15.2817393Z * [new branch] gh/anijain2305/843/head -> origin/gh/anijain2305/843/head 2025-09-07T06:39:15.2817584Z * [new branch] gh/anijain2305/843/orig -> origin/gh/anijain2305/843/orig 2025-09-07T06:39:15.2817781Z * [new branch] gh/anijain2305/844/base -> origin/gh/anijain2305/844/base 2025-09-07T06:39:15.2817973Z * [new branch] gh/anijain2305/844/head -> origin/gh/anijain2305/844/head 2025-09-07T06:39:15.2818167Z * [new branch] gh/anijain2305/844/orig -> origin/gh/anijain2305/844/orig 2025-09-07T06:39:15.2818357Z * [new branch] gh/anijain2305/846/base -> origin/gh/anijain2305/846/base 2025-09-07T06:39:15.2818605Z * [new branch] gh/anijain2305/846/head -> origin/gh/anijain2305/846/head 2025-09-07T06:39:15.2818802Z * [new branch] gh/anijain2305/846/orig -> origin/gh/anijain2305/846/orig 2025-09-07T06:39:15.2818993Z * [new branch] gh/anijain2305/848/base -> origin/gh/anijain2305/848/base 2025-09-07T06:39:15.2819185Z * [new branch] gh/anijain2305/848/head -> origin/gh/anijain2305/848/head 2025-09-07T06:39:15.2819375Z * [new branch] gh/anijain2305/848/orig -> origin/gh/anijain2305/848/orig 2025-09-07T06:39:15.2819567Z * [new branch] gh/anijain2305/849/base -> origin/gh/anijain2305/849/base 2025-09-07T06:39:15.2819801Z * [new branch] gh/anijain2305/849/head -> origin/gh/anijain2305/849/head 2025-09-07T06:39:15.2819993Z * [new branch] gh/anijain2305/849/orig -> origin/gh/anijain2305/849/orig 2025-09-07T06:39:15.2820186Z * [new branch] gh/anijain2305/850/base -> origin/gh/anijain2305/850/base 2025-09-07T06:39:15.2820375Z * [new branch] gh/anijain2305/850/head -> origin/gh/anijain2305/850/head 2025-09-07T06:39:15.2820567Z * [new branch] gh/anijain2305/850/orig -> origin/gh/anijain2305/850/orig 2025-09-07T06:39:15.2820756Z * [new branch] gh/anijain2305/851/base -> origin/gh/anijain2305/851/base 2025-09-07T06:39:15.2820950Z * [new branch] gh/anijain2305/851/head -> origin/gh/anijain2305/851/head 2025-09-07T06:39:15.2821150Z * [new branch] gh/anijain2305/851/orig -> origin/gh/anijain2305/851/orig 2025-09-07T06:39:15.2821366Z * [new branch] gh/anijain2305/852/base -> origin/gh/anijain2305/852/base 2025-09-07T06:39:15.2821608Z * [new branch] gh/anijain2305/852/head -> origin/gh/anijain2305/852/head 2025-09-07T06:39:15.2821889Z * [new branch] gh/anijain2305/852/orig -> origin/gh/anijain2305/852/orig 2025-09-07T06:39:15.2822119Z * [new branch] gh/anijain2305/853/base -> origin/gh/anijain2305/853/base 2025-09-07T06:39:15.2822341Z * [new branch] gh/anijain2305/853/head -> origin/gh/anijain2305/853/head 2025-09-07T06:39:15.2822594Z * [new branch] gh/anijain2305/853/orig -> origin/gh/anijain2305/853/orig 2025-09-07T06:39:15.2822837Z * [new branch] gh/anijain2305/854/base -> origin/gh/anijain2305/854/base 2025-09-07T06:39:15.2823155Z * [new branch] gh/anijain2305/854/head -> origin/gh/anijain2305/854/head 2025-09-07T06:39:15.2823407Z * [new branch] gh/anijain2305/854/orig -> origin/gh/anijain2305/854/orig 2025-09-07T06:39:15.2823630Z * [new branch] gh/anijain2305/855/base -> origin/gh/anijain2305/855/base 2025-09-07T06:39:15.2823888Z * [new branch] gh/anijain2305/855/head -> origin/gh/anijain2305/855/head 2025-09-07T06:39:15.2824158Z * [new branch] gh/anijain2305/855/orig -> origin/gh/anijain2305/855/orig 2025-09-07T06:39:15.2825886Z * [new branch] gh/anijain2305/856/base -> origin/gh/anijain2305/856/base 2025-09-07T06:39:15.2826102Z * [new branch] gh/anijain2305/856/head -> origin/gh/anijain2305/856/head 2025-09-07T06:39:15.2826305Z * [new branch] gh/anijain2305/856/orig -> origin/gh/anijain2305/856/orig 2025-09-07T06:39:15.2826498Z * [new branch] gh/anijain2305/857/base -> origin/gh/anijain2305/857/base 2025-09-07T06:39:15.2826700Z * [new branch] gh/anijain2305/857/head -> origin/gh/anijain2305/857/head 2025-09-07T06:39:15.2826893Z * [new branch] gh/anijain2305/857/orig -> origin/gh/anijain2305/857/orig 2025-09-07T06:39:15.2827085Z * [new branch] gh/anijain2305/858/base -> origin/gh/anijain2305/858/base 2025-09-07T06:39:15.2827275Z * [new branch] gh/anijain2305/858/head -> origin/gh/anijain2305/858/head 2025-09-07T06:39:15.2827531Z * [new branch] gh/anijain2305/858/orig -> origin/gh/anijain2305/858/orig 2025-09-07T06:39:15.2827720Z * [new branch] gh/anijain2305/859/base -> origin/gh/anijain2305/859/base 2025-09-07T06:39:15.2827913Z * [new branch] gh/anijain2305/859/head -> origin/gh/anijain2305/859/head 2025-09-07T06:39:15.2828102Z * [new branch] gh/anijain2305/859/orig -> origin/gh/anijain2305/859/orig 2025-09-07T06:39:15.2828294Z * [new branch] gh/anijain2305/860/base -> origin/gh/anijain2305/860/base 2025-09-07T06:39:15.2828490Z * [new branch] gh/anijain2305/860/head -> origin/gh/anijain2305/860/head 2025-09-07T06:39:15.2828732Z * [new branch] gh/anijain2305/860/orig -> origin/gh/anijain2305/860/orig 2025-09-07T06:39:15.2830273Z * [new branch] gh/anijain2305/861/base -> origin/gh/anijain2305/861/base 2025-09-07T06:39:15.2830485Z * [new branch] gh/anijain2305/861/head -> origin/gh/anijain2305/861/head 2025-09-07T06:39:15.2830685Z * [new branch] gh/anijain2305/861/orig -> origin/gh/anijain2305/861/orig 2025-09-07T06:39:15.2830876Z * [new branch] gh/anijain2305/862/base -> origin/gh/anijain2305/862/base 2025-09-07T06:39:15.2831073Z * [new branch] gh/anijain2305/862/head -> origin/gh/anijain2305/862/head 2025-09-07T06:39:15.2831277Z * [new branch] gh/anijain2305/862/orig -> origin/gh/anijain2305/862/orig 2025-09-07T06:39:15.2831474Z * [new branch] gh/anijain2305/863/base -> origin/gh/anijain2305/863/base 2025-09-07T06:39:15.2831671Z * [new branch] gh/anijain2305/863/head -> origin/gh/anijain2305/863/head 2025-09-07T06:39:15.2831871Z * [new branch] gh/anijain2305/863/orig -> origin/gh/anijain2305/863/orig 2025-09-07T06:39:15.2832061Z * [new branch] gh/anijain2305/864/base -> origin/gh/anijain2305/864/base 2025-09-07T06:39:15.2832253Z * [new branch] gh/anijain2305/864/head -> origin/gh/anijain2305/864/head 2025-09-07T06:39:15.2832442Z * [new branch] gh/anijain2305/864/orig -> origin/gh/anijain2305/864/orig 2025-09-07T06:39:15.2834565Z * [new branch] gh/anijain2305/865/base -> origin/gh/anijain2305/865/base 2025-09-07T06:39:15.2834780Z * [new branch] gh/anijain2305/865/head -> origin/gh/anijain2305/865/head 2025-09-07T06:39:15.2834980Z * [new branch] gh/anijain2305/865/orig -> origin/gh/anijain2305/865/orig 2025-09-07T06:39:15.2835177Z * [new branch] gh/anijain2305/866/base -> origin/gh/anijain2305/866/base 2025-09-07T06:39:15.2835378Z * [new branch] gh/anijain2305/866/head -> origin/gh/anijain2305/866/head 2025-09-07T06:39:15.2835571Z * [new branch] gh/anijain2305/866/orig -> origin/gh/anijain2305/866/orig 2025-09-07T06:39:15.2835769Z * [new branch] gh/anjali411/216/base -> origin/gh/anjali411/216/base 2025-09-07T06:39:15.2836014Z * [new branch] gh/anjali411/216/head -> origin/gh/anjali411/216/head 2025-09-07T06:39:15.2836205Z * [new branch] gh/anjali411/216/orig -> origin/gh/anjali411/216/orig 2025-09-07T06:39:15.2836397Z * [new branch] gh/ankitageorge/13/base -> origin/gh/ankitageorge/13/base 2025-09-07T06:39:15.2836595Z * [new branch] gh/ankitageorge/13/head -> origin/gh/ankitageorge/13/head 2025-09-07T06:39:15.2836791Z * [new branch] gh/ankitageorge/13/orig -> origin/gh/ankitageorge/13/orig 2025-09-07T06:39:15.2836987Z * [new branch] gh/ankitageorge/14/base -> origin/gh/ankitageorge/14/base 2025-09-07T06:39:15.2837186Z * [new branch] gh/ankitageorge/14/head -> origin/gh/ankitageorge/14/head 2025-09-07T06:39:15.2837378Z * [new branch] gh/ankitageorge/14/orig -> origin/gh/ankitageorge/14/orig 2025-09-07T06:39:15.2837650Z * [new branch] gh/ankitageorge/15/base -> origin/gh/ankitageorge/15/base 2025-09-07T06:39:15.2837852Z * [new branch] gh/ankitageorge/15/head -> origin/gh/ankitageorge/15/head 2025-09-07T06:39:15.2838046Z * [new branch] gh/ankitageorge/15/orig -> origin/gh/ankitageorge/15/orig 2025-09-07T06:39:15.2838241Z * [new branch] gh/ankitageorge/16/base -> origin/gh/ankitageorge/16/base 2025-09-07T06:39:15.2838440Z * [new branch] gh/ankitageorge/16/head -> origin/gh/ankitageorge/16/head 2025-09-07T06:39:15.2840049Z * [new branch] gh/ankitageorge/16/orig -> origin/gh/ankitageorge/16/orig 2025-09-07T06:39:15.2840313Z * [new branch] gh/ankitageorge/17/base -> origin/gh/ankitageorge/17/base 2025-09-07T06:39:15.2840519Z * [new branch] gh/ankitageorge/17/head -> origin/gh/ankitageorge/17/head 2025-09-07T06:39:15.2840712Z * [new branch] gh/ankitageorge/17/orig -> origin/gh/ankitageorge/17/orig 2025-09-07T06:39:15.2840910Z * [new branch] gh/ankitageorge/21/base -> origin/gh/ankitageorge/21/base 2025-09-07T06:39:15.2841113Z * [new branch] gh/ankitageorge/21/head -> origin/gh/ankitageorge/21/head 2025-09-07T06:39:15.2841309Z * [new branch] gh/ankitageorge/21/orig -> origin/gh/ankitageorge/21/orig 2025-09-07T06:39:15.2841503Z * [new branch] gh/anshul-si/1/base -> origin/gh/anshul-si/1/base 2025-09-07T06:39:15.2841687Z * [new branch] gh/anshul-si/1/head -> origin/gh/anshul-si/1/head 2025-09-07T06:39:15.2841874Z * [new branch] gh/anshul-si/15/base -> origin/gh/anshul-si/15/base 2025-09-07T06:39:15.2842067Z * [new branch] gh/anshul-si/15/head -> origin/gh/anshul-si/15/head 2025-09-07T06:39:15.2842253Z * [new branch] gh/anshul-si/15/orig -> origin/gh/anshul-si/15/orig 2025-09-07T06:39:15.2842436Z * [new branch] gh/anshul-si/16/base -> origin/gh/anshul-si/16/base 2025-09-07T06:39:15.2842616Z * [new branch] gh/anshul-si/16/head -> origin/gh/anshul-si/16/head 2025-09-07T06:39:15.2842796Z * [new branch] gh/anshul-si/16/orig -> origin/gh/anshul-si/16/orig 2025-09-07T06:39:15.2842975Z * [new branch] gh/anshul-si/17/base -> origin/gh/anshul-si/17/base 2025-09-07T06:39:15.2843373Z * [new branch] gh/anshul-si/17/head -> origin/gh/anshul-si/17/head 2025-09-07T06:39:15.2843554Z * [new branch] gh/anshul-si/17/orig -> origin/gh/anshul-si/17/orig 2025-09-07T06:39:15.2843733Z * [new branch] gh/anshul-si/18/base -> origin/gh/anshul-si/18/base 2025-09-07T06:39:15.2843918Z * [new branch] gh/anshul-si/18/head -> origin/gh/anshul-si/18/head 2025-09-07T06:39:15.2844101Z * [new branch] gh/anshul-si/18/orig -> origin/gh/anshul-si/18/orig 2025-09-07T06:39:15.2844282Z * [new branch] gh/anshul-si/19/base -> origin/gh/anshul-si/19/base 2025-09-07T06:39:15.2844463Z * [new branch] gh/anshul-si/19/head -> origin/gh/anshul-si/19/head 2025-09-07T06:39:15.2844644Z * [new branch] gh/anshul-si/19/orig -> origin/gh/anshul-si/19/orig 2025-09-07T06:39:15.2844825Z * [new branch] gh/anshul-si/2/base -> origin/gh/anshul-si/2/base 2025-09-07T06:39:15.2845006Z * [new branch] gh/anshul-si/2/head -> origin/gh/anshul-si/2/head 2025-09-07T06:39:15.2845206Z * [new branch] gh/anshul-si/20/base -> origin/gh/anshul-si/20/base 2025-09-07T06:39:15.2847065Z * [new branch] gh/anshul-si/20/head -> origin/gh/anshul-si/20/head 2025-09-07T06:39:15.2847268Z * [new branch] gh/anshul-si/20/orig -> origin/gh/anshul-si/20/orig 2025-09-07T06:39:15.2847458Z * [new branch] gh/anshul-si/21/base -> origin/gh/anshul-si/21/base 2025-09-07T06:39:15.2847695Z * [new branch] gh/anshul-si/21/head -> origin/gh/anshul-si/21/head 2025-09-07T06:39:15.2847875Z * [new branch] gh/anshul-si/21/orig -> origin/gh/anshul-si/21/orig 2025-09-07T06:39:15.2848058Z * [new branch] gh/anshul-si/22/base -> origin/gh/anshul-si/22/base 2025-09-07T06:39:15.2848241Z * [new branch] gh/anshul-si/22/head -> origin/gh/anshul-si/22/head 2025-09-07T06:39:15.2848581Z * [new branch] gh/anshul-si/22/orig -> origin/gh/anshul-si/22/orig 2025-09-07T06:39:15.2848770Z * [new branch] gh/anshul-si/23/base -> origin/gh/anshul-si/23/base 2025-09-07T06:39:15.2848988Z * [new branch] gh/anshul-si/23/head -> origin/gh/anshul-si/23/head 2025-09-07T06:39:15.2849177Z * [new branch] gh/anshul-si/23/orig -> origin/gh/anshul-si/23/orig 2025-09-07T06:39:15.2849356Z * [new branch] gh/anshul-si/24/base -> origin/gh/anshul-si/24/base 2025-09-07T06:39:15.2850915Z * [new branch] gh/anshul-si/24/head -> origin/gh/anshul-si/24/head 2025-09-07T06:39:15.2851110Z * [new branch] gh/anshul-si/24/orig -> origin/gh/anshul-si/24/orig 2025-09-07T06:39:15.2851289Z * [new branch] gh/anshul-si/25/base -> origin/gh/anshul-si/25/base 2025-09-07T06:39:15.2851469Z * [new branch] gh/anshul-si/25/head -> origin/gh/anshul-si/25/head 2025-09-07T06:39:15.2851648Z * [new branch] gh/anshul-si/25/orig -> origin/gh/anshul-si/25/orig 2025-09-07T06:39:15.2851833Z * [new branch] gh/anshul-si/26/base -> origin/gh/anshul-si/26/base 2025-09-07T06:39:15.2852019Z * [new branch] gh/anshul-si/26/head -> origin/gh/anshul-si/26/head 2025-09-07T06:39:15.2852197Z * [new branch] gh/anshul-si/26/orig -> origin/gh/anshul-si/26/orig 2025-09-07T06:39:15.2852381Z * [new branch] gh/anshul-si/27/base -> origin/gh/anshul-si/27/base 2025-09-07T06:39:15.2852570Z * [new branch] gh/anshul-si/27/head -> origin/gh/anshul-si/27/head 2025-09-07T06:39:15.2852759Z * [new branch] gh/anshul-si/27/orig -> origin/gh/anshul-si/27/orig 2025-09-07T06:39:15.2852942Z * [new branch] gh/anshul-si/28/base -> origin/gh/anshul-si/28/base 2025-09-07T06:39:15.2853014Z * [new branch] gh/anshul-si/28/head -> origin/gh/anshul-si/28/head 2025-09-07T06:39:15.2853185Z * [new branch] gh/anshul-si/28/orig -> origin/gh/anshul-si/28/orig 2025-09-07T06:39:15.2853258Z * [new branch] gh/anshul-si/29/base -> origin/gh/anshul-si/29/base 2025-09-07T06:39:15.2853340Z * [new branch] gh/anshul-si/29/head -> origin/gh/anshul-si/29/head 2025-09-07T06:39:15.2853412Z * [new branch] gh/anshul-si/29/orig -> origin/gh/anshul-si/29/orig 2025-09-07T06:39:15.2853489Z * [new branch] gh/anshul-si/3/base -> origin/gh/anshul-si/3/base 2025-09-07T06:39:15.2853563Z * [new branch] gh/anshul-si/3/head -> origin/gh/anshul-si/3/head 2025-09-07T06:39:15.2853635Z * [new branch] gh/anshul-si/4/base -> origin/gh/anshul-si/4/base 2025-09-07T06:39:15.2853710Z * [new branch] gh/anshul-si/4/head -> origin/gh/anshul-si/4/head 2025-09-07T06:39:15.2853783Z * [new branch] gh/anshul-si/5/base -> origin/gh/anshul-si/5/base 2025-09-07T06:39:15.2853854Z * [new branch] gh/anshul-si/5/head -> origin/gh/anshul-si/5/head 2025-09-07T06:39:15.2853930Z * [new branch] gh/aorenste/132/base -> origin/gh/aorenste/132/base 2025-09-07T06:39:15.2854017Z * [new branch] gh/aorenste/132/head -> origin/gh/aorenste/132/head 2025-09-07T06:39:15.2854092Z * [new branch] gh/bdhirsh/650/base -> origin/gh/bdhirsh/650/base 2025-09-07T06:39:15.2854215Z * [new branch] gh/bdhirsh/650/head -> origin/gh/bdhirsh/650/head 2025-09-07T06:39:15.2854290Z * [new branch] gh/bdhirsh/650/orig -> origin/gh/bdhirsh/650/orig 2025-09-07T06:39:15.2854363Z * [new branch] gh/bdhirsh/663/base -> origin/gh/bdhirsh/663/base 2025-09-07T06:39:15.2855587Z * [new branch] gh/bdhirsh/663/head -> origin/gh/bdhirsh/663/head 2025-09-07T06:39:15.2855670Z * [new branch] gh/bdhirsh/663/orig -> origin/gh/bdhirsh/663/orig 2025-09-07T06:39:15.2855743Z * [new branch] gh/bdhirsh/665/base -> origin/gh/bdhirsh/665/base 2025-09-07T06:39:15.2855869Z * [new branch] gh/bdhirsh/665/head -> origin/gh/bdhirsh/665/head 2025-09-07T06:39:15.2855942Z * [new branch] gh/bdhirsh/665/orig -> origin/gh/bdhirsh/665/orig 2025-09-07T06:39:15.2856015Z * [new branch] gh/bdhirsh/666/base -> origin/gh/bdhirsh/666/base 2025-09-07T06:39:15.2856091Z * [new branch] gh/bdhirsh/666/head -> origin/gh/bdhirsh/666/head 2025-09-07T06:39:15.2856164Z * [new branch] gh/bdhirsh/666/orig -> origin/gh/bdhirsh/666/orig 2025-09-07T06:39:15.2856236Z * [new branch] gh/bdhirsh/667/base -> origin/gh/bdhirsh/667/base 2025-09-07T06:39:15.2856309Z * [new branch] gh/bdhirsh/667/head -> origin/gh/bdhirsh/667/head 2025-09-07T06:39:15.2856382Z * [new branch] gh/bdhirsh/667/orig -> origin/gh/bdhirsh/667/orig 2025-09-07T06:39:15.2856454Z * [new branch] gh/bdhirsh/668/base -> origin/gh/bdhirsh/668/base 2025-09-07T06:39:15.2856528Z * [new branch] gh/bdhirsh/668/head -> origin/gh/bdhirsh/668/head 2025-09-07T06:39:15.2856601Z * [new branch] gh/bdhirsh/668/orig -> origin/gh/bdhirsh/668/orig 2025-09-07T06:39:15.2856673Z * [new branch] gh/bdhirsh/669/base -> origin/gh/bdhirsh/669/base 2025-09-07T06:39:15.2856746Z * [new branch] gh/bdhirsh/669/head -> origin/gh/bdhirsh/669/head 2025-09-07T06:39:15.2856819Z * [new branch] gh/bdhirsh/669/orig -> origin/gh/bdhirsh/669/orig 2025-09-07T06:39:15.2856893Z * [new branch] gh/bdhirsh/670/base -> origin/gh/bdhirsh/670/base 2025-09-07T06:39:15.2856967Z * [new branch] gh/bdhirsh/670/head -> origin/gh/bdhirsh/670/head 2025-09-07T06:39:15.2857041Z * [new branch] gh/bdhirsh/670/orig -> origin/gh/bdhirsh/670/orig 2025-09-07T06:39:15.2857137Z * [new branch] gh/benjaminglass1/100/base -> origin/gh/benjaminglass1/100/base 2025-09-07T06:39:15.2857229Z * [new branch] gh/benjaminglass1/100/head -> origin/gh/benjaminglass1/100/head 2025-09-07T06:39:15.2857315Z * [new branch] gh/benjaminglass1/100/orig -> origin/gh/benjaminglass1/100/orig 2025-09-07T06:39:15.2857403Z * [new branch] gh/benjaminglass1/101/base -> origin/gh/benjaminglass1/101/base 2025-09-07T06:39:15.2858516Z * [new branch] gh/benjaminglass1/101/head -> origin/gh/benjaminglass1/101/head 2025-09-07T06:39:15.2858606Z * [new branch] gh/benjaminglass1/101/orig -> origin/gh/benjaminglass1/101/orig 2025-09-07T06:39:15.2858706Z * [new branch] gh/benjaminglass1/102/base -> origin/gh/benjaminglass1/102/base 2025-09-07T06:39:15.2858801Z * [new branch] gh/benjaminglass1/102/head -> origin/gh/benjaminglass1/102/head 2025-09-07T06:39:15.2858887Z * [new branch] gh/benjaminglass1/102/orig -> origin/gh/benjaminglass1/102/orig 2025-09-07T06:39:15.2858988Z * [new branch] gh/benjaminglass1/103/base -> origin/gh/benjaminglass1/103/base 2025-09-07T06:39:15.2859079Z * [new branch] gh/benjaminglass1/103/head -> origin/gh/benjaminglass1/103/head 2025-09-07T06:39:15.2859204Z * [new branch] gh/benjaminglass1/103/orig -> origin/gh/benjaminglass1/103/orig 2025-09-07T06:39:15.2859299Z * [new branch] gh/benjaminglass1/104/base -> origin/gh/benjaminglass1/104/base 2025-09-07T06:39:15.2859384Z * [new branch] gh/benjaminglass1/104/head -> origin/gh/benjaminglass1/104/head 2025-09-07T06:39:15.2859470Z * [new branch] gh/benjaminglass1/104/orig -> origin/gh/benjaminglass1/104/orig 2025-09-07T06:39:15.2859556Z * [new branch] gh/benjaminglass1/105/base -> origin/gh/benjaminglass1/105/base 2025-09-07T06:39:15.2859641Z * [new branch] gh/benjaminglass1/105/head -> origin/gh/benjaminglass1/105/head 2025-09-07T06:39:15.2859726Z * [new branch] gh/benjaminglass1/105/orig -> origin/gh/benjaminglass1/105/orig 2025-09-07T06:39:15.2859843Z * [new branch] gh/benjaminglass1/106/base -> origin/gh/benjaminglass1/106/base 2025-09-07T06:39:15.2859928Z * [new branch] gh/benjaminglass1/106/head -> origin/gh/benjaminglass1/106/head 2025-09-07T06:39:15.2860014Z * [new branch] gh/benjaminglass1/106/orig -> origin/gh/benjaminglass1/106/orig 2025-09-07T06:39:15.2860104Z * [new branch] gh/benjaminglass1/79/base -> origin/gh/benjaminglass1/79/base 2025-09-07T06:39:15.2860188Z * [new branch] gh/benjaminglass1/79/head -> origin/gh/benjaminglass1/79/head 2025-09-07T06:39:15.2860272Z * [new branch] gh/benjaminglass1/79/orig -> origin/gh/benjaminglass1/79/orig 2025-09-07T06:39:15.2860372Z * [new branch] gh/benjaminglass1/86/base -> origin/gh/benjaminglass1/86/base 2025-09-07T06:39:15.2861770Z * [new branch] gh/benjaminglass1/86/head -> origin/gh/benjaminglass1/86/head 2025-09-07T06:39:15.2861875Z * [new branch] gh/benjaminglass1/86/orig -> origin/gh/benjaminglass1/86/orig 2025-09-07T06:39:15.2861965Z * [new branch] gh/benjaminglass1/89/base -> origin/gh/benjaminglass1/89/base 2025-09-07T06:39:15.2862052Z * [new branch] gh/benjaminglass1/89/head -> origin/gh/benjaminglass1/89/head 2025-09-07T06:39:15.2862137Z * [new branch] gh/benjaminglass1/89/orig -> origin/gh/benjaminglass1/89/orig 2025-09-07T06:39:15.2862233Z * [new branch] gh/benjaminglass1/91/base -> origin/gh/benjaminglass1/91/base 2025-09-07T06:39:15.2862327Z * [new branch] gh/benjaminglass1/91/head -> origin/gh/benjaminglass1/91/head 2025-09-07T06:39:15.2862423Z * [new branch] gh/benjaminglass1/91/orig -> origin/gh/benjaminglass1/91/orig 2025-09-07T06:39:15.2862507Z * [new branch] gh/benjaminglass1/93/base -> origin/gh/benjaminglass1/93/base 2025-09-07T06:39:15.2862593Z * [new branch] gh/benjaminglass1/93/head -> origin/gh/benjaminglass1/93/head 2025-09-07T06:39:15.2862676Z * [new branch] gh/benjaminglass1/93/orig -> origin/gh/benjaminglass1/93/orig 2025-09-07T06:39:15.2862763Z * [new branch] gh/benjaminglass1/95/base -> origin/gh/benjaminglass1/95/base 2025-09-07T06:39:15.2862854Z * [new branch] gh/benjaminglass1/95/head -> origin/gh/benjaminglass1/95/head 2025-09-07T06:39:15.2862937Z * [new branch] gh/benjaminglass1/95/orig -> origin/gh/benjaminglass1/95/orig 2025-09-07T06:39:15.2863021Z * [new branch] gh/benjaminglass1/97/base -> origin/gh/benjaminglass1/97/base 2025-09-07T06:39:15.2863179Z * [new branch] gh/benjaminglass1/97/head -> origin/gh/benjaminglass1/97/head 2025-09-07T06:39:15.2863265Z * [new branch] gh/benjaminglass1/97/orig -> origin/gh/benjaminglass1/97/orig 2025-09-07T06:39:15.2863351Z * [new branch] gh/benjaminglass1/99/base -> origin/gh/benjaminglass1/99/base 2025-09-07T06:39:15.2863437Z * [new branch] gh/benjaminglass1/99/head -> origin/gh/benjaminglass1/99/head 2025-09-07T06:39:15.2863520Z * [new branch] gh/benjaminglass1/99/orig -> origin/gh/benjaminglass1/99/orig 2025-09-07T06:39:15.2863673Z * [new branch] gh/bobrenjc93/514/base -> origin/gh/bobrenjc93/514/base 2025-09-07T06:39:15.2863758Z * [new branch] gh/bobrenjc93/514/head -> origin/gh/bobrenjc93/514/head 2025-09-07T06:39:15.2863839Z * [new branch] gh/bobrenjc93/514/orig -> origin/gh/bobrenjc93/514/orig 2025-09-07T06:39:15.2863918Z * [new branch] gh/bobrenjc93/521/base -> origin/gh/bobrenjc93/521/base 2025-09-07T06:39:15.2863997Z * [new branch] gh/bobrenjc93/521/head -> origin/gh/bobrenjc93/521/head 2025-09-07T06:39:15.2864073Z * [new branch] gh/bobrenjc93/521/orig -> origin/gh/bobrenjc93/521/orig 2025-09-07T06:39:15.2864206Z * [new branch] gh/bobrenjc93/522/base -> origin/gh/bobrenjc93/522/base 2025-09-07T06:39:15.2864283Z * [new branch] gh/bobrenjc93/522/head -> origin/gh/bobrenjc93/522/head 2025-09-07T06:39:15.2864359Z * [new branch] gh/bobrenjc93/522/orig -> origin/gh/bobrenjc93/522/orig 2025-09-07T06:39:15.2864437Z * [new branch] gh/bobrenjc93/525/base -> origin/gh/bobrenjc93/525/base 2025-09-07T06:39:15.2864515Z * [new branch] gh/bobrenjc93/525/head -> origin/gh/bobrenjc93/525/head 2025-09-07T06:39:15.2864592Z * [new branch] gh/bobrenjc93/525/orig -> origin/gh/bobrenjc93/525/orig 2025-09-07T06:39:15.2864668Z * [new branch] gh/bobrenjc93/526/base -> origin/gh/bobrenjc93/526/base 2025-09-07T06:39:15.2864746Z * [new branch] gh/bobrenjc93/526/head -> origin/gh/bobrenjc93/526/head 2025-09-07T06:39:15.2864822Z * [new branch] gh/bobrenjc93/526/orig -> origin/gh/bobrenjc93/526/orig 2025-09-07T06:39:15.2864900Z * [new branch] gh/bobrenjc93/527/base -> origin/gh/bobrenjc93/527/base 2025-09-07T06:39:15.2864981Z * [new branch] gh/bobrenjc93/527/head -> origin/gh/bobrenjc93/527/head 2025-09-07T06:39:15.2865059Z * [new branch] gh/bobrenjc93/527/orig -> origin/gh/bobrenjc93/527/orig 2025-09-07T06:39:15.2865136Z * [new branch] gh/bobrenjc93/528/base -> origin/gh/bobrenjc93/528/base 2025-09-07T06:39:15.2865213Z * [new branch] gh/bobrenjc93/528/head -> origin/gh/bobrenjc93/528/head 2025-09-07T06:39:15.2865290Z * [new branch] gh/bobrenjc93/528/orig -> origin/gh/bobrenjc93/528/orig 2025-09-07T06:39:15.2865377Z * [new branch] gh/bobrenjc93/529/base -> origin/gh/bobrenjc93/529/base 2025-09-07T06:39:15.2865453Z * [new branch] gh/bobrenjc93/529/head -> origin/gh/bobrenjc93/529/head 2025-09-07T06:39:15.2865531Z * [new branch] gh/bobrenjc93/529/orig -> origin/gh/bobrenjc93/529/orig 2025-09-07T06:39:15.2865611Z * [new branch] gh/bobrenjc93/535/base -> origin/gh/bobrenjc93/535/base 2025-09-07T06:39:15.2865687Z * [new branch] gh/bobrenjc93/535/head -> origin/gh/bobrenjc93/535/head 2025-09-07T06:39:15.2865769Z * [new branch] gh/bobrenjc93/535/orig -> origin/gh/bobrenjc93/535/orig 2025-09-07T06:39:15.2865845Z * [new branch] gh/bobrenjc93/537/base -> origin/gh/bobrenjc93/537/base 2025-09-07T06:39:15.2865922Z * [new branch] gh/bobrenjc93/537/head -> origin/gh/bobrenjc93/537/head 2025-09-07T06:39:15.2867255Z * [new branch] gh/bobrenjc93/537/orig -> origin/gh/bobrenjc93/537/orig 2025-09-07T06:39:15.2867346Z * [new branch] gh/bobrenjc93/539/base -> origin/gh/bobrenjc93/539/base 2025-09-07T06:39:15.2867425Z * [new branch] gh/bobrenjc93/539/head -> origin/gh/bobrenjc93/539/head 2025-09-07T06:39:15.2867506Z * [new branch] gh/bobrenjc93/539/orig -> origin/gh/bobrenjc93/539/orig 2025-09-07T06:39:15.2867582Z * [new branch] gh/bobrenjc93/540/base -> origin/gh/bobrenjc93/540/base 2025-09-07T06:39:15.2867699Z * [new branch] gh/bobrenjc93/540/head -> origin/gh/bobrenjc93/540/head 2025-09-07T06:39:15.2867776Z * [new branch] gh/bobrenjc93/540/orig -> origin/gh/bobrenjc93/540/orig 2025-09-07T06:39:15.2867855Z * [new branch] gh/bobrenjc93/541/base -> origin/gh/bobrenjc93/541/base 2025-09-07T06:39:15.2867932Z * [new branch] gh/bobrenjc93/541/head -> origin/gh/bobrenjc93/541/head 2025-09-07T06:39:15.2868009Z * [new branch] gh/bobrenjc93/541/orig -> origin/gh/bobrenjc93/541/orig 2025-09-07T06:39:15.2868085Z * [new branch] gh/bobrenjc93/542/base -> origin/gh/bobrenjc93/542/base 2025-09-07T06:39:15.2868165Z * [new branch] gh/bobrenjc93/542/head -> origin/gh/bobrenjc93/542/head 2025-09-07T06:39:15.2868279Z * [new branch] gh/bobrenjc93/542/orig -> origin/gh/bobrenjc93/542/orig 2025-09-07T06:39:15.2868355Z * [new branch] gh/bobrenjc93/543/base -> origin/gh/bobrenjc93/543/base 2025-09-07T06:39:15.2868437Z * [new branch] gh/bobrenjc93/543/head -> origin/gh/bobrenjc93/543/head 2025-09-07T06:39:15.2868515Z * [new branch] gh/bobrenjc93/543/orig -> origin/gh/bobrenjc93/543/orig 2025-09-07T06:39:15.2868591Z * [new branch] gh/bobrenjc93/544/base -> origin/gh/bobrenjc93/544/base 2025-09-07T06:39:15.2868668Z * [new branch] gh/bobrenjc93/544/head -> origin/gh/bobrenjc93/544/head 2025-09-07T06:39:15.2868745Z * [new branch] gh/bobrenjc93/544/orig -> origin/gh/bobrenjc93/544/orig 2025-09-07T06:39:15.2868827Z * [new branch] gh/bobrenjc93/545/base -> origin/gh/bobrenjc93/545/base 2025-09-07T06:39:15.2868907Z * [new branch] gh/bobrenjc93/545/head -> origin/gh/bobrenjc93/545/head 2025-09-07T06:39:15.2868986Z * [new branch] gh/bobrenjc93/545/orig -> origin/gh/bobrenjc93/545/orig 2025-09-07T06:39:15.2869063Z * [new branch] gh/bobrenjc93/546/base -> origin/gh/bobrenjc93/546/base 2025-09-07T06:39:15.2869146Z * [new branch] gh/bobrenjc93/546/head -> origin/gh/bobrenjc93/546/head 2025-09-07T06:39:15.2870839Z * [new branch] gh/bobrenjc93/546/orig -> origin/gh/bobrenjc93/546/orig 2025-09-07T06:39:15.2870948Z * [new branch] gh/bobrenjc93/547/base -> origin/gh/bobrenjc93/547/base 2025-09-07T06:39:15.2871034Z * [new branch] gh/bobrenjc93/547/head -> origin/gh/bobrenjc93/547/head 2025-09-07T06:39:15.2871118Z * [new branch] gh/bobrenjc93/547/orig -> origin/gh/bobrenjc93/547/orig 2025-09-07T06:39:15.2871195Z * [new branch] gh/bobrenjc93/548/base -> origin/gh/bobrenjc93/548/base 2025-09-07T06:39:15.2871278Z * [new branch] gh/bobrenjc93/548/head -> origin/gh/bobrenjc93/548/head 2025-09-07T06:39:15.2871355Z * [new branch] gh/bobrenjc93/548/orig -> origin/gh/bobrenjc93/548/orig 2025-09-07T06:39:15.2871434Z * [new branch] gh/bobrenjc93/549/base -> origin/gh/bobrenjc93/549/base 2025-09-07T06:39:15.2871510Z * [new branch] gh/bobrenjc93/549/head -> origin/gh/bobrenjc93/549/head 2025-09-07T06:39:15.2871587Z * [new branch] gh/bobrenjc93/549/orig -> origin/gh/bobrenjc93/549/orig 2025-09-07T06:39:15.2871666Z * [new branch] gh/bobrenjc93/550/base -> origin/gh/bobrenjc93/550/base 2025-09-07T06:39:15.2871748Z * [new branch] gh/bobrenjc93/550/head -> origin/gh/bobrenjc93/550/head 2025-09-07T06:39:15.2871826Z * [new branch] gh/bobrenjc93/550/orig -> origin/gh/bobrenjc93/550/orig 2025-09-07T06:39:15.2871902Z * [new branch] gh/bobrenjc93/551/base -> origin/gh/bobrenjc93/551/base 2025-09-07T06:39:15.2871986Z * [new branch] gh/bobrenjc93/551/head -> origin/gh/bobrenjc93/551/head 2025-09-07T06:39:15.2872064Z * [new branch] gh/bobrenjc93/551/orig -> origin/gh/bobrenjc93/551/orig 2025-09-07T06:39:15.2872184Z * [new branch] gh/bobrenjc93/552/base -> origin/gh/bobrenjc93/552/base 2025-09-07T06:39:15.2872261Z * [new branch] gh/bobrenjc93/552/head -> origin/gh/bobrenjc93/552/head 2025-09-07T06:39:15.2872339Z * [new branch] gh/bobrenjc93/552/orig -> origin/gh/bobrenjc93/552/orig 2025-09-07T06:39:15.2872420Z * [new branch] gh/bobrenjc93/553/base -> origin/gh/bobrenjc93/553/base 2025-09-07T06:39:15.2872496Z * [new branch] gh/bobrenjc93/553/head -> origin/gh/bobrenjc93/553/head 2025-09-07T06:39:15.2872572Z * [new branch] gh/bobrenjc93/553/orig -> origin/gh/bobrenjc93/553/orig 2025-09-07T06:39:15.2872682Z * [new branch] gh/bobrenjc93/554/base -> origin/gh/bobrenjc93/554/base 2025-09-07T06:39:15.2872761Z * [new branch] gh/bobrenjc93/554/head -> origin/gh/bobrenjc93/554/head 2025-09-07T06:39:15.2872839Z * [new branch] gh/bobrenjc93/554/orig -> origin/gh/bobrenjc93/554/orig 2025-09-07T06:39:15.2872919Z * [new branch] gh/bobrenjc93/555/base -> origin/gh/bobrenjc93/555/base 2025-09-07T06:39:15.2872995Z * [new branch] gh/bobrenjc93/555/head -> origin/gh/bobrenjc93/555/head 2025-09-07T06:39:15.2873140Z * [new branch] gh/bobrenjc93/555/orig -> origin/gh/bobrenjc93/555/orig 2025-09-07T06:39:15.2873225Z * [new branch] gh/bobrenjc93/556/base -> origin/gh/bobrenjc93/556/base 2025-09-07T06:39:15.2873308Z * [new branch] gh/bobrenjc93/556/head -> origin/gh/bobrenjc93/556/head 2025-09-07T06:39:15.2873384Z * [new branch] gh/bobrenjc93/556/orig -> origin/gh/bobrenjc93/556/orig 2025-09-07T06:39:15.2873479Z * [new branch] gh/briancoutinho/2/base -> origin/gh/briancoutinho/2/base 2025-09-07T06:39:15.2873562Z * [new branch] gh/briancoutinho/2/head -> origin/gh/briancoutinho/2/head 2025-09-07T06:39:15.2873637Z * [new branch] gh/c00w/23/base -> origin/gh/c00w/23/base 2025-09-07T06:39:15.2874939Z * [new branch] gh/c00w/23/head -> origin/gh/c00w/23/head 2025-09-07T06:39:15.2875016Z * [new branch] gh/c00w/48/base -> origin/gh/c00w/48/base 2025-09-07T06:39:15.2875089Z * [new branch] gh/c00w/48/head -> origin/gh/c00w/48/head 2025-09-07T06:39:15.2875159Z * [new branch] gh/c00w/48/orig -> origin/gh/c00w/48/orig 2025-09-07T06:39:15.2875232Z * [new branch] gh/c00w/53/base -> origin/gh/c00w/53/base 2025-09-07T06:39:15.2875298Z * [new branch] gh/c00w/53/head -> origin/gh/c00w/53/head 2025-09-07T06:39:15.2875367Z * [new branch] gh/c00w/53/orig -> origin/gh/c00w/53/orig 2025-09-07T06:39:15.2875433Z * [new branch] gh/c00w/54/base -> origin/gh/c00w/54/base 2025-09-07T06:39:15.2875500Z * [new branch] gh/c00w/54/head -> origin/gh/c00w/54/head 2025-09-07T06:39:15.2875568Z * [new branch] gh/c00w/54/orig -> origin/gh/c00w/54/orig 2025-09-07T06:39:15.2875633Z * [new branch] gh/c00w/55/base -> origin/gh/c00w/55/base 2025-09-07T06:39:15.2875699Z * [new branch] gh/c00w/55/head -> origin/gh/c00w/55/head 2025-09-07T06:39:15.2875766Z * [new branch] gh/c00w/55/orig -> origin/gh/c00w/55/orig 2025-09-07T06:39:15.2875833Z * [new branch] gh/c00w/56/base -> origin/gh/c00w/56/base 2025-09-07T06:39:15.2875899Z * [new branch] gh/c00w/56/head -> origin/gh/c00w/56/head 2025-09-07T06:39:15.2875976Z * [new branch] gh/c00w/56/orig -> origin/gh/c00w/56/orig 2025-09-07T06:39:15.2876053Z * [new branch] gh/clee2000/1/base -> origin/gh/clee2000/1/base 2025-09-07T06:39:15.2876208Z * [new branch] gh/clee2000/1/head -> origin/gh/clee2000/1/head 2025-09-07T06:39:15.2876280Z * [new branch] gh/clee2000/1/orig -> origin/gh/clee2000/1/orig 2025-09-07T06:39:15.2876364Z * [new branch] gh/coconutruben/1/base -> origin/gh/coconutruben/1/base 2025-09-07T06:39:15.2876452Z * [new branch] gh/coconutruben/1/head -> origin/gh/coconutruben/1/head 2025-09-07T06:39:15.2876540Z * [new branch] gh/coconutruben/11/base -> origin/gh/coconutruben/11/base 2025-09-07T06:39:15.2877829Z * [new branch] gh/coconutruben/11/head -> origin/gh/coconutruben/11/head 2025-09-07T06:39:15.2877925Z * [new branch] gh/coconutruben/11/orig -> origin/gh/coconutruben/11/orig 2025-09-07T06:39:15.2878079Z * [new branch] gh/coconutruben/12/base -> origin/gh/coconutruben/12/base 2025-09-07T06:39:15.2878163Z * [new branch] gh/coconutruben/12/head -> origin/gh/coconutruben/12/head 2025-09-07T06:39:15.2878255Z * [new branch] gh/coconutruben/12/orig -> origin/gh/coconutruben/12/orig 2025-09-07T06:39:15.2878336Z * [new branch] gh/coconutruben/13/base -> origin/gh/coconutruben/13/base 2025-09-07T06:39:15.2878416Z * [new branch] gh/coconutruben/13/head -> origin/gh/coconutruben/13/head 2025-09-07T06:39:15.2878495Z * [new branch] gh/coconutruben/13/orig -> origin/gh/coconutruben/13/orig 2025-09-07T06:39:15.2878575Z * [new branch] gh/coconutruben/14/base -> origin/gh/coconutruben/14/base 2025-09-07T06:39:15.2878655Z * [new branch] gh/coconutruben/14/head -> origin/gh/coconutruben/14/head 2025-09-07T06:39:15.2878737Z * [new branch] gh/coconutruben/14/orig -> origin/gh/coconutruben/14/orig 2025-09-07T06:39:15.2878819Z * [new branch] gh/coconutruben/15/base -> origin/gh/coconutruben/15/base 2025-09-07T06:39:15.2878901Z * [new branch] gh/coconutruben/15/head -> origin/gh/coconutruben/15/head 2025-09-07T06:39:15.2878981Z * [new branch] gh/coconutruben/15/orig -> origin/gh/coconutruben/15/orig 2025-09-07T06:39:15.2879060Z * [new branch] gh/coconutruben/16/base -> origin/gh/coconutruben/16/base 2025-09-07T06:39:15.2879140Z * [new branch] gh/coconutruben/16/head -> origin/gh/coconutruben/16/head 2025-09-07T06:39:15.2879225Z * [new branch] gh/coconutruben/16/orig -> origin/gh/coconutruben/16/orig 2025-09-07T06:39:15.2879304Z * [new branch] gh/coconutruben/17/base -> origin/gh/coconutruben/17/base 2025-09-07T06:39:15.2879384Z * [new branch] gh/coconutruben/17/head -> origin/gh/coconutruben/17/head 2025-09-07T06:39:15.2879471Z * [new branch] gh/coconutruben/17/orig -> origin/gh/coconutruben/17/orig 2025-09-07T06:39:15.2879555Z * [new branch] gh/coconutruben/18/base -> origin/gh/coconutruben/18/base 2025-09-07T06:39:15.2879639Z * [new branch] gh/coconutruben/18/head -> origin/gh/coconutruben/18/head 2025-09-07T06:39:15.2879728Z * [new branch] gh/coconutruben/18/orig -> origin/gh/coconutruben/18/orig 2025-09-07T06:39:15.2879817Z * [new branch] gh/coconutruben/19/base -> origin/gh/coconutruben/19/base 2025-09-07T06:39:15.2879897Z * [new branch] gh/coconutruben/19/head -> origin/gh/coconutruben/19/head 2025-09-07T06:39:15.2879976Z * [new branch] gh/coconutruben/19/orig -> origin/gh/coconutruben/19/orig 2025-09-07T06:39:15.2880055Z * [new branch] gh/coconutruben/20/base -> origin/gh/coconutruben/20/base 2025-09-07T06:39:15.2880138Z * [new branch] gh/coconutruben/20/head -> origin/gh/coconutruben/20/head 2025-09-07T06:39:15.2881500Z * [new branch] gh/coconutruben/20/orig -> origin/gh/coconutruben/20/orig 2025-09-07T06:39:15.2881631Z * [new branch] gh/coconutruben/21/base -> origin/gh/coconutruben/21/base 2025-09-07T06:39:15.2881713Z * [new branch] gh/coconutruben/21/head -> origin/gh/coconutruben/21/head 2025-09-07T06:39:15.2881792Z * [new branch] gh/coconutruben/21/orig -> origin/gh/coconutruben/21/orig 2025-09-07T06:39:15.2881873Z * [new branch] gh/coconutruben/22/base -> origin/gh/coconutruben/22/base 2025-09-07T06:39:15.2881963Z * [new branch] gh/coconutruben/22/head -> origin/gh/coconutruben/22/head 2025-09-07T06:39:15.2882042Z * [new branch] gh/coconutruben/22/orig -> origin/gh/coconutruben/22/orig 2025-09-07T06:39:15.2882121Z * [new branch] gh/coconutruben/24/base -> origin/gh/coconutruben/24/base 2025-09-07T06:39:15.2882234Z * [new branch] gh/coconutruben/24/head -> origin/gh/coconutruben/24/head 2025-09-07T06:39:15.2882313Z * [new branch] gh/coconutruben/24/orig -> origin/gh/coconutruben/24/orig 2025-09-07T06:39:15.2882395Z * [new branch] gh/coconutruben/25/base -> origin/gh/coconutruben/25/base 2025-09-07T06:39:15.2882475Z * [new branch] gh/coconutruben/25/head -> origin/gh/coconutruben/25/head 2025-09-07T06:39:15.2882554Z * [new branch] gh/coconutruben/25/orig -> origin/gh/coconutruben/25/orig 2025-09-07T06:39:15.2882633Z * [new branch] gh/coconutruben/28/base -> origin/gh/coconutruben/28/base 2025-09-07T06:39:15.2882715Z * [new branch] gh/coconutruben/28/head -> origin/gh/coconutruben/28/head 2025-09-07T06:39:15.2882797Z * [new branch] gh/coconutruben/28/orig -> origin/gh/coconutruben/28/orig 2025-09-07T06:39:15.2882880Z * [new branch] gh/coconutruben/29/base -> origin/gh/coconutruben/29/base 2025-09-07T06:39:15.2882960Z * [new branch] gh/coconutruben/29/head -> origin/gh/coconutruben/29/head 2025-09-07T06:39:15.2883048Z * [new branch] gh/coconutruben/29/orig -> origin/gh/coconutruben/29/orig 2025-09-07T06:39:15.2883212Z * [new branch] gh/coconutruben/30/base -> origin/gh/coconutruben/30/base 2025-09-07T06:39:15.2883294Z * [new branch] gh/coconutruben/30/head -> origin/gh/coconutruben/30/head 2025-09-07T06:39:15.2883374Z * [new branch] gh/coconutruben/30/orig -> origin/gh/coconutruben/30/orig 2025-09-07T06:39:15.2883460Z * [new branch] gh/coconutruben/31/base -> origin/gh/coconutruben/31/base 2025-09-07T06:39:15.2883540Z * [new branch] gh/coconutruben/31/head -> origin/gh/coconutruben/31/head 2025-09-07T06:39:15.2884875Z * [new branch] gh/coconutruben/31/orig -> origin/gh/coconutruben/31/orig 2025-09-07T06:39:15.2884963Z * [new branch] gh/coconutruben/32/base -> origin/gh/coconutruben/32/base 2025-09-07T06:39:15.2885042Z * [new branch] gh/coconutruben/32/head -> origin/gh/coconutruben/32/head 2025-09-07T06:39:15.2885132Z * [new branch] gh/coconutruben/32/orig -> origin/gh/coconutruben/32/orig 2025-09-07T06:39:15.2885211Z * [new branch] gh/coconutruben/33/base -> origin/gh/coconutruben/33/base 2025-09-07T06:39:15.2885290Z * [new branch] gh/coconutruben/33/head -> origin/gh/coconutruben/33/head 2025-09-07T06:39:15.2885371Z * [new branch] gh/coconutruben/33/orig -> origin/gh/coconutruben/33/orig 2025-09-07T06:39:15.2885449Z * [new branch] gh/coconutruben/34/base -> origin/gh/coconutruben/34/base 2025-09-07T06:39:15.2885528Z * [new branch] gh/coconutruben/34/head -> origin/gh/coconutruben/34/head 2025-09-07T06:39:15.2885615Z * [new branch] gh/coconutruben/34/orig -> origin/gh/coconutruben/34/orig 2025-09-07T06:39:15.2885694Z * [new branch] gh/coconutruben/35/base -> origin/gh/coconutruben/35/base 2025-09-07T06:39:15.2885773Z * [new branch] gh/coconutruben/35/head -> origin/gh/coconutruben/35/head 2025-09-07T06:39:15.2885910Z * [new branch] gh/coconutruben/35/orig -> origin/gh/coconutruben/35/orig 2025-09-07T06:39:15.2885996Z * [new branch] gh/coconutruben/36/base -> origin/gh/coconutruben/36/base 2025-09-07T06:39:15.2886075Z * [new branch] gh/coconutruben/36/head -> origin/gh/coconutruben/36/head 2025-09-07T06:39:15.2886155Z * [new branch] gh/coconutruben/36/orig -> origin/gh/coconutruben/36/orig 2025-09-07T06:39:15.2886234Z * [new branch] gh/coconutruben/37/base -> origin/gh/coconutruben/37/base 2025-09-07T06:39:15.2886313Z * [new branch] gh/coconutruben/37/head -> origin/gh/coconutruben/37/head 2025-09-07T06:39:15.2886428Z * [new branch] gh/coconutruben/37/orig -> origin/gh/coconutruben/37/orig 2025-09-07T06:39:15.2886507Z * [new branch] gh/coconutruben/38/base -> origin/gh/coconutruben/38/base 2025-09-07T06:39:15.2886588Z * [new branch] gh/coconutruben/38/head -> origin/gh/coconutruben/38/head 2025-09-07T06:39:15.2886668Z * [new branch] gh/coconutruben/38/orig -> origin/gh/coconutruben/38/orig 2025-09-07T06:39:15.2886750Z * [new branch] gh/coconutruben/39/base -> origin/gh/coconutruben/39/base 2025-09-07T06:39:15.2888037Z * [new branch] gh/coconutruben/39/head -> origin/gh/coconutruben/39/head 2025-09-07T06:39:15.2888138Z * [new branch] gh/coconutruben/39/orig -> origin/gh/coconutruben/39/orig 2025-09-07T06:39:15.2888221Z * [new branch] gh/coconutruben/40/base -> origin/gh/coconutruben/40/base 2025-09-07T06:39:15.2888394Z * [new branch] gh/coconutruben/40/head -> origin/gh/coconutruben/40/head 2025-09-07T06:39:15.2888475Z * [new branch] gh/coconutruben/40/orig -> origin/gh/coconutruben/40/orig 2025-09-07T06:39:15.2888554Z * [new branch] gh/coconutruben/41/base -> origin/gh/coconutruben/41/base 2025-09-07T06:39:15.2888636Z * [new branch] gh/coconutruben/41/head -> origin/gh/coconutruben/41/head 2025-09-07T06:39:15.2888724Z * [new branch] gh/coconutruben/41/orig -> origin/gh/coconutruben/41/orig 2025-09-07T06:39:15.2888812Z * [new branch] gh/coconutruben/42/base -> origin/gh/coconutruben/42/base 2025-09-07T06:39:15.2888891Z * [new branch] gh/coconutruben/42/head -> origin/gh/coconutruben/42/head 2025-09-07T06:39:15.2888971Z * [new branch] gh/coconutruben/42/orig -> origin/gh/coconutruben/42/orig 2025-09-07T06:39:15.2889052Z * [new branch] gh/coconutruben/43/base -> origin/gh/coconutruben/43/base 2025-09-07T06:39:15.2889136Z * [new branch] gh/coconutruben/43/head -> origin/gh/coconutruben/43/head 2025-09-07T06:39:15.2889216Z * [new branch] gh/coconutruben/43/orig -> origin/gh/coconutruben/43/orig 2025-09-07T06:39:15.2889298Z * [new branch] gh/coconutruben/44/base -> origin/gh/coconutruben/44/base 2025-09-07T06:39:15.2889379Z * [new branch] gh/coconutruben/44/head -> origin/gh/coconutruben/44/head 2025-09-07T06:39:15.2889462Z * [new branch] gh/coconutruben/44/orig -> origin/gh/coconutruben/44/orig 2025-09-07T06:39:15.2889541Z * [new branch] gh/coconutruben/45/base -> origin/gh/coconutruben/45/base 2025-09-07T06:39:15.2889620Z * [new branch] gh/coconutruben/45/head -> origin/gh/coconutruben/45/head 2025-09-07T06:39:15.2889699Z * [new branch] gh/coconutruben/45/orig -> origin/gh/coconutruben/45/orig 2025-09-07T06:39:15.2889780Z * [new branch] gh/coconutruben/46/base -> origin/gh/coconutruben/46/base 2025-09-07T06:39:15.2889859Z * [new branch] gh/coconutruben/46/head -> origin/gh/coconutruben/46/head 2025-09-07T06:39:15.2889949Z * [new branch] gh/coconutruben/46/orig -> origin/gh/coconutruben/46/orig 2025-09-07T06:39:15.2890070Z * [new branch] gh/coconutruben/47/base -> origin/gh/coconutruben/47/base 2025-09-07T06:39:15.2890150Z * [new branch] gh/coconutruben/47/head -> origin/gh/coconutruben/47/head 2025-09-07T06:39:15.2890238Z * [new branch] gh/coconutruben/47/orig -> origin/gh/coconutruben/47/orig 2025-09-07T06:39:15.2890317Z * [new branch] gh/coconutruben/48/base -> origin/gh/coconutruben/48/base 2025-09-07T06:39:15.2890397Z * [new branch] gh/coconutruben/48/head -> origin/gh/coconutruben/48/head 2025-09-07T06:39:15.2890476Z * [new branch] gh/coconutruben/48/orig -> origin/gh/coconutruben/48/orig 2025-09-07T06:39:15.2890580Z * [new branch] gh/coconutruben/49/base -> origin/gh/coconutruben/49/base 2025-09-07T06:39:15.2890659Z * [new branch] gh/coconutruben/49/head -> origin/gh/coconutruben/49/head 2025-09-07T06:39:15.2890740Z * [new branch] gh/coconutruben/49/orig -> origin/gh/coconutruben/49/orig 2025-09-07T06:39:15.2890821Z * [new branch] gh/coconutruben/50/base -> origin/gh/coconutruben/50/base 2025-09-07T06:39:15.2890900Z * [new branch] gh/coconutruben/50/head -> origin/gh/coconutruben/50/head 2025-09-07T06:39:15.2890979Z * [new branch] gh/coconutruben/50/orig -> origin/gh/coconutruben/50/orig 2025-09-07T06:39:15.2891062Z * [new branch] gh/coconutruben/51/base -> origin/gh/coconutruben/51/base 2025-09-07T06:39:15.2891141Z * [new branch] gh/coconutruben/51/head -> origin/gh/coconutruben/51/head 2025-09-07T06:39:15.2891220Z * [new branch] gh/coconutruben/51/orig -> origin/gh/coconutruben/51/orig 2025-09-07T06:39:15.2891303Z * [new branch] gh/coconutruben/52/base -> origin/gh/coconutruben/52/base 2025-09-07T06:39:15.2891382Z * [new branch] gh/coconutruben/52/head -> origin/gh/coconutruben/52/head 2025-09-07T06:39:15.2891464Z * [new branch] gh/coconutruben/52/orig -> origin/gh/coconutruben/52/orig 2025-09-07T06:39:15.2891547Z * [new branch] gh/coconutruben/53/base -> origin/gh/coconutruben/53/base 2025-09-07T06:39:15.2891626Z * [new branch] gh/coconutruben/53/head -> origin/gh/coconutruben/53/head 2025-09-07T06:39:15.2891705Z * [new branch] gh/coconutruben/53/orig -> origin/gh/coconutruben/53/orig 2025-09-07T06:39:15.2893153Z * [new branch] gh/coconutruben/54/base -> origin/gh/coconutruben/54/base 2025-09-07T06:39:15.2893252Z * [new branch] gh/coconutruben/54/head -> origin/gh/coconutruben/54/head 2025-09-07T06:39:15.2893338Z * [new branch] gh/coconutruben/54/orig -> origin/gh/coconutruben/54/orig 2025-09-07T06:39:15.2893418Z * [new branch] gh/coconutruben/55/base -> origin/gh/coconutruben/55/base 2025-09-07T06:39:15.2893507Z * [new branch] gh/coconutruben/55/head -> origin/gh/coconutruben/55/head 2025-09-07T06:39:15.2893586Z * [new branch] gh/coconutruben/55/orig -> origin/gh/coconutruben/55/orig 2025-09-07T06:39:15.2893665Z * [new branch] gh/coconutruben/56/base -> origin/gh/coconutruben/56/base 2025-09-07T06:39:15.2893749Z * [new branch] gh/coconutruben/56/head -> origin/gh/coconutruben/56/head 2025-09-07T06:39:15.2893828Z * [new branch] gh/coconutruben/56/orig -> origin/gh/coconutruben/56/orig 2025-09-07T06:39:15.2893908Z * [new branch] gh/coconutruben/57/base -> origin/gh/coconutruben/57/base 2025-09-07T06:39:15.2893989Z * [new branch] gh/coconutruben/57/head -> origin/gh/coconutruben/57/head 2025-09-07T06:39:15.2894070Z * [new branch] gh/coconutruben/57/orig -> origin/gh/coconutruben/57/orig 2025-09-07T06:39:15.2894149Z * [new branch] gh/coconutruben/58/base -> origin/gh/coconutruben/58/base 2025-09-07T06:39:15.2894282Z * [new branch] gh/coconutruben/58/head -> origin/gh/coconutruben/58/head 2025-09-07T06:39:15.2894371Z * [new branch] gh/coconutruben/58/orig -> origin/gh/coconutruben/58/orig 2025-09-07T06:39:15.2894451Z * [new branch] gh/coconutruben/59/base -> origin/gh/coconutruben/59/base 2025-09-07T06:39:15.2894532Z * [new branch] gh/coconutruben/59/head -> origin/gh/coconutruben/59/head 2025-09-07T06:39:15.2894611Z * [new branch] gh/coconutruben/59/orig -> origin/gh/coconutruben/59/orig 2025-09-07T06:39:15.2894690Z * [new branch] gh/coconutruben/60/base -> origin/gh/coconutruben/60/base 2025-09-07T06:39:15.2894825Z * [new branch] gh/coconutruben/60/head -> origin/gh/coconutruben/60/head 2025-09-07T06:39:15.2894904Z * [new branch] gh/coconutruben/60/orig -> origin/gh/coconutruben/60/orig 2025-09-07T06:39:15.2894984Z * [new branch] gh/coconutruben/61/base -> origin/gh/coconutruben/61/base 2025-09-07T06:39:15.2896295Z * [new branch] gh/coconutruben/61/head -> origin/gh/coconutruben/61/head 2025-09-07T06:39:15.2896388Z * [new branch] gh/coconutruben/61/orig -> origin/gh/coconutruben/61/orig 2025-09-07T06:39:15.2896472Z * [new branch] gh/coconutruben/62/base -> origin/gh/coconutruben/62/base 2025-09-07T06:39:15.2896556Z * [new branch] gh/coconutruben/62/head -> origin/gh/coconutruben/62/head 2025-09-07T06:39:15.2896645Z * [new branch] gh/coconutruben/62/orig -> origin/gh/coconutruben/62/orig 2025-09-07T06:39:15.2896731Z * [new branch] gh/coconutruben/63/base -> origin/gh/coconutruben/63/base 2025-09-07T06:39:15.2896817Z * [new branch] gh/coconutruben/63/head -> origin/gh/coconutruben/63/head 2025-09-07T06:39:15.2896896Z * [new branch] gh/coconutruben/63/orig -> origin/gh/coconutruben/63/orig 2025-09-07T06:39:15.2896986Z * [new branch] gh/coconutruben/64/base -> origin/gh/coconutruben/64/base 2025-09-07T06:39:15.2897066Z * [new branch] gh/coconutruben/64/head -> origin/gh/coconutruben/64/head 2025-09-07T06:39:15.2897145Z * [new branch] gh/coconutruben/64/orig -> origin/gh/coconutruben/64/orig 2025-09-07T06:39:15.2897224Z * [new branch] gh/coconutruben/65/base -> origin/gh/coconutruben/65/base 2025-09-07T06:39:15.2897304Z * [new branch] gh/coconutruben/65/head -> origin/gh/coconutruben/65/head 2025-09-07T06:39:15.2897383Z * [new branch] gh/coconutruben/65/orig -> origin/gh/coconutruben/65/orig 2025-09-07T06:39:15.2897464Z * [new branch] gh/coconutruben/66/base -> origin/gh/coconutruben/66/base 2025-09-07T06:39:15.2897544Z * [new branch] gh/coconutruben/66/head -> origin/gh/coconutruben/66/head 2025-09-07T06:39:15.2897625Z * [new branch] gh/coconutruben/66/orig -> origin/gh/coconutruben/66/orig 2025-09-07T06:39:15.2897717Z * [new branch] gh/codingwithsurya/12/base -> origin/gh/codingwithsurya/12/base 2025-09-07T06:39:15.2897806Z * [new branch] gh/codingwithsurya/12/head -> origin/gh/codingwithsurya/12/head 2025-09-07T06:39:15.2897898Z * [new branch] gh/codingwithsurya/12/orig -> origin/gh/codingwithsurya/12/orig 2025-09-07T06:39:15.2897987Z * [new branch] gh/codingwithsurya/14/base -> origin/gh/codingwithsurya/14/base 2025-09-07T06:39:15.2898077Z * [new branch] gh/codingwithsurya/14/head -> origin/gh/codingwithsurya/14/head 2025-09-07T06:39:15.2898164Z * [new branch] gh/codingwithsurya/14/orig -> origin/gh/codingwithsurya/14/orig 2025-09-07T06:39:15.2898252Z * [new branch] gh/codingwithsurya/15/base -> origin/gh/codingwithsurya/15/base 2025-09-07T06:39:15.2898339Z * [new branch] gh/codingwithsurya/15/head -> origin/gh/codingwithsurya/15/head 2025-09-07T06:39:15.2898461Z * [new branch] gh/codingwithsurya/15/orig -> origin/gh/codingwithsurya/15/orig 2025-09-07T06:39:15.2898552Z * [new branch] gh/codingwithsurya/16/base -> origin/gh/codingwithsurya/16/base 2025-09-07T06:39:15.2898638Z * [new branch] gh/codingwithsurya/16/head -> origin/gh/codingwithsurya/16/head 2025-09-07T06:39:15.2898727Z * [new branch] gh/codingwithsurya/16/orig -> origin/gh/codingwithsurya/16/orig 2025-09-07T06:39:15.2898818Z * [new branch] gh/codingwithsurya/17/base -> origin/gh/codingwithsurya/17/base 2025-09-07T06:39:15.2898904Z * [new branch] gh/codingwithsurya/17/head -> origin/gh/codingwithsurya/17/head 2025-09-07T06:39:15.2900229Z * [new branch] gh/codingwithsurya/17/orig -> origin/gh/codingwithsurya/17/orig 2025-09-07T06:39:15.2900337Z * [new branch] gh/codingwithsurya/18/base -> origin/gh/codingwithsurya/18/base 2025-09-07T06:39:15.2900426Z * [new branch] gh/codingwithsurya/18/head -> origin/gh/codingwithsurya/18/head 2025-09-07T06:39:15.2900512Z * [new branch] gh/codingwithsurya/18/orig -> origin/gh/codingwithsurya/18/orig 2025-09-07T06:39:15.2900598Z * [new branch] gh/codingwithsurya/19/base -> origin/gh/codingwithsurya/19/base 2025-09-07T06:39:15.2900684Z * [new branch] gh/codingwithsurya/19/head -> origin/gh/codingwithsurya/19/head 2025-09-07T06:39:15.2900770Z * [new branch] gh/codingwithsurya/19/orig -> origin/gh/codingwithsurya/19/orig 2025-09-07T06:39:15.2900856Z * [new branch] gh/codingwithsurya/20/base -> origin/gh/codingwithsurya/20/base 2025-09-07T06:39:15.2900953Z * [new branch] gh/codingwithsurya/20/head -> origin/gh/codingwithsurya/20/head 2025-09-07T06:39:15.2901039Z * [new branch] gh/codingwithsurya/20/orig -> origin/gh/codingwithsurya/20/orig 2025-09-07T06:39:15.2901128Z * [new branch] gh/codingwithsurya/21/base -> origin/gh/codingwithsurya/21/base 2025-09-07T06:39:15.2901214Z * [new branch] gh/codingwithsurya/21/head -> origin/gh/codingwithsurya/21/head 2025-09-07T06:39:15.2901307Z * [new branch] gh/codingwithsurya/21/orig -> origin/gh/codingwithsurya/21/orig 2025-09-07T06:39:15.2901390Z * [new branch] gh/colinchan15/1/base -> origin/gh/colinchan15/1/base 2025-09-07T06:39:15.2901469Z * [new branch] gh/colinchan15/1/head -> origin/gh/colinchan15/1/head 2025-09-07T06:39:15.2901546Z * [new branch] gh/colinchan15/2/base -> origin/gh/colinchan15/2/base 2025-09-07T06:39:15.2901624Z * [new branch] gh/colinchan15/2/head -> origin/gh/colinchan15/2/head 2025-09-07T06:39:15.2901704Z * [new branch] gh/colinchan15/3/base -> origin/gh/colinchan15/3/base 2025-09-07T06:39:15.2901780Z * [new branch] gh/colinchan15/3/head -> origin/gh/colinchan15/3/head 2025-09-07T06:39:15.2901858Z * [new branch] gh/colinchan15/6/base -> origin/gh/colinchan15/6/base 2025-09-07T06:39:15.2901933Z * [new branch] gh/colinchan15/6/head -> origin/gh/colinchan15/6/head 2025-09-07T06:39:15.2902021Z * [new branch] gh/davidberard98/382/base -> origin/gh/davidberard98/382/base 2025-09-07T06:39:15.2902107Z * [new branch] gh/davidberard98/382/head -> origin/gh/davidberard98/382/head 2025-09-07T06:39:15.2903707Z * [new branch] gh/davidberard98/382/orig -> origin/gh/davidberard98/382/orig 2025-09-07T06:39:15.2903812Z * [new branch] gh/davidberard98/386/base -> origin/gh/davidberard98/386/base 2025-09-07T06:39:15.2903908Z * [new branch] gh/davidberard98/386/head -> origin/gh/davidberard98/386/head 2025-09-07T06:39:15.2903999Z * [new branch] gh/davidberard98/386/orig -> origin/gh/davidberard98/386/orig 2025-09-07T06:39:15.2904138Z * [new branch] gh/davidberard98/391/base -> origin/gh/davidberard98/391/base 2025-09-07T06:39:15.2904222Z * [new branch] gh/davidberard98/391/head -> origin/gh/davidberard98/391/head 2025-09-07T06:39:15.2904305Z * [new branch] gh/davidberard98/391/orig -> origin/gh/davidberard98/391/orig 2025-09-07T06:39:15.2904387Z * [new branch] gh/davidberard98/392/base -> origin/gh/davidberard98/392/base 2025-09-07T06:39:15.2904472Z * [new branch] gh/davidberard98/392/head -> origin/gh/davidberard98/392/head 2025-09-07T06:39:15.2904555Z * [new branch] gh/davidberard98/392/orig -> origin/gh/davidberard98/392/orig 2025-09-07T06:39:15.2904643Z * [new branch] gh/davidberard98/394/base -> origin/gh/davidberard98/394/base 2025-09-07T06:39:15.2904773Z * [new branch] gh/davidberard98/394/head -> origin/gh/davidberard98/394/head 2025-09-07T06:39:15.2904864Z * [new branch] gh/davidberard98/394/orig -> origin/gh/davidberard98/394/orig 2025-09-07T06:39:15.2904949Z * [new branch] gh/davidberard98/396/base -> origin/gh/davidberard98/396/base 2025-09-07T06:39:15.2905031Z * [new branch] gh/davidberard98/396/head -> origin/gh/davidberard98/396/head 2025-09-07T06:39:15.2905115Z * [new branch] gh/davidberard98/396/orig -> origin/gh/davidberard98/396/orig 2025-09-07T06:39:15.2905198Z * [new branch] gh/davidberard98/397/base -> origin/gh/davidberard98/397/base 2025-09-07T06:39:15.2905281Z * [new branch] gh/davidberard98/397/head -> origin/gh/davidberard98/397/head 2025-09-07T06:39:15.2905364Z * [new branch] gh/davidberard98/397/orig -> origin/gh/davidberard98/397/orig 2025-09-07T06:39:15.2905449Z * [new branch] gh/davidberard98/398/base -> origin/gh/davidberard98/398/base 2025-09-07T06:39:15.2905532Z * [new branch] gh/davidberard98/398/head -> origin/gh/davidberard98/398/head 2025-09-07T06:39:15.2905617Z * [new branch] gh/davidberard98/398/orig -> origin/gh/davidberard98/398/orig 2025-09-07T06:39:15.2905702Z * [new branch] gh/davidberard98/399/base -> origin/gh/davidberard98/399/base 2025-09-07T06:39:15.2907037Z * [new branch] gh/davidberard98/399/head -> origin/gh/davidberard98/399/head 2025-09-07T06:39:15.2907136Z * [new branch] gh/davidberard98/399/orig -> origin/gh/davidberard98/399/orig 2025-09-07T06:39:15.2907228Z * [new branch] gh/davidberard98/400/base -> origin/gh/davidberard98/400/base 2025-09-07T06:39:15.2907316Z * [new branch] gh/davidberard98/400/head -> origin/gh/davidberard98/400/head 2025-09-07T06:39:15.2907406Z * [new branch] gh/davidberard98/400/orig -> origin/gh/davidberard98/400/orig 2025-09-07T06:39:15.2907489Z * [new branch] gh/davidberard98/401/base -> origin/gh/davidberard98/401/base 2025-09-07T06:39:15.2907571Z * [new branch] gh/davidberard98/401/head -> origin/gh/davidberard98/401/head 2025-09-07T06:39:15.2907658Z * [new branch] gh/davidberard98/401/orig -> origin/gh/davidberard98/401/orig 2025-09-07T06:39:15.2907741Z * [new branch] gh/davidberard98/402/base -> origin/gh/davidberard98/402/base 2025-09-07T06:39:15.2907823Z * [new branch] gh/davidberard98/402/head -> origin/gh/davidberard98/402/head 2025-09-07T06:39:15.2907909Z * [new branch] gh/davidberard98/402/orig -> origin/gh/davidberard98/402/orig 2025-09-07T06:39:15.2907995Z * [new branch] gh/davidberard98/403/base -> origin/gh/davidberard98/403/base 2025-09-07T06:39:15.2908077Z * [new branch] gh/davidberard98/403/head -> origin/gh/davidberard98/403/head 2025-09-07T06:39:15.2908162Z * [new branch] gh/davidberard98/403/orig -> origin/gh/davidberard98/403/orig 2025-09-07T06:39:15.2908244Z * [new branch] gh/davidberard98/404/base -> origin/gh/davidberard98/404/base 2025-09-07T06:39:15.2908360Z * [new branch] gh/davidberard98/404/head -> origin/gh/davidberard98/404/head 2025-09-07T06:39:15.2908444Z * [new branch] gh/davidberard98/404/orig -> origin/gh/davidberard98/404/orig 2025-09-07T06:39:15.2908527Z * [new branch] gh/davidberard98/405/base -> origin/gh/davidberard98/405/base 2025-09-07T06:39:15.2908609Z * [new branch] gh/davidberard98/405/head -> origin/gh/davidberard98/405/head 2025-09-07T06:39:15.2908693Z * [new branch] gh/davidberard98/405/orig -> origin/gh/davidberard98/405/orig 2025-09-07T06:39:15.2908786Z * [new branch] gh/davidberard98/406/base -> origin/gh/davidberard98/406/base 2025-09-07T06:39:15.2908909Z * [new branch] gh/davidberard98/406/head -> origin/gh/davidberard98/406/head 2025-09-07T06:39:15.2910192Z * [new branch] gh/davidberard98/406/orig -> origin/gh/davidberard98/406/orig 2025-09-07T06:39:15.2910298Z * [new branch] gh/davidberard98/407/base -> origin/gh/davidberard98/407/base 2025-09-07T06:39:15.2910381Z * [new branch] gh/davidberard98/407/head -> origin/gh/davidberard98/407/head 2025-09-07T06:39:15.2910464Z * [new branch] gh/davidberard98/407/orig -> origin/gh/davidberard98/407/orig 2025-09-07T06:39:15.2910546Z * [new branch] gh/davidberard98/408/base -> origin/gh/davidberard98/408/base 2025-09-07T06:39:15.2910634Z * [new branch] gh/davidberard98/408/head -> origin/gh/davidberard98/408/head 2025-09-07T06:39:15.2910717Z * [new branch] gh/davidberard98/408/orig -> origin/gh/davidberard98/408/orig 2025-09-07T06:39:15.2910800Z * [new branch] gh/davidberard98/409/base -> origin/gh/davidberard98/409/base 2025-09-07T06:39:15.2910892Z * [new branch] gh/davidberard98/409/head -> origin/gh/davidberard98/409/head 2025-09-07T06:39:15.2910980Z * [new branch] gh/davidberard98/409/orig -> origin/gh/davidberard98/409/orig 2025-09-07T06:39:15.2911073Z * [new branch] gh/desertfire/594/base -> origin/gh/desertfire/594/base 2025-09-07T06:39:15.2911153Z * [new branch] gh/desertfire/594/head -> origin/gh/desertfire/594/head 2025-09-07T06:39:15.2911235Z * [new branch] gh/desertfire/594/orig -> origin/gh/desertfire/594/orig 2025-09-07T06:39:15.2911314Z * [new branch] gh/desertfire/595/base -> origin/gh/desertfire/595/base 2025-09-07T06:39:15.2911391Z * [new branch] gh/desertfire/595/head -> origin/gh/desertfire/595/head 2025-09-07T06:39:15.2911468Z * [new branch] gh/desertfire/595/orig -> origin/gh/desertfire/595/orig 2025-09-07T06:39:15.2911550Z * [new branch] gh/desertfire/597/base -> origin/gh/desertfire/597/base 2025-09-07T06:39:15.2911628Z * [new branch] gh/desertfire/597/head -> origin/gh/desertfire/597/head 2025-09-07T06:39:15.2911707Z * [new branch] gh/desertfire/597/orig -> origin/gh/desertfire/597/orig 2025-09-07T06:39:15.2911784Z * [new branch] gh/dharakk/1/base -> origin/gh/dharakk/1/base 2025-09-07T06:39:15.2911862Z * [new branch] gh/dharakk/1/head -> origin/gh/dharakk/1/head 2025-09-07T06:39:15.2911943Z * [new branch] gh/drisspg/149/base -> origin/gh/drisspg/149/base 2025-09-07T06:39:15.2912021Z * [new branch] gh/drisspg/149/head -> origin/gh/drisspg/149/head 2025-09-07T06:39:15.2912095Z * [new branch] gh/drisspg/149/orig -> origin/gh/drisspg/149/orig 2025-09-07T06:39:15.2913439Z * [new branch] gh/drisspg/159/base -> origin/gh/drisspg/159/base 2025-09-07T06:39:15.2913540Z * [new branch] gh/drisspg/159/head -> origin/gh/drisspg/159/head 2025-09-07T06:39:15.2913614Z * [new branch] gh/drisspg/159/orig -> origin/gh/drisspg/159/orig 2025-09-07T06:39:15.2913750Z * [new branch] gh/drisspg/166/base -> origin/gh/drisspg/166/base 2025-09-07T06:39:15.2913833Z * [new branch] gh/drisspg/166/head -> origin/gh/drisspg/166/head 2025-09-07T06:39:15.2913906Z * [new branch] gh/drisspg/166/orig -> origin/gh/drisspg/166/orig 2025-09-07T06:39:15.2913979Z * [new branch] gh/drisspg/170/base -> origin/gh/drisspg/170/base 2025-09-07T06:39:15.2914052Z * [new branch] gh/drisspg/170/head -> origin/gh/drisspg/170/head 2025-09-07T06:39:15.2914125Z * [new branch] gh/drisspg/170/orig -> origin/gh/drisspg/170/orig 2025-09-07T06:39:15.2914198Z * [new branch] gh/drisspg/173/base -> origin/gh/drisspg/173/base 2025-09-07T06:39:15.2914309Z * [new branch] gh/drisspg/173/head -> origin/gh/drisspg/173/head 2025-09-07T06:39:15.2914382Z * [new branch] gh/drisspg/173/orig -> origin/gh/drisspg/173/orig 2025-09-07T06:39:15.2914455Z * [new branch] gh/drisspg/177/base -> origin/gh/drisspg/177/base 2025-09-07T06:39:15.2914528Z * [new branch] gh/drisspg/177/head -> origin/gh/drisspg/177/head 2025-09-07T06:39:15.2914601Z * [new branch] gh/drisspg/177/orig -> origin/gh/drisspg/177/orig 2025-09-07T06:39:15.2914673Z * [new branch] gh/drisspg/178/base -> origin/gh/drisspg/178/base 2025-09-07T06:39:15.2914746Z * [new branch] gh/drisspg/178/head -> origin/gh/drisspg/178/head 2025-09-07T06:39:15.2914828Z * [new branch] gh/drisspg/178/orig -> origin/gh/drisspg/178/orig 2025-09-07T06:39:15.2914906Z * [new branch] gh/drisspg/180/base -> origin/gh/drisspg/180/base 2025-09-07T06:39:15.2914980Z * [new branch] gh/drisspg/180/head -> origin/gh/drisspg/180/head 2025-09-07T06:39:15.2915053Z * [new branch] gh/drisspg/180/orig -> origin/gh/drisspg/180/orig 2025-09-07T06:39:15.2915127Z * [new branch] gh/drisspg/181/base -> origin/gh/drisspg/181/base 2025-09-07T06:39:15.2915199Z * [new branch] gh/drisspg/181/head -> origin/gh/drisspg/181/head 2025-09-07T06:39:15.2915277Z * [new branch] gh/drisspg/181/orig -> origin/gh/drisspg/181/orig 2025-09-07T06:39:15.2915350Z * [new branch] gh/drisspg/182/base -> origin/gh/drisspg/182/base 2025-09-07T06:39:15.2915426Z * [new branch] gh/drisspg/182/head -> origin/gh/drisspg/182/head 2025-09-07T06:39:15.2915499Z * [new branch] gh/drisspg/183/base -> origin/gh/drisspg/183/base 2025-09-07T06:39:15.2915576Z * [new branch] gh/drisspg/183/head -> origin/gh/drisspg/183/head 2025-09-07T06:39:15.2915649Z * [new branch] gh/drisspg/184/base -> origin/gh/drisspg/184/base 2025-09-07T06:39:15.2915722Z * [new branch] gh/drisspg/184/head -> origin/gh/drisspg/184/head 2025-09-07T06:39:15.2915797Z * [new branch] gh/drisspg/185/base -> origin/gh/drisspg/185/base 2025-09-07T06:39:15.2915869Z * [new branch] gh/drisspg/185/head -> origin/gh/drisspg/185/head 2025-09-07T06:39:15.2915943Z * [new branch] gh/drisspg/186/base -> origin/gh/drisspg/186/base 2025-09-07T06:39:15.2916015Z * [new branch] gh/drisspg/186/head -> origin/gh/drisspg/186/head 2025-09-07T06:39:15.2916088Z * [new branch] gh/drisspg/186/orig -> origin/gh/drisspg/186/orig 2025-09-07T06:39:15.2917363Z * [new branch] gh/drisspg/187/base -> origin/gh/drisspg/187/base 2025-09-07T06:39:15.2917459Z * [new branch] gh/drisspg/187/head -> origin/gh/drisspg/187/head 2025-09-07T06:39:15.2917532Z * [new branch] gh/drisspg/187/orig -> origin/gh/drisspg/187/orig 2025-09-07T06:39:15.2917605Z * [new branch] gh/drisspg/188/base -> origin/gh/drisspg/188/base 2025-09-07T06:39:15.2917715Z * [new branch] gh/drisspg/188/head -> origin/gh/drisspg/188/head 2025-09-07T06:39:15.2917797Z * [new branch] gh/drisspg/188/orig -> origin/gh/drisspg/188/orig 2025-09-07T06:39:15.2917869Z * [new branch] gh/drisspg/189/base -> origin/gh/drisspg/189/base 2025-09-07T06:39:15.2917942Z * [new branch] gh/drisspg/189/head -> origin/gh/drisspg/189/head 2025-09-07T06:39:15.2918019Z * [new branch] gh/drisspg/189/orig -> origin/gh/drisspg/189/orig 2025-09-07T06:39:15.2918092Z * [new branch] gh/drisspg/190/base -> origin/gh/drisspg/190/base 2025-09-07T06:39:15.2918197Z * [new branch] gh/drisspg/190/head -> origin/gh/drisspg/190/head 2025-09-07T06:39:15.2918270Z * [new branch] gh/drisspg/190/orig -> origin/gh/drisspg/190/orig 2025-09-07T06:39:15.2918344Z * [new branch] gh/drisspg/191/base -> origin/gh/drisspg/191/base 2025-09-07T06:39:15.2918416Z * [new branch] gh/drisspg/191/head -> origin/gh/drisspg/191/head 2025-09-07T06:39:15.2918489Z * [new branch] gh/drisspg/191/orig -> origin/gh/drisspg/191/orig 2025-09-07T06:39:15.2918562Z * [new branch] gh/drisspg/192/base -> origin/gh/drisspg/192/base 2025-09-07T06:39:15.2918637Z * [new branch] gh/drisspg/192/head -> origin/gh/drisspg/192/head 2025-09-07T06:39:15.2918714Z * [new branch] gh/drisspg/192/orig -> origin/gh/drisspg/192/orig 2025-09-07T06:39:15.2918788Z * [new branch] gh/drisspg/193/base -> origin/gh/drisspg/193/base 2025-09-07T06:39:15.2918862Z * [new branch] gh/drisspg/193/head -> origin/gh/drisspg/193/head 2025-09-07T06:39:15.2918935Z * [new branch] gh/drisspg/193/orig -> origin/gh/drisspg/193/orig 2025-09-07T06:39:15.2919017Z * [new branch] gh/drisspg/194/base -> origin/gh/drisspg/194/base 2025-09-07T06:39:15.2919094Z * [new branch] gh/drisspg/194/head -> origin/gh/drisspg/194/head 2025-09-07T06:39:15.2920475Z * [new branch] gh/drisspg/194/orig -> origin/gh/drisspg/194/orig 2025-09-07T06:39:15.2920568Z * [new branch] gh/drisspg/195/base -> origin/gh/drisspg/195/base 2025-09-07T06:39:15.2920641Z * [new branch] gh/drisspg/195/head -> origin/gh/drisspg/195/head 2025-09-07T06:39:15.2920720Z * [new branch] gh/drisspg/195/orig -> origin/gh/drisspg/195/orig 2025-09-07T06:39:15.2920806Z * [new branch] gh/drisspg/196/base -> origin/gh/drisspg/196/base 2025-09-07T06:39:15.2920883Z * [new branch] gh/drisspg/196/head -> origin/gh/drisspg/196/head 2025-09-07T06:39:15.2920955Z * [new branch] gh/drisspg/196/orig -> origin/gh/drisspg/196/orig 2025-09-07T06:39:15.2921031Z * [new branch] gh/drisspg/197/base -> origin/gh/drisspg/197/base 2025-09-07T06:39:15.2921110Z * [new branch] gh/drisspg/197/head -> origin/gh/drisspg/197/head 2025-09-07T06:39:15.2921183Z * [new branch] gh/drisspg/197/orig -> origin/gh/drisspg/197/orig 2025-09-07T06:39:15.2921258Z * [new branch] gh/drisspg/198/base -> origin/gh/drisspg/198/base 2025-09-07T06:39:15.2921335Z * [new branch] gh/drisspg/198/head -> origin/gh/drisspg/198/head 2025-09-07T06:39:15.2921408Z * [new branch] gh/drisspg/198/orig -> origin/gh/drisspg/198/orig 2025-09-07T06:39:15.2921481Z * [new branch] gh/drisspg/199/base -> origin/gh/drisspg/199/base 2025-09-07T06:39:15.2921560Z * [new branch] gh/drisspg/199/head -> origin/gh/drisspg/199/head 2025-09-07T06:39:15.2921638Z * [new branch] gh/drisspg/199/orig -> origin/gh/drisspg/199/orig 2025-09-07T06:39:15.2921753Z * [new branch] gh/dsjohns2/1/base -> origin/gh/dsjohns2/1/base 2025-09-07T06:39:15.2921834Z * [new branch] gh/dsjohns2/1/head -> origin/gh/dsjohns2/1/head 2025-09-07T06:39:15.2921913Z * [new branch] gh/eellison/784/base -> origin/gh/eellison/784/base 2025-09-07T06:39:15.2921996Z * [new branch] gh/eellison/784/head -> origin/gh/eellison/784/head 2025-09-07T06:39:15.2922074Z * [new branch] gh/eellison/784/orig -> origin/gh/eellison/784/orig 2025-09-07T06:39:15.2922152Z * [new branch] gh/eellison/785/base -> origin/gh/eellison/785/base 2025-09-07T06:39:15.2922265Z * [new branch] gh/eellison/785/head -> origin/gh/eellison/785/head 2025-09-07T06:39:15.2922342Z * [new branch] gh/eellison/785/orig -> origin/gh/eellison/785/orig 2025-09-07T06:39:15.2923853Z * [new branch] gh/eellison/789/base -> origin/gh/eellison/789/base 2025-09-07T06:39:15.2923948Z * [new branch] gh/eellison/789/head -> origin/gh/eellison/789/head 2025-09-07T06:39:15.2924030Z * [new branch] gh/eellison/789/orig -> origin/gh/eellison/789/orig 2025-09-07T06:39:15.2924107Z * [new branch] gh/eellison/800/base -> origin/gh/eellison/800/base 2025-09-07T06:39:15.2924188Z * [new branch] gh/eellison/800/head -> origin/gh/eellison/800/head 2025-09-07T06:39:15.2924269Z * [new branch] gh/eellison/800/orig -> origin/gh/eellison/800/orig 2025-09-07T06:39:15.2924344Z * [new branch] gh/eellison/801/base -> origin/gh/eellison/801/base 2025-09-07T06:39:15.2924422Z * [new branch] gh/eellison/801/head -> origin/gh/eellison/801/head 2025-09-07T06:39:15.2924495Z * [new branch] gh/eellison/801/orig -> origin/gh/eellison/801/orig 2025-09-07T06:39:15.2924580Z * [new branch] gh/eellison/802/base -> origin/gh/eellison/802/base 2025-09-07T06:39:15.2924654Z * [new branch] gh/eellison/802/head -> origin/gh/eellison/802/head 2025-09-07T06:39:15.2924728Z * [new branch] gh/eellison/802/orig -> origin/gh/eellison/802/orig 2025-09-07T06:39:15.2924801Z * [new branch] gh/eellison/805/base -> origin/gh/eellison/805/base 2025-09-07T06:39:15.2924876Z * [new branch] gh/eellison/805/head -> origin/gh/eellison/805/head 2025-09-07T06:39:15.2924949Z * [new branch] gh/eellison/805/orig -> origin/gh/eellison/805/orig 2025-09-07T06:39:15.2925022Z * [new branch] gh/eellison/808/base -> origin/gh/eellison/808/base 2025-09-07T06:39:15.2925107Z * [new branch] gh/eellison/808/head -> origin/gh/eellison/808/head 2025-09-07T06:39:15.2925180Z * [new branch] gh/eellison/808/orig -> origin/gh/eellison/808/orig 2025-09-07T06:39:15.2925256Z * [new branch] gh/eellison/809/base -> origin/gh/eellison/809/base 2025-09-07T06:39:15.2925334Z * [new branch] gh/eellison/809/head -> origin/gh/eellison/809/head 2025-09-07T06:39:15.2925408Z * [new branch] gh/eellison/809/orig -> origin/gh/eellison/809/orig 2025-09-07T06:39:15.2925481Z * [new branch] gh/eellison/813/base -> origin/gh/eellison/813/base 2025-09-07T06:39:15.2925559Z * [new branch] gh/eellison/813/head -> origin/gh/eellison/813/head 2025-09-07T06:39:15.2926974Z * [new branch] gh/eellison/813/orig -> origin/gh/eellison/813/orig 2025-09-07T06:39:15.2927062Z * [new branch] gh/eellison/814/base -> origin/gh/eellison/814/base 2025-09-07T06:39:15.2927145Z * [new branch] gh/eellison/814/head -> origin/gh/eellison/814/head 2025-09-07T06:39:15.2927226Z * [new branch] gh/eellison/814/orig -> origin/gh/eellison/814/orig 2025-09-07T06:39:15.2927359Z * [new branch] gh/eellison/815/base -> origin/gh/eellison/815/base 2025-09-07T06:39:15.2927434Z * [new branch] gh/eellison/815/head -> origin/gh/eellison/815/head 2025-09-07T06:39:15.2927508Z * [new branch] gh/eellison/815/orig -> origin/gh/eellison/815/orig 2025-09-07T06:39:15.2927589Z * [new branch] gh/eellison/816/base -> origin/gh/eellison/816/base 2025-09-07T06:39:15.2927663Z * [new branch] gh/eellison/816/head -> origin/gh/eellison/816/head 2025-09-07T06:39:15.2927736Z * [new branch] gh/eellison/816/orig -> origin/gh/eellison/816/orig 2025-09-07T06:39:15.2927842Z * [new branch] gh/eellison/817/base -> origin/gh/eellison/817/base 2025-09-07T06:39:15.2927916Z * [new branch] gh/eellison/817/head -> origin/gh/eellison/817/head 2025-09-07T06:39:15.2927990Z * [new branch] gh/eellison/817/orig -> origin/gh/eellison/817/orig 2025-09-07T06:39:15.2928067Z * [new branch] gh/eellison/818/base -> origin/gh/eellison/818/base 2025-09-07T06:39:15.2928143Z * [new branch] gh/eellison/818/head -> origin/gh/eellison/818/head 2025-09-07T06:39:15.2928220Z * [new branch] gh/eellison/818/orig -> origin/gh/eellison/818/orig 2025-09-07T06:39:15.2928412Z * [new branch] gh/eellison/819/base -> origin/gh/eellison/819/base 2025-09-07T06:39:15.2928491Z * [new branch] gh/eellison/819/head -> origin/gh/eellison/819/head 2025-09-07T06:39:15.2928565Z * [new branch] gh/eellison/819/orig -> origin/gh/eellison/819/orig 2025-09-07T06:39:15.2928642Z * [new branch] gh/eellison/820/base -> origin/gh/eellison/820/base 2025-09-07T06:39:15.2928723Z * [new branch] gh/eellison/820/head -> origin/gh/eellison/820/head 2025-09-07T06:39:15.2928799Z * [new branch] gh/eellison/820/orig -> origin/gh/eellison/820/orig 2025-09-07T06:39:15.2928874Z * [new branch] gh/eellison/821/base -> origin/gh/eellison/821/base 2025-09-07T06:39:15.2930285Z * [new branch] gh/eellison/821/head -> origin/gh/eellison/821/head 2025-09-07T06:39:15.2930375Z * [new branch] gh/eellison/821/orig -> origin/gh/eellison/821/orig 2025-09-07T06:39:15.2930453Z * [new branch] gh/eellison/822/base -> origin/gh/eellison/822/base 2025-09-07T06:39:15.2930536Z * [new branch] gh/eellison/822/head -> origin/gh/eellison/822/head 2025-09-07T06:39:15.2930612Z * [new branch] gh/eellison/822/orig -> origin/gh/eellison/822/orig 2025-09-07T06:39:15.2930695Z * [new branch] gh/eellison/823/base -> origin/gh/eellison/823/base 2025-09-07T06:39:15.2930769Z * [new branch] gh/eellison/823/head -> origin/gh/eellison/823/head 2025-09-07T06:39:15.2930847Z * [new branch] gh/eellison/823/orig -> origin/gh/eellison/823/orig 2025-09-07T06:39:15.2930921Z * [new branch] gh/etaf/132/base -> origin/gh/etaf/132/base 2025-09-07T06:39:15.2930991Z * [new branch] gh/etaf/132/head -> origin/gh/etaf/132/head 2025-09-07T06:39:15.2931066Z * [new branch] gh/etaf/132/orig -> origin/gh/etaf/132/orig 2025-09-07T06:39:15.2931134Z * [new branch] gh/etaf/138/base -> origin/gh/etaf/138/base 2025-09-07T06:39:15.2931201Z * [new branch] gh/etaf/138/head -> origin/gh/etaf/138/head 2025-09-07T06:39:15.2931269Z * [new branch] gh/etaf/138/orig -> origin/gh/etaf/138/orig 2025-09-07T06:39:15.2931338Z * [new branch] gh/etaf/140/base -> origin/gh/etaf/140/base 2025-09-07T06:39:15.2931405Z * [new branch] gh/etaf/140/head -> origin/gh/etaf/140/head 2025-09-07T06:39:15.2931524Z * [new branch] gh/etaf/140/orig -> origin/gh/etaf/140/orig 2025-09-07T06:39:15.2931601Z * [new branch] gh/etaf/143/base -> origin/gh/etaf/143/base 2025-09-07T06:39:15.2931668Z * [new branch] gh/etaf/143/head -> origin/gh/etaf/143/head 2025-09-07T06:39:15.2931736Z * [new branch] gh/etaf/143/orig -> origin/gh/etaf/143/orig 2025-09-07T06:39:15.2931803Z * [new branch] gh/etaf/147/base -> origin/gh/etaf/147/base 2025-09-07T06:39:15.2931870Z * [new branch] gh/etaf/147/head -> origin/gh/etaf/147/head 2025-09-07T06:39:15.2931940Z * [new branch] gh/etaf/151/base -> origin/gh/etaf/151/base 2025-09-07T06:39:15.2932036Z * [new branch] gh/etaf/151/head -> origin/gh/etaf/151/head 2025-09-07T06:39:15.2932102Z * [new branch] gh/etaf/151/orig -> origin/gh/etaf/151/orig 2025-09-07T06:39:15.2932171Z * [new branch] gh/etaf/152/base -> origin/gh/etaf/152/base 2025-09-07T06:39:15.2932239Z * [new branch] gh/etaf/152/head -> origin/gh/etaf/152/head 2025-09-07T06:39:15.2932312Z * [new branch] gh/etaf/152/orig -> origin/gh/etaf/152/orig 2025-09-07T06:39:15.2932378Z * [new branch] gh/etaf/153/base -> origin/gh/etaf/153/base 2025-09-07T06:39:15.2932446Z * [new branch] gh/etaf/153/head -> origin/gh/etaf/153/head 2025-09-07T06:39:15.2932512Z * [new branch] gh/etaf/153/orig -> origin/gh/etaf/153/orig 2025-09-07T06:39:15.2932579Z * [new branch] gh/etaf/154/base -> origin/gh/etaf/154/base 2025-09-07T06:39:15.2932648Z * [new branch] gh/etaf/154/head -> origin/gh/etaf/154/head 2025-09-07T06:39:15.2932715Z * [new branch] gh/etaf/154/orig -> origin/gh/etaf/154/orig 2025-09-07T06:39:15.2932783Z * [new branch] gh/etaf/155/base -> origin/gh/etaf/155/base 2025-09-07T06:39:15.2932851Z * [new branch] gh/etaf/155/head -> origin/gh/etaf/155/head 2025-09-07T06:39:15.2932917Z * [new branch] gh/etaf/155/orig -> origin/gh/etaf/155/orig 2025-09-07T06:39:15.2932984Z * [new branch] gh/etaf/156/base -> origin/gh/etaf/156/base 2025-09-07T06:39:15.2933051Z * [new branch] gh/etaf/156/head -> origin/gh/etaf/156/head 2025-09-07T06:39:15.2934469Z * [new branch] gh/etaf/156/orig -> origin/gh/etaf/156/orig 2025-09-07T06:39:15.2934553Z * [new branch] gh/etaf/157/base -> origin/gh/etaf/157/base 2025-09-07T06:39:15.2934625Z * [new branch] gh/etaf/157/head -> origin/gh/etaf/157/head 2025-09-07T06:39:15.2934701Z * [new branch] gh/etaf/157/orig -> origin/gh/etaf/157/orig 2025-09-07T06:39:15.2934769Z * [new branch] gh/etaf/158/base -> origin/gh/etaf/158/base 2025-09-07T06:39:15.2934836Z * [new branch] gh/etaf/158/head -> origin/gh/etaf/158/head 2025-09-07T06:39:15.2934905Z * [new branch] gh/etaf/158/orig -> origin/gh/etaf/158/orig 2025-09-07T06:39:15.2934972Z * [new branch] gh/etaf/159/base -> origin/gh/etaf/159/base 2025-09-07T06:39:15.2935038Z * [new branch] gh/etaf/159/head -> origin/gh/etaf/159/head 2025-09-07T06:39:15.2935105Z * [new branch] gh/etaf/159/orig -> origin/gh/etaf/159/orig 2025-09-07T06:39:15.2935172Z * [new branch] gh/etaf/160/base -> origin/gh/etaf/160/base 2025-09-07T06:39:15.2935249Z * [new branch] gh/etaf/160/head -> origin/gh/etaf/160/head 2025-09-07T06:39:15.2935317Z * [new branch] gh/etaf/160/orig -> origin/gh/etaf/160/orig 2025-09-07T06:39:15.2935384Z * [new branch] gh/etaf/161/base -> origin/gh/etaf/161/base 2025-09-07T06:39:15.2935499Z * [new branch] gh/etaf/161/head -> origin/gh/etaf/161/head 2025-09-07T06:39:15.2935572Z * [new branch] gh/etaf/161/orig -> origin/gh/etaf/161/orig 2025-09-07T06:39:15.2935638Z * [new branch] gh/etaf/162/base -> origin/gh/etaf/162/base 2025-09-07T06:39:15.2935709Z * [new branch] gh/etaf/162/head -> origin/gh/etaf/162/head 2025-09-07T06:39:15.2935786Z * [new branch] gh/etaf/162/orig -> origin/gh/etaf/162/orig 2025-09-07T06:39:15.2935853Z * [new branch] gh/etaf/163/base -> origin/gh/etaf/163/base 2025-09-07T06:39:15.2935958Z * [new branch] gh/etaf/163/head -> origin/gh/etaf/163/head 2025-09-07T06:39:15.2936024Z * [new branch] gh/etaf/163/orig -> origin/gh/etaf/163/orig 2025-09-07T06:39:15.2936091Z * [new branch] gh/etaf/164/base -> origin/gh/etaf/164/base 2025-09-07T06:39:15.2937721Z * [new branch] gh/etaf/164/head -> origin/gh/etaf/164/head 2025-09-07T06:39:15.2937812Z * [new branch] gh/etaf/164/orig -> origin/gh/etaf/164/orig 2025-09-07T06:39:15.2937883Z * [new branch] gh/etaf/165/base -> origin/gh/etaf/165/base 2025-09-07T06:39:15.2937957Z * [new branch] gh/etaf/165/orig -> origin/gh/etaf/165/orig 2025-09-07T06:39:15.2938024Z * [new branch] gh/etaf/166/base -> origin/gh/etaf/166/base 2025-09-07T06:39:15.2938091Z * [new branch] gh/etaf/166/head -> origin/gh/etaf/166/head 2025-09-07T06:39:15.2938164Z * [new branch] gh/etaf/166/orig -> origin/gh/etaf/166/orig 2025-09-07T06:39:15.2938231Z * [new branch] gh/etaf/167/base -> origin/gh/etaf/167/base 2025-09-07T06:39:15.2938299Z * [new branch] gh/etaf/167/head -> origin/gh/etaf/167/head 2025-09-07T06:39:15.2938367Z * [new branch] gh/etaf/167/orig -> origin/gh/etaf/167/orig 2025-09-07T06:39:15.2938434Z * [new branch] gh/etaf/168/base -> origin/gh/etaf/168/base 2025-09-07T06:39:15.2938503Z * [new branch] gh/etaf/168/head -> origin/gh/etaf/168/head 2025-09-07T06:39:15.2938577Z * [new branch] gh/etaf/168/orig -> origin/gh/etaf/168/orig 2025-09-07T06:39:15.2938644Z * [new branch] gh/etaf/169/base -> origin/gh/etaf/169/base 2025-09-07T06:39:15.2938711Z * [new branch] gh/etaf/169/head -> origin/gh/etaf/169/head 2025-09-07T06:39:15.2938779Z * [new branch] gh/etaf/169/orig -> origin/gh/etaf/169/orig 2025-09-07T06:39:15.2938865Z * [new branch] gh/exclamaforte/1/base -> origin/gh/exclamaforte/1/base 2025-09-07T06:39:15.2938957Z * [new branch] gh/exclamaforte/1/head -> origin/gh/exclamaforte/1/head 2025-09-07T06:39:15.2939038Z * [new branch] gh/exclamaforte/2/base -> origin/gh/exclamaforte/2/base 2025-09-07T06:39:15.2939117Z * [new branch] gh/exclamaforte/2/head -> origin/gh/exclamaforte/2/head 2025-09-07T06:39:15.2939197Z * [new branch] gh/exclamaforte/3/base -> origin/gh/exclamaforte/3/base 2025-09-07T06:39:15.2939275Z * [new branch] gh/exclamaforte/3/head -> origin/gh/exclamaforte/3/head 2025-09-07T06:39:15.2939355Z * [new branch] gh/exclamaforte/4/base -> origin/gh/exclamaforte/4/base 2025-09-07T06:39:15.2939437Z * [new branch] gh/exclamaforte/4/head -> origin/gh/exclamaforte/4/head 2025-09-07T06:39:15.2939515Z * [new branch] gh/ezyang/2374/base -> origin/gh/ezyang/2374/base 2025-09-07T06:39:15.2939591Z * [new branch] gh/ezyang/2374/head -> origin/gh/ezyang/2374/head 2025-09-07T06:39:15.2939697Z * [new branch] gh/ezyang/2374/orig -> origin/gh/ezyang/2374/orig 2025-09-07T06:39:15.2939771Z * [new branch] gh/ezyang/2973/base -> origin/gh/ezyang/2973/base 2025-09-07T06:39:15.2939844Z * [new branch] gh/ezyang/2973/head -> origin/gh/ezyang/2973/head 2025-09-07T06:39:15.2939916Z * [new branch] gh/ezyang/2973/orig -> origin/gh/ezyang/2973/orig 2025-09-07T06:39:15.2941237Z * [new branch] gh/ezyang/2974/base -> origin/gh/ezyang/2974/base 2025-09-07T06:39:15.2941325Z * [new branch] gh/ezyang/2974/head -> origin/gh/ezyang/2974/head 2025-09-07T06:39:15.2941400Z * [new branch] gh/ezyang/2974/orig -> origin/gh/ezyang/2974/orig 2025-09-07T06:39:15.2941510Z * [new branch] gh/ezyang/3074/base -> origin/gh/ezyang/3074/base 2025-09-07T06:39:15.2941581Z * [new branch] gh/ezyang/3074/head -> origin/gh/ezyang/3074/head 2025-09-07T06:39:15.2941660Z * [new branch] gh/ezyang/3074/orig -> origin/gh/ezyang/3074/orig 2025-09-07T06:39:15.2941741Z * [new branch] gh/ezyang/3088/base -> origin/gh/ezyang/3088/base 2025-09-07T06:39:15.2941813Z * [new branch] gh/ezyang/3088/head -> origin/gh/ezyang/3088/head 2025-09-07T06:39:15.2941886Z * [new branch] gh/ezyang/3088/orig -> origin/gh/ezyang/3088/orig 2025-09-07T06:39:15.2941957Z * [new branch] gh/ezyang/3092/base -> origin/gh/ezyang/3092/base 2025-09-07T06:39:15.2942029Z * [new branch] gh/ezyang/3092/head -> origin/gh/ezyang/3092/head 2025-09-07T06:39:15.2942103Z * [new branch] gh/ezyang/3092/orig -> origin/gh/ezyang/3092/orig 2025-09-07T06:39:15.2942178Z * [new branch] gh/ezyang/3103/base -> origin/gh/ezyang/3103/base 2025-09-07T06:39:15.2942250Z * [new branch] gh/ezyang/3103/head -> origin/gh/ezyang/3103/head 2025-09-07T06:39:15.2942324Z * [new branch] gh/ezyang/3103/orig -> origin/gh/ezyang/3103/orig 2025-09-07T06:39:15.2942396Z * [new branch] gh/ezyang/3105/base -> origin/gh/ezyang/3105/base 2025-09-07T06:39:15.2942469Z * [new branch] gh/ezyang/3105/head -> origin/gh/ezyang/3105/head 2025-09-07T06:39:15.2942543Z * [new branch] gh/ezyang/3105/orig -> origin/gh/ezyang/3105/orig 2025-09-07T06:39:15.2942625Z * [new branch] gh/ezyang/3114/base -> origin/gh/ezyang/3114/base 2025-09-07T06:39:15.2942706Z * [new branch] gh/ezyang/3114/head -> origin/gh/ezyang/3114/head 2025-09-07T06:39:15.2942783Z * [new branch] gh/ezyang/3114/orig -> origin/gh/ezyang/3114/orig 2025-09-07T06:39:15.2942854Z * [new branch] gh/ezyang/3116/base -> origin/gh/ezyang/3116/base 2025-09-07T06:39:15.2942927Z * [new branch] gh/ezyang/3116/head -> origin/gh/ezyang/3116/head 2025-09-07T06:39:15.2944308Z * [new branch] gh/ezyang/3116/orig -> origin/gh/ezyang/3116/orig 2025-09-07T06:39:15.2944398Z * [new branch] gh/ezyang/3120/base -> origin/gh/ezyang/3120/base 2025-09-07T06:39:15.2944474Z * [new branch] gh/ezyang/3120/head -> origin/gh/ezyang/3120/head 2025-09-07T06:39:15.2944546Z * [new branch] gh/ezyang/3120/orig -> origin/gh/ezyang/3120/orig 2025-09-07T06:39:15.2944627Z * [new branch] gh/ezyang/3122/base -> origin/gh/ezyang/3122/base 2025-09-07T06:39:15.2944701Z * [new branch] gh/ezyang/3122/head -> origin/gh/ezyang/3122/head 2025-09-07T06:39:15.2944778Z * [new branch] gh/ezyang/3122/orig -> origin/gh/ezyang/3122/orig 2025-09-07T06:39:15.2944850Z * [new branch] gh/ezyang/3123/base -> origin/gh/ezyang/3123/base 2025-09-07T06:39:15.2944923Z * [new branch] gh/ezyang/3123/head -> origin/gh/ezyang/3123/head 2025-09-07T06:39:15.2945053Z * [new branch] gh/ezyang/3123/orig -> origin/gh/ezyang/3123/orig 2025-09-07T06:39:15.2945125Z * [new branch] gh/ezyang/3125/base -> origin/gh/ezyang/3125/base 2025-09-07T06:39:15.2945198Z * [new branch] gh/ezyang/3125/head -> origin/gh/ezyang/3125/head 2025-09-07T06:39:15.2945270Z * [new branch] gh/ezyang/3125/orig -> origin/gh/ezyang/3125/orig 2025-09-07T06:39:15.2945342Z * [new branch] gh/ezyang/3126/base -> origin/gh/ezyang/3126/base 2025-09-07T06:39:15.2945415Z * [new branch] gh/ezyang/3126/head -> origin/gh/ezyang/3126/head 2025-09-07T06:39:15.2945528Z * [new branch] gh/ezyang/3126/orig -> origin/gh/ezyang/3126/orig 2025-09-07T06:39:15.2945603Z * [new branch] gh/ezyang/3127/base -> origin/gh/ezyang/3127/base 2025-09-07T06:39:15.2945677Z * [new branch] gh/ezyang/3127/head -> origin/gh/ezyang/3127/head 2025-09-07T06:39:15.2945751Z * [new branch] gh/ezyang/3127/orig -> origin/gh/ezyang/3127/orig 2025-09-07T06:39:15.2945830Z * [new branch] gh/ezyang/3128/base -> origin/gh/ezyang/3128/base 2025-09-07T06:39:15.2945902Z * [new branch] gh/ezyang/3128/head -> origin/gh/ezyang/3128/head 2025-09-07T06:39:15.2945975Z * [new branch] gh/ezyang/3128/orig -> origin/gh/ezyang/3128/orig 2025-09-07T06:39:15.2946047Z * [new branch] gh/ezyang/3129/base -> origin/gh/ezyang/3129/base 2025-09-07T06:39:15.2947398Z * [new branch] gh/ezyang/3129/head -> origin/gh/ezyang/3129/head 2025-09-07T06:39:15.2947504Z * [new branch] gh/ezyang/3129/orig -> origin/gh/ezyang/3129/orig 2025-09-07T06:39:15.2947575Z * [new branch] gh/ezyang/3130/base -> origin/gh/ezyang/3130/base 2025-09-07T06:39:15.2947650Z * [new branch] gh/ezyang/3130/head -> origin/gh/ezyang/3130/head 2025-09-07T06:39:15.2947727Z * [new branch] gh/ezyang/3130/orig -> origin/gh/ezyang/3130/orig 2025-09-07T06:39:15.2947800Z * [new branch] gh/ezyang/3131/base -> origin/gh/ezyang/3131/base 2025-09-07T06:39:15.2947876Z * [new branch] gh/ezyang/3131/head -> origin/gh/ezyang/3131/head 2025-09-07T06:39:15.2947948Z * [new branch] gh/ezyang/3131/orig -> origin/gh/ezyang/3131/orig 2025-09-07T06:39:15.2948021Z * [new branch] gh/ezyang/3132/base -> origin/gh/ezyang/3132/base 2025-09-07T06:39:15.2948096Z * [new branch] gh/ezyang/3132/head -> origin/gh/ezyang/3132/head 2025-09-07T06:39:15.2948174Z * [new branch] gh/ezyang/3132/orig -> origin/gh/ezyang/3132/orig 2025-09-07T06:39:15.2948246Z * [new branch] gh/ezyang/3133/base -> origin/gh/ezyang/3133/base 2025-09-07T06:39:15.2948318Z * [new branch] gh/ezyang/3133/head -> origin/gh/ezyang/3133/head 2025-09-07T06:39:15.2948391Z * [new branch] gh/ezyang/3133/orig -> origin/gh/ezyang/3133/orig 2025-09-07T06:39:15.2948462Z * [new branch] gh/ezyang/3134/base -> origin/gh/ezyang/3134/base 2025-09-07T06:39:15.2948533Z * [new branch] gh/ezyang/3134/head -> origin/gh/ezyang/3134/head 2025-09-07T06:39:15.2948606Z * [new branch] gh/ezyang/3134/orig -> origin/gh/ezyang/3134/orig 2025-09-07T06:39:15.2948677Z * [new branch] gh/ezyang/3135/base -> origin/gh/ezyang/3135/base 2025-09-07T06:39:15.2948753Z * [new branch] gh/ezyang/3135/head -> origin/gh/ezyang/3135/head 2025-09-07T06:39:15.2948827Z * [new branch] gh/ezyang/3135/orig -> origin/gh/ezyang/3135/orig 2025-09-07T06:39:15.2948899Z * [new branch] gh/ezyang/3136/base -> origin/gh/ezyang/3136/base 2025-09-07T06:39:15.2949008Z * [new branch] gh/ezyang/3136/head -> origin/gh/ezyang/3136/head 2025-09-07T06:39:15.2949089Z * [new branch] gh/ezyang/3136/orig -> origin/gh/ezyang/3136/orig 2025-09-07T06:39:15.2949163Z * [new branch] gh/ezyang/3137/base -> origin/gh/ezyang/3137/base 2025-09-07T06:39:15.2949235Z * [new branch] gh/ezyang/3137/head -> origin/gh/ezyang/3137/head 2025-09-07T06:39:15.2949307Z * [new branch] gh/ezyang/3137/orig -> origin/gh/ezyang/3137/orig 2025-09-07T06:39:15.2949387Z * [new branch] gh/ezyang/3138/base -> origin/gh/ezyang/3138/base 2025-09-07T06:39:15.2949488Z * [new branch] gh/ezyang/3138/head -> origin/gh/ezyang/3138/head 2025-09-07T06:39:15.2949560Z * [new branch] gh/ezyang/3138/orig -> origin/gh/ezyang/3138/orig 2025-09-07T06:39:15.2949632Z * [new branch] gh/ezyang/3139/base -> origin/gh/ezyang/3139/base 2025-09-07T06:39:15.2949705Z * [new branch] gh/ezyang/3139/head -> origin/gh/ezyang/3139/head 2025-09-07T06:39:15.2949777Z * [new branch] gh/ezyang/3139/orig -> origin/gh/ezyang/3139/orig 2025-09-07T06:39:15.2949849Z * [new branch] gh/ezyang/3140/base -> origin/gh/ezyang/3140/base 2025-09-07T06:39:15.2949921Z * [new branch] gh/ezyang/3140/head -> origin/gh/ezyang/3140/head 2025-09-07T06:39:15.2949995Z * [new branch] gh/ezyang/3140/orig -> origin/gh/ezyang/3140/orig 2025-09-07T06:39:15.2950067Z * [new branch] gh/ezyang/3141/base -> origin/gh/ezyang/3141/base 2025-09-07T06:39:15.2951400Z * [new branch] gh/ezyang/3141/head -> origin/gh/ezyang/3141/head 2025-09-07T06:39:15.2951496Z * [new branch] gh/ezyang/3141/orig -> origin/gh/ezyang/3141/orig 2025-09-07T06:39:15.2951568Z * [new branch] gh/ezyang/3142/base -> origin/gh/ezyang/3142/base 2025-09-07T06:39:15.2951641Z * [new branch] gh/ezyang/3142/head -> origin/gh/ezyang/3142/head 2025-09-07T06:39:15.2951714Z * [new branch] gh/ezyang/3142/orig -> origin/gh/ezyang/3142/orig 2025-09-07T06:39:15.2951794Z * [new branch] gh/ezyang/3143/base -> origin/gh/ezyang/3143/base 2025-09-07T06:39:15.2951865Z * [new branch] gh/ezyang/3143/head -> origin/gh/ezyang/3143/head 2025-09-07T06:39:15.2951943Z * [new branch] gh/ezyang/3143/orig -> origin/gh/ezyang/3143/orig 2025-09-07T06:39:15.2952019Z * [new branch] gh/fadara01/1/base -> origin/gh/fadara01/1/base 2025-09-07T06:39:15.2952096Z * [new branch] gh/fadara01/1/head -> origin/gh/fadara01/1/head 2025-09-07T06:39:15.2952170Z * [new branch] gh/fadara01/1/orig -> origin/gh/fadara01/1/orig 2025-09-07T06:39:15.2952243Z * [new branch] gh/fduwjj/171/base -> origin/gh/fduwjj/171/base 2025-09-07T06:39:15.2952322Z * [new branch] gh/fduwjj/171/head -> origin/gh/fduwjj/171/head 2025-09-07T06:39:15.2952394Z * [new branch] gh/fduwjj/171/orig -> origin/gh/fduwjj/171/orig 2025-09-07T06:39:15.2952464Z * [new branch] gh/fduwjj/175/base -> origin/gh/fduwjj/175/base 2025-09-07T06:39:15.2952534Z * [new branch] gh/fduwjj/175/head -> origin/gh/fduwjj/175/head 2025-09-07T06:39:15.2952606Z * [new branch] gh/fduwjj/175/orig -> origin/gh/fduwjj/175/orig 2025-09-07T06:39:15.2952677Z * [new branch] gh/fduwjj/176/base -> origin/gh/fduwjj/176/base 2025-09-07T06:39:15.2952750Z * [new branch] gh/fduwjj/176/head -> origin/gh/fduwjj/176/head 2025-09-07T06:39:15.2952822Z * [new branch] gh/fduwjj/176/orig -> origin/gh/fduwjj/176/orig 2025-09-07T06:39:15.2952942Z * [new branch] gh/fduwjj/177/base -> origin/gh/fduwjj/177/base 2025-09-07T06:39:15.2953019Z * [new branch] gh/fduwjj/177/head -> origin/gh/fduwjj/177/head 2025-09-07T06:39:15.2954414Z * [new branch] gh/fduwjj/177/orig -> origin/gh/fduwjj/177/orig 2025-09-07T06:39:15.2954504Z * [new branch] gh/fduwjj/178/base -> origin/gh/fduwjj/178/base 2025-09-07T06:39:15.2954578Z * [new branch] gh/fduwjj/178/head -> origin/gh/fduwjj/178/head 2025-09-07T06:39:15.2954649Z * [new branch] gh/fduwjj/178/orig -> origin/gh/fduwjj/178/orig 2025-09-07T06:39:15.2954724Z * [new branch] gh/fduwjj/179/base -> origin/gh/fduwjj/179/base 2025-09-07T06:39:15.2954860Z * [new branch] gh/fduwjj/179/head -> origin/gh/fduwjj/179/head 2025-09-07T06:39:15.2954930Z * [new branch] gh/fduwjj/179/orig -> origin/gh/fduwjj/179/orig 2025-09-07T06:39:15.2955009Z * [new branch] gh/fduwjj/180/base -> origin/gh/fduwjj/180/base 2025-09-07T06:39:15.2955084Z * [new branch] gh/fduwjj/180/head -> origin/gh/fduwjj/180/head 2025-09-07T06:39:15.2955155Z * [new branch] gh/fduwjj/180/orig -> origin/gh/fduwjj/180/orig 2025-09-07T06:39:15.2955228Z * [new branch] gh/fduwjj/181/base -> origin/gh/fduwjj/181/base 2025-09-07T06:39:15.2955298Z * [new branch] gh/fduwjj/181/head -> origin/gh/fduwjj/181/head 2025-09-07T06:39:15.2955377Z * [new branch] gh/fduwjj/181/orig -> origin/gh/fduwjj/181/orig 2025-09-07T06:39:15.2955448Z * [new branch] gh/fduwjj/182/base -> origin/gh/fduwjj/182/base 2025-09-07T06:39:15.2955522Z * [new branch] gh/fduwjj/182/head -> origin/gh/fduwjj/182/head 2025-09-07T06:39:15.2955597Z * [new branch] gh/fduwjj/182/orig -> origin/gh/fduwjj/182/orig 2025-09-07T06:39:15.2955670Z * [new branch] gh/fduwjj/183/base -> origin/gh/fduwjj/183/base 2025-09-07T06:39:15.2955745Z * [new branch] gh/fduwjj/183/head -> origin/gh/fduwjj/183/head 2025-09-07T06:39:15.2955821Z * [new branch] gh/fduwjj/183/orig -> origin/gh/fduwjj/183/orig 2025-09-07T06:39:15.2955893Z * [new branch] gh/fduwjj/184/base -> origin/gh/fduwjj/184/base 2025-09-07T06:39:15.2955966Z * [new branch] gh/fduwjj/184/head -> origin/gh/fduwjj/184/head 2025-09-07T06:39:15.2956040Z * [new branch] gh/fduwjj/184/orig -> origin/gh/fduwjj/184/orig 2025-09-07T06:39:15.2956112Z * [new branch] gh/fduwjj/185/base -> origin/gh/fduwjj/185/base 2025-09-07T06:39:15.2956189Z * [new branch] gh/fduwjj/185/head -> origin/gh/fduwjj/185/head 2025-09-07T06:39:15.2957476Z * [new branch] gh/fduwjj/185/orig -> origin/gh/fduwjj/185/orig 2025-09-07T06:39:15.2957560Z * [new branch] gh/fduwjj/186/base -> origin/gh/fduwjj/186/base 2025-09-07T06:39:15.2957634Z * [new branch] gh/fduwjj/186/head -> origin/gh/fduwjj/186/head 2025-09-07T06:39:15.2957706Z * [new branch] gh/fduwjj/186/orig -> origin/gh/fduwjj/186/orig 2025-09-07T06:39:15.2957777Z * [new branch] gh/fduwjj/187/base -> origin/gh/fduwjj/187/base 2025-09-07T06:39:15.2957848Z * [new branch] gh/fduwjj/187/head -> origin/gh/fduwjj/187/head 2025-09-07T06:39:15.2957919Z * [new branch] gh/fduwjj/187/orig -> origin/gh/fduwjj/187/orig 2025-09-07T06:39:15.2957990Z * [new branch] gh/fduwjj/188/base -> origin/gh/fduwjj/188/base 2025-09-07T06:39:15.2958066Z * [new branch] gh/fduwjj/188/head -> origin/gh/fduwjj/188/head 2025-09-07T06:39:15.2958145Z * [new branch] gh/fduwjj/188/orig -> origin/gh/fduwjj/188/orig 2025-09-07T06:39:15.2958261Z * [new branch] gh/fduwjj/189/base -> origin/gh/fduwjj/189/base 2025-09-07T06:39:15.2958333Z * [new branch] gh/fduwjj/189/head -> origin/gh/fduwjj/189/head 2025-09-07T06:39:15.2958406Z * [new branch] gh/fduwjj/189/orig -> origin/gh/fduwjj/189/orig 2025-09-07T06:39:15.2958479Z * [new branch] gh/fduwjj/190/base -> origin/gh/fduwjj/190/base 2025-09-07T06:39:15.2958556Z * [new branch] gh/fduwjj/190/head -> origin/gh/fduwjj/190/head 2025-09-07T06:39:15.2958633Z * [new branch] gh/fduwjj/190/orig -> origin/gh/fduwjj/190/orig 2025-09-07T06:39:15.2958735Z * [new branch] gh/fduwjj/191/base -> origin/gh/fduwjj/191/base 2025-09-07T06:39:15.2958807Z * [new branch] gh/fduwjj/191/head -> origin/gh/fduwjj/191/head 2025-09-07T06:39:15.2958877Z * [new branch] gh/fduwjj/191/orig -> origin/gh/fduwjj/191/orig 2025-09-07T06:39:15.2958951Z * [new branch] gh/fegin/306/base -> origin/gh/fegin/306/base 2025-09-07T06:39:15.2959022Z * [new branch] gh/fegin/306/head -> origin/gh/fegin/306/head 2025-09-07T06:39:15.2959094Z * [new branch] gh/fegin/306/orig -> origin/gh/fegin/306/orig 2025-09-07T06:39:15.2959165Z * [new branch] gh/fegin/307/base -> origin/gh/fegin/307/base 2025-09-07T06:39:15.2959237Z * [new branch] gh/fegin/307/head -> origin/gh/fegin/307/head 2025-09-07T06:39:15.2959307Z * [new branch] gh/fegin/307/orig -> origin/gh/fegin/307/orig 2025-09-07T06:39:15.2959377Z * [new branch] gh/fegin/308/base -> origin/gh/fegin/308/base 2025-09-07T06:39:15.2959450Z * [new branch] gh/fegin/308/head -> origin/gh/fegin/308/head 2025-09-07T06:39:15.2959526Z * [new branch] gh/fegin/308/orig -> origin/gh/fegin/308/orig 2025-09-07T06:39:15.2959597Z * [new branch] gh/fegin/309/base -> origin/gh/fegin/309/base 2025-09-07T06:39:15.2959666Z * [new branch] gh/fegin/309/head -> origin/gh/fegin/309/head 2025-09-07T06:39:15.2959736Z * [new branch] gh/fegin/309/orig -> origin/gh/fegin/309/orig 2025-09-07T06:39:15.2959806Z * [new branch] gh/fegin/310/base -> origin/gh/fegin/310/base 2025-09-07T06:39:15.2959875Z * [new branch] gh/fegin/310/head -> origin/gh/fegin/310/head 2025-09-07T06:39:15.2959949Z * [new branch] gh/fegin/310/orig -> origin/gh/fegin/310/orig 2025-09-07T06:39:15.2960024Z * [new branch] gh/fegin/311/base -> origin/gh/fegin/311/base 2025-09-07T06:39:15.2960094Z * [new branch] gh/fegin/311/head -> origin/gh/fegin/311/head 2025-09-07T06:39:15.2960164Z * [new branch] gh/fegin/311/orig -> origin/gh/fegin/311/orig 2025-09-07T06:39:15.2960235Z * [new branch] gh/fegin/312/base -> origin/gh/fegin/312/base 2025-09-07T06:39:15.2960304Z * [new branch] gh/fegin/312/head -> origin/gh/fegin/312/head 2025-09-07T06:39:15.2960372Z * [new branch] gh/fegin/312/orig -> origin/gh/fegin/312/orig 2025-09-07T06:39:15.2960442Z * [new branch] gh/fegin/313/base -> origin/gh/fegin/313/base 2025-09-07T06:39:15.2960511Z * [new branch] gh/fegin/313/head -> origin/gh/fegin/313/head 2025-09-07T06:39:15.2960580Z * [new branch] gh/fegin/313/orig -> origin/gh/fegin/313/orig 2025-09-07T06:39:15.2960653Z * [new branch] gh/fffrog/124/base -> origin/gh/fffrog/124/base 2025-09-07T06:39:15.2960725Z * [new branch] gh/fffrog/124/head -> origin/gh/fffrog/124/head 2025-09-07T06:39:15.2962021Z * [new branch] gh/fffrog/124/orig -> origin/gh/fffrog/124/orig 2025-09-07T06:39:15.2962146Z * [new branch] gh/fffrog/129/base -> origin/gh/fffrog/129/base 2025-09-07T06:39:15.2962225Z * [new branch] gh/fffrog/129/head -> origin/gh/fffrog/129/head 2025-09-07T06:39:15.2962296Z * [new branch] gh/fffrog/129/orig -> origin/gh/fffrog/129/orig 2025-09-07T06:39:15.2962366Z * [new branch] gh/fffrog/130/base -> origin/gh/fffrog/130/base 2025-09-07T06:39:15.2962441Z * [new branch] gh/fffrog/130/head -> origin/gh/fffrog/130/head 2025-09-07T06:39:15.2962519Z * [new branch] gh/fffrog/130/orig -> origin/gh/fffrog/130/orig 2025-09-07T06:39:15.2962627Z * [new branch] gh/fffrog/131/base -> origin/gh/fffrog/131/base 2025-09-07T06:39:15.2962706Z * [new branch] gh/fffrog/131/head -> origin/gh/fffrog/131/head 2025-09-07T06:39:15.2962779Z * [new branch] gh/fffrog/131/orig -> origin/gh/fffrog/131/orig 2025-09-07T06:39:15.2962851Z * [new branch] gh/fffrog/132/base -> origin/gh/fffrog/132/base 2025-09-07T06:39:15.2962922Z * [new branch] gh/fffrog/132/head -> origin/gh/fffrog/132/head 2025-09-07T06:39:15.2962998Z * [new branch] gh/fffrog/132/orig -> origin/gh/fffrog/132/orig 2025-09-07T06:39:15.2963143Z * [new branch] gh/fffrog/133/base -> origin/gh/fffrog/133/base 2025-09-07T06:39:15.2963216Z * [new branch] gh/fffrog/133/head -> origin/gh/fffrog/133/head 2025-09-07T06:39:15.2963287Z * [new branch] gh/fffrog/133/orig -> origin/gh/fffrog/133/orig 2025-09-07T06:39:15.2963361Z * [new branch] gh/fffrog/134/base -> origin/gh/fffrog/134/base 2025-09-07T06:39:15.2963431Z * [new branch] gh/fffrog/134/head -> origin/gh/fffrog/134/head 2025-09-07T06:39:15.2963503Z * [new branch] gh/fffrog/134/orig -> origin/gh/fffrog/134/orig 2025-09-07T06:39:15.2963575Z * [new branch] gh/fffrog/135/base -> origin/gh/fffrog/135/base 2025-09-07T06:39:15.2963645Z * [new branch] gh/fffrog/135/head -> origin/gh/fffrog/135/head 2025-09-07T06:39:15.2963717Z * [new branch] gh/fffrog/135/orig -> origin/gh/fffrog/135/orig 2025-09-07T06:39:15.2963787Z * [new branch] gh/fffrog/136/base -> origin/gh/fffrog/136/base 2025-09-07T06:39:15.2965124Z * [new branch] gh/fffrog/136/head -> origin/gh/fffrog/136/head 2025-09-07T06:39:15.2965216Z * [new branch] gh/fffrog/136/orig -> origin/gh/fffrog/136/orig 2025-09-07T06:39:15.2965294Z * [new branch] gh/fffrog/137/base -> origin/gh/fffrog/137/base 2025-09-07T06:39:15.2965365Z * [new branch] gh/fffrog/137/head -> origin/gh/fffrog/137/head 2025-09-07T06:39:15.2965440Z * [new branch] gh/fffrog/137/orig -> origin/gh/fffrog/137/orig 2025-09-07T06:39:15.2965526Z * [new branch] gh/fffrog/138/base -> origin/gh/fffrog/138/base 2025-09-07T06:39:15.2965604Z * [new branch] gh/fffrog/138/head -> origin/gh/fffrog/138/head 2025-09-07T06:39:15.2965677Z * [new branch] gh/fffrog/138/orig -> origin/gh/fffrog/138/orig 2025-09-07T06:39:15.2965751Z * [new branch] gh/fffrog/139/base -> origin/gh/fffrog/139/base 2025-09-07T06:39:15.2965826Z * [new branch] gh/fffrog/139/head -> origin/gh/fffrog/139/head 2025-09-07T06:39:15.2965897Z * [new branch] gh/fffrog/139/orig -> origin/gh/fffrog/139/orig 2025-09-07T06:39:15.2965974Z * [new branch] gh/fffrog/140/base -> origin/gh/fffrog/140/base 2025-09-07T06:39:15.2966044Z * [new branch] gh/fffrog/140/head -> origin/gh/fffrog/140/head 2025-09-07T06:39:15.2966171Z * [new branch] gh/fffrog/140/orig -> origin/gh/fffrog/140/orig 2025-09-07T06:39:15.2966242Z * [new branch] gh/fffrog/141/base -> origin/gh/fffrog/141/base 2025-09-07T06:39:15.2966313Z * [new branch] gh/fffrog/141/head -> origin/gh/fffrog/141/head 2025-09-07T06:39:15.2966383Z * [new branch] gh/fffrog/141/orig -> origin/gh/fffrog/141/orig 2025-09-07T06:39:15.2966455Z * [new branch] gh/fffrog/142/base -> origin/gh/fffrog/142/base 2025-09-07T06:39:15.2966531Z * [new branch] gh/fffrog/142/head -> origin/gh/fffrog/142/head 2025-09-07T06:39:15.2966602Z * [new branch] gh/fffrog/142/orig -> origin/gh/fffrog/142/orig 2025-09-07T06:39:15.2966706Z * [new branch] gh/fffrog/143/base -> origin/gh/fffrog/143/base 2025-09-07T06:39:15.2966776Z * [new branch] gh/fffrog/143/head -> origin/gh/fffrog/143/head 2025-09-07T06:39:15.2966857Z * [new branch] gh/fffrog/143/orig -> origin/gh/fffrog/143/orig 2025-09-07T06:39:15.2966937Z * [new branch] gh/fffrog/144/base -> origin/gh/fffrog/144/base 2025-09-07T06:39:15.2967007Z * [new branch] gh/fffrog/144/head -> origin/gh/fffrog/144/head 2025-09-07T06:39:15.2967078Z * [new branch] gh/fffrog/144/orig -> origin/gh/fffrog/144/orig 2025-09-07T06:39:15.2967149Z * [new branch] gh/fffrog/145/base -> origin/gh/fffrog/145/base 2025-09-07T06:39:15.2967220Z * [new branch] gh/fffrog/145/head -> origin/gh/fffrog/145/head 2025-09-07T06:39:15.2967297Z * [new branch] gh/fffrog/145/orig -> origin/gh/fffrog/145/orig 2025-09-07T06:39:15.2967375Z * [new branch] gh/fffrog/146/base -> origin/gh/fffrog/146/base 2025-09-07T06:39:15.2967446Z * [new branch] gh/fffrog/146/head -> origin/gh/fffrog/146/head 2025-09-07T06:39:15.2967518Z * [new branch] gh/fffrog/146/orig -> origin/gh/fffrog/146/orig 2025-09-07T06:39:15.2967590Z * [new branch] gh/fffrog/147/base -> origin/gh/fffrog/147/base 2025-09-07T06:39:15.2967661Z * [new branch] gh/fffrog/147/head -> origin/gh/fffrog/147/head 2025-09-07T06:39:15.2967731Z * [new branch] gh/fffrog/147/orig -> origin/gh/fffrog/147/orig 2025-09-07T06:39:15.2967802Z * [new branch] gh/fffrog/148/base -> origin/gh/fffrog/148/base 2025-09-07T06:39:15.2967873Z * [new branch] gh/fffrog/148/head -> origin/gh/fffrog/148/head 2025-09-07T06:39:15.2969655Z * [new branch] gh/fffrog/148/orig -> origin/gh/fffrog/148/orig 2025-09-07T06:39:15.2969760Z * [new branch] gh/fffrog/149/base -> origin/gh/fffrog/149/base 2025-09-07T06:39:15.2969834Z * [new branch] gh/fffrog/149/head -> origin/gh/fffrog/149/head 2025-09-07T06:39:15.2969907Z * [new branch] gh/fffrog/149/orig -> origin/gh/fffrog/149/orig 2025-09-07T06:39:15.2969986Z * [new branch] gh/fffrog/150/base -> origin/gh/fffrog/150/base 2025-09-07T06:39:15.2970062Z * [new branch] gh/fffrog/150/head -> origin/gh/fffrog/150/head 2025-09-07T06:39:15.2970143Z * [new branch] gh/fffrog/150/orig -> origin/gh/fffrog/150/orig 2025-09-07T06:39:15.2970214Z * [new branch] gh/fffrog/151/base -> origin/gh/fffrog/151/base 2025-09-07T06:39:15.2970293Z * [new branch] gh/fffrog/151/head -> origin/gh/fffrog/151/head 2025-09-07T06:39:15.2970371Z * [new branch] gh/fffrog/151/orig -> origin/gh/fffrog/151/orig 2025-09-07T06:39:15.2970446Z * [new branch] gh/fffrog/152/base -> origin/gh/fffrog/152/base 2025-09-07T06:39:15.2970518Z * [new branch] gh/fffrog/152/head -> origin/gh/fffrog/152/head 2025-09-07T06:39:15.2970629Z * [new branch] gh/fffrog/153/base -> origin/gh/fffrog/153/base 2025-09-07T06:39:15.2970700Z * [new branch] gh/fffrog/153/head -> origin/gh/fffrog/153/head 2025-09-07T06:39:15.2970773Z * [new branch] gh/fffrog/153/orig -> origin/gh/fffrog/153/orig 2025-09-07T06:39:15.2970860Z * [new branch] gh/gmagogsfm/1/base -> origin/gh/gmagogsfm/1/base 2025-09-07T06:39:15.2970935Z * [new branch] gh/gmagogsfm/1/head -> origin/gh/gmagogsfm/1/head 2025-09-07T06:39:15.2971010Z * [new branch] gh/gmagogsfm/1/orig -> origin/gh/gmagogsfm/1/orig 2025-09-07T06:39:15.2971114Z * [new branch] gh/gmagogsfm/2/base -> origin/gh/gmagogsfm/2/base 2025-09-07T06:39:15.2971188Z * [new branch] gh/gmagogsfm/2/head -> origin/gh/gmagogsfm/2/head 2025-09-07T06:39:15.2971262Z * [new branch] gh/gmagogsfm/2/orig -> origin/gh/gmagogsfm/2/orig 2025-09-07T06:39:15.2971338Z * [new branch] gh/gmagogsfm/3/base -> origin/gh/gmagogsfm/3/base 2025-09-07T06:39:15.2971411Z * [new branch] gh/gmagogsfm/3/head -> origin/gh/gmagogsfm/3/head 2025-09-07T06:39:15.2972802Z * [new branch] gh/gmagogsfm/3/orig -> origin/gh/gmagogsfm/3/orig 2025-09-07T06:39:15.2972887Z * [new branch] gh/guangyey/134/base -> origin/gh/guangyey/134/base 2025-09-07T06:39:15.2972971Z * [new branch] gh/guangyey/134/head -> origin/gh/guangyey/134/head 2025-09-07T06:39:15.2973054Z * [new branch] gh/guangyey/134/orig -> origin/gh/guangyey/134/orig 2025-09-07T06:39:15.2973218Z * [new branch] gh/guangyey/135/base -> origin/gh/guangyey/135/base 2025-09-07T06:39:15.2973295Z * [new branch] gh/guangyey/135/head -> origin/gh/guangyey/135/head 2025-09-07T06:39:15.2973373Z * [new branch] gh/guangyey/135/orig -> origin/gh/guangyey/135/orig 2025-09-07T06:39:15.2973462Z * [new branch] gh/guangyey/139/base -> origin/gh/guangyey/139/base 2025-09-07T06:39:15.2973536Z * [new branch] gh/guangyey/139/head -> origin/gh/guangyey/139/head 2025-09-07T06:39:15.2973616Z * [new branch] gh/guangyey/139/orig -> origin/gh/guangyey/139/orig 2025-09-07T06:39:15.2973705Z * [new branch] gh/guangyey/140/base -> origin/gh/guangyey/140/base 2025-09-07T06:39:15.2973787Z * [new branch] gh/guangyey/140/head -> origin/gh/guangyey/140/head 2025-09-07T06:39:15.2973861Z * [new branch] gh/guangyey/140/orig -> origin/gh/guangyey/140/orig 2025-09-07T06:39:15.2973947Z * [new branch] gh/guangyey/142/base -> origin/gh/guangyey/142/base 2025-09-07T06:39:15.2974021Z * [new branch] gh/guangyey/142/head -> origin/gh/guangyey/142/head 2025-09-07T06:39:15.2974096Z * [new branch] gh/guangyey/142/orig -> origin/gh/guangyey/142/orig 2025-09-07T06:39:15.2974171Z * [new branch] gh/guangyey/145/base -> origin/gh/guangyey/145/base 2025-09-07T06:39:15.2974245Z * [new branch] gh/guangyey/145/head -> origin/gh/guangyey/145/head 2025-09-07T06:39:15.2974318Z * [new branch] gh/guangyey/145/orig -> origin/gh/guangyey/145/orig 2025-09-07T06:39:15.2974393Z * [new branch] gh/guangyey/153/base -> origin/gh/guangyey/153/base 2025-09-07T06:39:15.2974468Z * [new branch] gh/guangyey/153/head -> origin/gh/guangyey/153/head 2025-09-07T06:39:15.2974541Z * [new branch] gh/guangyey/153/orig -> origin/gh/guangyey/153/orig 2025-09-07T06:39:15.2979642Z * [new branch] gh/guangyey/159/base -> origin/gh/guangyey/159/base 2025-09-07T06:39:15.2979729Z * [new branch] gh/guangyey/159/head -> origin/gh/guangyey/159/head 2025-09-07T06:39:15.2979870Z * [new branch] gh/guangyey/159/orig -> origin/gh/guangyey/159/orig 2025-09-07T06:39:15.2979957Z * [new branch] gh/guangyey/163/base -> origin/gh/guangyey/163/base 2025-09-07T06:39:15.2980030Z * [new branch] gh/guangyey/163/head -> origin/gh/guangyey/163/head 2025-09-07T06:39:15.2980110Z * [new branch] gh/guangyey/163/orig -> origin/gh/guangyey/163/orig 2025-09-07T06:39:15.2980199Z * [new branch] gh/guangyey/168/base -> origin/gh/guangyey/168/base 2025-09-07T06:39:15.2980278Z * [new branch] gh/guangyey/168/head -> origin/gh/guangyey/168/head 2025-09-07T06:39:15.2980362Z * [new branch] gh/guangyey/168/orig -> origin/gh/guangyey/168/orig 2025-09-07T06:39:15.2980482Z * [new branch] gh/guangyey/169/base -> origin/gh/guangyey/169/base 2025-09-07T06:39:15.2980555Z * [new branch] gh/guangyey/169/head -> origin/gh/guangyey/169/head 2025-09-07T06:39:15.2980637Z * [new branch] gh/guangyey/169/orig -> origin/gh/guangyey/169/orig 2025-09-07T06:39:15.2980727Z * [new branch] gh/guangyey/170/base -> origin/gh/guangyey/170/base 2025-09-07T06:39:15.2980800Z * [new branch] gh/guangyey/170/head -> origin/gh/guangyey/170/head 2025-09-07T06:39:15.2980876Z * [new branch] gh/guangyey/170/orig -> origin/gh/guangyey/170/orig 2025-09-07T06:39:15.2980956Z * [new branch] gh/guangyey/171/base -> origin/gh/guangyey/171/base 2025-09-07T06:39:15.2981035Z * [new branch] gh/guangyey/171/head -> origin/gh/guangyey/171/head 2025-09-07T06:39:15.2981113Z * [new branch] gh/guangyey/171/orig -> origin/gh/guangyey/171/orig 2025-09-07T06:39:15.2981187Z * [new branch] gh/guangyey/174/base -> origin/gh/guangyey/174/base 2025-09-07T06:39:15.2981270Z * [new branch] gh/guangyey/174/head -> origin/gh/guangyey/174/head 2025-09-07T06:39:15.2981344Z * [new branch] gh/guangyey/174/orig -> origin/gh/guangyey/174/orig 2025-09-07T06:39:15.2981418Z * [new branch] gh/guangyey/176/base -> origin/gh/guangyey/176/base 2025-09-07T06:39:15.2981493Z * [new branch] gh/guangyey/176/head -> origin/gh/guangyey/176/head 2025-09-07T06:39:15.2981573Z * [new branch] gh/guangyey/176/orig -> origin/gh/guangyey/176/orig 2025-09-07T06:39:15.2981649Z * [new branch] gh/guangyey/178/base -> origin/gh/guangyey/178/base 2025-09-07T06:39:15.2981734Z * [new branch] gh/guangyey/178/head -> origin/gh/guangyey/178/head 2025-09-07T06:39:15.2981809Z * [new branch] gh/guangyey/178/orig -> origin/gh/guangyey/178/orig 2025-09-07T06:39:15.2981883Z * [new branch] gh/guangyey/181/base -> origin/gh/guangyey/181/base 2025-09-07T06:39:15.2981961Z * [new branch] gh/guangyey/181/head -> origin/gh/guangyey/181/head 2025-09-07T06:39:15.2982035Z * [new branch] gh/guangyey/181/orig -> origin/gh/guangyey/181/orig 2025-09-07T06:39:15.2982116Z * [new branch] gh/guangyey/182/base -> origin/gh/guangyey/182/base 2025-09-07T06:39:15.2982191Z * [new branch] gh/guangyey/182/head -> origin/gh/guangyey/182/head 2025-09-07T06:39:15.2982264Z * [new branch] gh/guangyey/182/orig -> origin/gh/guangyey/182/orig 2025-09-07T06:39:15.2982344Z * [new branch] gh/guangyey/183/base -> origin/gh/guangyey/183/base 2025-09-07T06:39:15.2982424Z * [new branch] gh/guangyey/183/head -> origin/gh/guangyey/183/head 2025-09-07T06:39:15.2982507Z * [new branch] gh/guangyey/183/orig -> origin/gh/guangyey/183/orig 2025-09-07T06:39:15.2982580Z * [new branch] gh/guangyey/184/base -> origin/gh/guangyey/184/base 2025-09-07T06:39:15.2982696Z * [new branch] gh/guangyey/184/head -> origin/gh/guangyey/184/head 2025-09-07T06:39:15.2982772Z * [new branch] gh/guangyey/184/orig -> origin/gh/guangyey/184/orig 2025-09-07T06:39:15.2982846Z * [new branch] gh/guangyey/185/base -> origin/gh/guangyey/185/base 2025-09-07T06:39:15.2984770Z * [new branch] gh/guangyey/185/head -> origin/gh/guangyey/185/head 2025-09-07T06:39:15.2984872Z * [new branch] gh/guangyey/185/orig -> origin/gh/guangyey/185/orig 2025-09-07T06:39:15.2984946Z * [new branch] gh/guangyey/186/base -> origin/gh/guangyey/186/base 2025-09-07T06:39:15.2985220Z * [new branch] gh/guangyey/186/head -> origin/gh/guangyey/186/head 2025-09-07T06:39:15.2985373Z * [new branch] gh/guangyey/186/orig -> origin/gh/guangyey/186/orig 2025-09-07T06:39:15.2985448Z * [new branch] gh/guangyey/187/base -> origin/gh/guangyey/187/base 2025-09-07T06:39:15.2985530Z * [new branch] gh/guangyey/187/head -> origin/gh/guangyey/187/head 2025-09-07T06:39:15.2985612Z * [new branch] gh/guangyey/187/orig -> origin/gh/guangyey/187/orig 2025-09-07T06:39:15.2985686Z * [new branch] gh/guangyey/188/base -> origin/gh/guangyey/188/base 2025-09-07T06:39:15.2985766Z * [new branch] gh/guangyey/188/head -> origin/gh/guangyey/188/head 2025-09-07T06:39:15.2985852Z * [new branch] gh/guangyey/188/orig -> origin/gh/guangyey/188/orig 2025-09-07T06:39:15.2985925Z * [new branch] gh/guangyey/189/base -> origin/gh/guangyey/189/base 2025-09-07T06:39:15.2986006Z * [new branch] gh/guangyey/189/head -> origin/gh/guangyey/189/head 2025-09-07T06:39:15.2986088Z * [new branch] gh/guangyey/189/orig -> origin/gh/guangyey/189/orig 2025-09-07T06:39:15.2986161Z * [new branch] gh/guangyey/190/base -> origin/gh/guangyey/190/base 2025-09-07T06:39:15.2986236Z * [new branch] gh/guangyey/190/head -> origin/gh/guangyey/190/head 2025-09-07T06:39:15.2986310Z * [new branch] gh/guangyey/190/orig -> origin/gh/guangyey/190/orig 2025-09-07T06:39:15.2986386Z * [new branch] gh/guangyey/191/base -> origin/gh/guangyey/191/base 2025-09-07T06:39:15.2986462Z * [new branch] gh/guangyey/191/head -> origin/gh/guangyey/191/head 2025-09-07T06:39:15.2986537Z * [new branch] gh/guangyey/191/orig -> origin/gh/guangyey/191/orig 2025-09-07T06:39:15.2986613Z * [new branch] gh/guangyey/192/base -> origin/gh/guangyey/192/base 2025-09-07T06:39:15.2986693Z * [new branch] gh/guangyey/192/head -> origin/gh/guangyey/192/head 2025-09-07T06:39:15.2986772Z * [new branch] gh/guangyey/192/orig -> origin/gh/guangyey/192/orig 2025-09-07T06:39:15.2986847Z * [new branch] gh/guangyey/193/base -> origin/gh/guangyey/193/base 2025-09-07T06:39:15.2986920Z * [new branch] gh/guangyey/193/head -> origin/gh/guangyey/193/head 2025-09-07T06:39:15.2986993Z * [new branch] gh/guangyey/193/orig -> origin/gh/guangyey/193/orig 2025-09-07T06:39:15.2987068Z * [new branch] gh/guangyey/194/base -> origin/gh/guangyey/194/base 2025-09-07T06:39:15.2987141Z * [new branch] gh/guangyey/194/head -> origin/gh/guangyey/194/head 2025-09-07T06:39:15.2987215Z * [new branch] gh/guangyey/194/orig -> origin/gh/guangyey/194/orig 2025-09-07T06:39:15.2987290Z * [new branch] gh/guangyey/195/base -> origin/gh/guangyey/195/base 2025-09-07T06:39:15.2987377Z * [new branch] gh/guangyey/195/head -> origin/gh/guangyey/195/head 2025-09-07T06:39:15.2987453Z * [new branch] gh/guangyey/195/orig -> origin/gh/guangyey/195/orig 2025-09-07T06:39:15.2987565Z * [new branch] gh/guangyey/196/base -> origin/gh/guangyey/196/base 2025-09-07T06:39:15.2987639Z * [new branch] gh/guangyey/196/head -> origin/gh/guangyey/196/head 2025-09-07T06:39:15.2987712Z * [new branch] gh/guangyey/196/orig -> origin/gh/guangyey/196/orig 2025-09-07T06:39:15.2988808Z * [new branch] gh/guangyey/197/base -> origin/gh/guangyey/197/base 2025-09-07T06:39:15.2988882Z * [new branch] gh/guangyey/197/head -> origin/gh/guangyey/197/head 2025-09-07T06:39:15.2988956Z * [new branch] gh/guangyey/197/orig -> origin/gh/guangyey/197/orig 2025-09-07T06:39:15.2989035Z * [new branch] gh/guangyey/198/base -> origin/gh/guangyey/198/base 2025-09-07T06:39:15.2989141Z * [new branch] gh/guangyey/198/head -> origin/gh/guangyey/198/head 2025-09-07T06:39:15.2989214Z * [new branch] gh/guangyey/198/orig -> origin/gh/guangyey/198/orig 2025-09-07T06:39:15.2989302Z * [new branch] gh/guangyey/199/base -> origin/gh/guangyey/199/base 2025-09-07T06:39:15.2989383Z * [new branch] gh/guangyey/199/head -> origin/gh/guangyey/199/head 2025-09-07T06:39:15.2989459Z * [new branch] gh/guangyey/199/orig -> origin/gh/guangyey/199/orig 2025-09-07T06:39:15.2989533Z * [new branch] gh/guangyey/200/base -> origin/gh/guangyey/200/base 2025-09-07T06:39:15.2989606Z * [new branch] gh/guangyey/200/head -> origin/gh/guangyey/200/head 2025-09-07T06:39:15.2989680Z * [new branch] gh/guangyey/200/orig -> origin/gh/guangyey/200/orig 2025-09-07T06:39:15.2989759Z * [new branch] gh/guangyey/201/base -> origin/gh/guangyey/201/base 2025-09-07T06:39:15.2989833Z * [new branch] gh/guangyey/201/head -> origin/gh/guangyey/201/head 2025-09-07T06:39:15.2989906Z * [new branch] gh/guangyey/201/orig -> origin/gh/guangyey/201/orig 2025-09-07T06:39:15.2989986Z * [new branch] gh/guangyey/202/base -> origin/gh/guangyey/202/base 2025-09-07T06:39:15.2990060Z * [new branch] gh/guangyey/202/head -> origin/gh/guangyey/202/head 2025-09-07T06:39:15.2990134Z * [new branch] gh/guangyey/202/orig -> origin/gh/guangyey/202/orig 2025-09-07T06:39:15.2990209Z * [new branch] gh/guangyey/203/base -> origin/gh/guangyey/203/base 2025-09-07T06:39:15.2990283Z * [new branch] gh/guangyey/203/head -> origin/gh/guangyey/203/head 2025-09-07T06:39:15.2990356Z * [new branch] gh/guangyey/203/orig -> origin/gh/guangyey/203/orig 2025-09-07T06:39:15.2990437Z * [new branch] gh/guangyey/204/base -> origin/gh/guangyey/204/base 2025-09-07T06:39:15.2990511Z * [new branch] gh/guangyey/204/head -> origin/gh/guangyey/204/head 2025-09-07T06:39:15.2990586Z * [new branch] gh/guangyey/204/orig -> origin/gh/guangyey/204/orig 2025-09-07T06:39:15.2990660Z * [new branch] gh/guangyey/205/base -> origin/gh/guangyey/205/base 2025-09-07T06:39:15.2990736Z * [new branch] gh/guangyey/205/head -> origin/gh/guangyey/205/head 2025-09-07T06:39:15.2990810Z * [new branch] gh/guangyey/205/orig -> origin/gh/guangyey/205/orig 2025-09-07T06:39:15.2990885Z * [new branch] gh/guangyey/206/base -> origin/gh/guangyey/206/base 2025-09-07T06:39:15.2990960Z * [new branch] gh/guangyey/206/head -> origin/gh/guangyey/206/head 2025-09-07T06:39:15.2991033Z * [new branch] gh/guangyey/206/orig -> origin/gh/guangyey/206/orig 2025-09-07T06:39:15.2991111Z * [new branch] gh/guangyey/207/base -> origin/gh/guangyey/207/base 2025-09-07T06:39:15.2991188Z * [new branch] gh/guangyey/207/head -> origin/gh/guangyey/207/head 2025-09-07T06:39:15.2991287Z * [new branch] gh/guangyey/207/orig -> origin/gh/guangyey/207/orig 2025-09-07T06:39:15.2991363Z * [new branch] gh/guangyey/79/base -> origin/gh/guangyey/79/base 2025-09-07T06:39:15.2991439Z * [new branch] gh/guangyey/79/head -> origin/gh/guangyey/79/head 2025-09-07T06:39:15.2991542Z * [new branch] gh/guangyey/79/orig -> origin/gh/guangyey/79/orig 2025-09-07T06:39:15.2991631Z * [new branch] gh/guangyey/89/base -> origin/gh/guangyey/89/base 2025-09-07T06:39:15.2991741Z * [new branch] gh/guangyey/89/head -> origin/gh/guangyey/89/head 2025-09-07T06:39:15.2991827Z * [new branch] gh/guangyey/89/orig -> origin/gh/guangyey/89/orig 2025-09-07T06:39:15.2992027Z * [new branch] gh/guilhermeleobas/107/base -> origin/gh/guilhermeleobas/107/base 2025-09-07T06:39:15.2992135Z * [new branch] gh/guilhermeleobas/107/head -> origin/gh/guilhermeleobas/107/head 2025-09-07T06:39:15.2992251Z * [new branch] gh/guilhermeleobas/107/orig -> origin/gh/guilhermeleobas/107/orig 2025-09-07T06:39:15.2992363Z * [new branch] gh/guilhermeleobas/108/base -> origin/gh/guilhermeleobas/108/base 2025-09-07T06:39:15.2992484Z * [new branch] gh/guilhermeleobas/108/head -> origin/gh/guilhermeleobas/108/head 2025-09-07T06:39:15.2992623Z * [new branch] gh/guilhermeleobas/108/orig -> origin/gh/guilhermeleobas/108/orig 2025-09-07T06:39:15.2992732Z * [new branch] gh/guilhermeleobas/124/base -> origin/gh/guilhermeleobas/124/base 2025-09-07T06:39:15.2992831Z * [new branch] gh/guilhermeleobas/124/head -> origin/gh/guilhermeleobas/124/head 2025-09-07T06:39:15.2992945Z * [new branch] gh/guilhermeleobas/124/orig -> origin/gh/guilhermeleobas/124/orig 2025-09-07T06:39:15.2993051Z * [new branch] gh/guilhermeleobas/147/base -> origin/gh/guilhermeleobas/147/base 2025-09-07T06:39:15.2993223Z * [new branch] gh/guilhermeleobas/147/head -> origin/gh/guilhermeleobas/147/head 2025-09-07T06:39:15.2993358Z * [new branch] gh/guilhermeleobas/147/orig -> origin/gh/guilhermeleobas/147/orig 2025-09-07T06:39:15.2993464Z * [new branch] gh/guilhermeleobas/150/base -> origin/gh/guilhermeleobas/150/base 2025-09-07T06:39:15.2993565Z * [new branch] gh/guilhermeleobas/150/head -> origin/gh/guilhermeleobas/150/head 2025-09-07T06:39:15.2993685Z * [new branch] gh/guilhermeleobas/150/orig -> origin/gh/guilhermeleobas/150/orig 2025-09-07T06:39:15.2993784Z * [new branch] gh/guilhermeleobas/163/base -> origin/gh/guilhermeleobas/163/base 2025-09-07T06:39:15.2993887Z * [new branch] gh/guilhermeleobas/163/head -> origin/gh/guilhermeleobas/163/head 2025-09-07T06:39:15.2994013Z * [new branch] gh/guilhermeleobas/163/orig -> origin/gh/guilhermeleobas/163/orig 2025-09-07T06:39:15.2994121Z * [new branch] gh/guilhermeleobas/164/base -> origin/gh/guilhermeleobas/164/base 2025-09-07T06:39:15.2994221Z * [new branch] gh/guilhermeleobas/164/head -> origin/gh/guilhermeleobas/164/head 2025-09-07T06:39:15.2994350Z * [new branch] gh/guilhermeleobas/164/orig -> origin/gh/guilhermeleobas/164/orig 2025-09-07T06:39:15.2994451Z * [new branch] gh/guilhermeleobas/165/base -> origin/gh/guilhermeleobas/165/base 2025-09-07T06:39:15.2994552Z * [new branch] gh/guilhermeleobas/165/head -> origin/gh/guilhermeleobas/165/head 2025-09-07T06:39:15.2994685Z * [new branch] gh/guilhermeleobas/165/orig -> origin/gh/guilhermeleobas/165/orig 2025-09-07T06:39:15.2994827Z * [new branch] gh/guilhermeleobas/166/base -> origin/gh/guilhermeleobas/166/base 2025-09-07T06:39:15.2994948Z * [new branch] gh/guilhermeleobas/166/head -> origin/gh/guilhermeleobas/166/head 2025-09-07T06:39:15.2995074Z * [new branch] gh/guilhermeleobas/166/orig -> origin/gh/guilhermeleobas/166/orig 2025-09-07T06:39:15.2995215Z * [new branch] gh/guilhermeleobas/167/base -> origin/gh/guilhermeleobas/167/base 2025-09-07T06:39:15.2995312Z * [new branch] gh/guilhermeleobas/167/head -> origin/gh/guilhermeleobas/167/head 2025-09-07T06:39:15.2995466Z * [new branch] gh/guilhermeleobas/167/orig -> origin/gh/guilhermeleobas/167/orig 2025-09-07T06:39:15.2995571Z * [new branch] gh/guilhermeleobas/168/base -> origin/gh/guilhermeleobas/168/base 2025-09-07T06:39:15.2995675Z * [new branch] gh/guilhermeleobas/168/head -> origin/gh/guilhermeleobas/168/head 2025-09-07T06:39:15.2995795Z * [new branch] gh/guilhermeleobas/168/orig -> origin/gh/guilhermeleobas/168/orig 2025-09-07T06:39:15.2995932Z * [new branch] gh/guilhermeleobas/169/base -> origin/gh/guilhermeleobas/169/base 2025-09-07T06:39:15.2996028Z * [new branch] gh/guilhermeleobas/169/head -> origin/gh/guilhermeleobas/169/head 2025-09-07T06:39:15.2996170Z * [new branch] gh/guilhermeleobas/169/orig -> origin/gh/guilhermeleobas/169/orig 2025-09-07T06:39:15.2996279Z * [new branch] gh/guilhermeleobas/170/base -> origin/gh/guilhermeleobas/170/base 2025-09-07T06:39:15.2996380Z * [new branch] gh/guilhermeleobas/170/head -> origin/gh/guilhermeleobas/170/head 2025-09-07T06:39:15.2996500Z * [new branch] gh/guilhermeleobas/170/orig -> origin/gh/guilhermeleobas/170/orig 2025-09-07T06:39:15.2996601Z * [new branch] gh/guilhermeleobas/171/base -> origin/gh/guilhermeleobas/171/base 2025-09-07T06:39:15.2996698Z * [new branch] gh/guilhermeleobas/171/head -> origin/gh/guilhermeleobas/171/head 2025-09-07T06:39:15.2996855Z * [new branch] gh/guilhermeleobas/171/orig -> origin/gh/guilhermeleobas/171/orig 2025-09-07T06:39:15.2996962Z * [new branch] gh/guilhermeleobas/173/base -> origin/gh/guilhermeleobas/173/base 2025-09-07T06:39:15.2997064Z * [new branch] gh/guilhermeleobas/173/head -> origin/gh/guilhermeleobas/173/head 2025-09-07T06:39:15.2997179Z * [new branch] gh/guilhermeleobas/173/orig -> origin/gh/guilhermeleobas/173/orig 2025-09-07T06:39:15.2997276Z * [new branch] gh/guilhermeleobas/192/base -> origin/gh/guilhermeleobas/192/base 2025-09-07T06:39:15.2997399Z * [new branch] gh/guilhermeleobas/192/head -> origin/gh/guilhermeleobas/192/head 2025-09-07T06:39:15.2997522Z * [new branch] gh/guilhermeleobas/192/orig -> origin/gh/guilhermeleobas/192/orig 2025-09-07T06:39:15.2997625Z * [new branch] gh/guilhermeleobas/193/base -> origin/gh/guilhermeleobas/193/base 2025-09-07T06:39:15.2997726Z * [new branch] gh/guilhermeleobas/193/head -> origin/gh/guilhermeleobas/193/head 2025-09-07T06:39:15.2997831Z * [new branch] gh/guilhermeleobas/193/orig -> origin/gh/guilhermeleobas/193/orig 2025-09-07T06:39:15.2997971Z * [new branch] gh/guilhermeleobas/194/base -> origin/gh/guilhermeleobas/194/base 2025-09-07T06:39:15.2998098Z * [new branch] gh/guilhermeleobas/194/head -> origin/gh/guilhermeleobas/194/head 2025-09-07T06:39:15.2998204Z * [new branch] gh/guilhermeleobas/194/orig -> origin/gh/guilhermeleobas/194/orig 2025-09-07T06:39:15.2998327Z * [new branch] gh/guilhermeleobas/203/base -> origin/gh/guilhermeleobas/203/base 2025-09-07T06:39:15.2998433Z * [new branch] gh/guilhermeleobas/203/head -> origin/gh/guilhermeleobas/203/head 2025-09-07T06:39:15.2998537Z * [new branch] gh/guilhermeleobas/203/orig -> origin/gh/guilhermeleobas/203/orig 2025-09-07T06:39:15.2998646Z * [new branch] gh/guilhermeleobas/204/base -> origin/gh/guilhermeleobas/204/base 2025-09-07T06:39:15.2998765Z * [new branch] gh/guilhermeleobas/204/head -> origin/gh/guilhermeleobas/204/head 2025-09-07T06:39:15.2998881Z * [new branch] gh/guilhermeleobas/204/orig -> origin/gh/guilhermeleobas/204/orig 2025-09-07T06:39:15.2999030Z * [new branch] gh/guilhermeleobas/205/base -> origin/gh/guilhermeleobas/205/base 2025-09-07T06:39:15.2999152Z * [new branch] gh/guilhermeleobas/205/head -> origin/gh/guilhermeleobas/205/head 2025-09-07T06:39:15.2999255Z * [new branch] gh/guilhermeleobas/205/orig -> origin/gh/guilhermeleobas/205/orig 2025-09-07T06:39:15.2999386Z * [new branch] gh/guilhermeleobas/209/base -> origin/gh/guilhermeleobas/209/base 2025-09-07T06:39:15.2999505Z * [new branch] gh/guilhermeleobas/209/head -> origin/gh/guilhermeleobas/209/head 2025-09-07T06:39:15.2999604Z * [new branch] gh/guilhermeleobas/209/orig -> origin/gh/guilhermeleobas/209/orig 2025-09-07T06:39:15.2999767Z * [new branch] gh/guilhermeleobas/210/base -> origin/gh/guilhermeleobas/210/base 2025-09-07T06:39:15.2999868Z * [new branch] gh/guilhermeleobas/210/head -> origin/gh/guilhermeleobas/210/head 2025-09-07T06:39:15.2999969Z * [new branch] gh/guilhermeleobas/210/orig -> origin/gh/guilhermeleobas/210/orig 2025-09-07T06:39:15.3000107Z * [new branch] gh/guilhermeleobas/211/base -> origin/gh/guilhermeleobas/211/base 2025-09-07T06:39:15.3000214Z * [new branch] gh/guilhermeleobas/211/head -> origin/gh/guilhermeleobas/211/head 2025-09-07T06:39:15.3000319Z * [new branch] gh/guilhermeleobas/211/orig -> origin/gh/guilhermeleobas/211/orig 2025-09-07T06:39:15.3000431Z * [new branch] gh/guilhermeleobas/214/base -> origin/gh/guilhermeleobas/214/base 2025-09-07T06:39:15.3000564Z * [new branch] gh/guilhermeleobas/214/head -> origin/gh/guilhermeleobas/214/head 2025-09-07T06:39:15.3000668Z * [new branch] gh/guilhermeleobas/214/orig -> origin/gh/guilhermeleobas/214/orig 2025-09-07T06:39:15.3000797Z * [new branch] gh/guilhermeleobas/215/base -> origin/gh/guilhermeleobas/215/base 2025-09-07T06:39:15.3000906Z * [new branch] gh/guilhermeleobas/215/head -> origin/gh/guilhermeleobas/215/head 2025-09-07T06:39:15.3001009Z * [new branch] gh/guilhermeleobas/215/orig -> origin/gh/guilhermeleobas/215/orig 2025-09-07T06:39:15.3001120Z * [new branch] gh/guilhermeleobas/216/base -> origin/gh/guilhermeleobas/216/base 2025-09-07T06:39:15.3001221Z * [new branch] gh/guilhermeleobas/216/head -> origin/gh/guilhermeleobas/216/head 2025-09-07T06:39:15.3001327Z * [new branch] gh/guilhermeleobas/216/orig -> origin/gh/guilhermeleobas/216/orig 2025-09-07T06:39:15.3001491Z * [new branch] gh/guilhermeleobas/217/base -> origin/gh/guilhermeleobas/217/base 2025-09-07T06:39:15.3001597Z * [new branch] gh/guilhermeleobas/217/head -> origin/gh/guilhermeleobas/217/head 2025-09-07T06:39:15.3001700Z * [new branch] gh/guilhermeleobas/217/orig -> origin/gh/guilhermeleobas/217/orig 2025-09-07T06:39:15.3001815Z * [new branch] gh/guilhermeleobas/219/base -> origin/gh/guilhermeleobas/219/base 2025-09-07T06:39:15.3001920Z * [new branch] gh/guilhermeleobas/219/head -> origin/gh/guilhermeleobas/219/head 2025-09-07T06:39:15.3002016Z * [new branch] gh/guilhermeleobas/219/orig -> origin/gh/guilhermeleobas/219/orig 2025-09-07T06:39:15.3002156Z * [new branch] gh/guilhermeleobas/220/base -> origin/gh/guilhermeleobas/220/base 2025-09-07T06:39:15.3002256Z * [new branch] gh/guilhermeleobas/220/head -> origin/gh/guilhermeleobas/220/head 2025-09-07T06:39:15.3002357Z * [new branch] gh/guilhermeleobas/220/orig -> origin/gh/guilhermeleobas/220/orig 2025-09-07T06:39:15.3002468Z * [new branch] gh/guilhermeleobas/221/base -> origin/gh/guilhermeleobas/221/base 2025-09-07T06:39:15.3002573Z * [new branch] gh/guilhermeleobas/221/head -> origin/gh/guilhermeleobas/221/head 2025-09-07T06:39:15.3002667Z * [new branch] gh/guilhermeleobas/221/orig -> origin/gh/guilhermeleobas/221/orig 2025-09-07T06:39:15.3002852Z * [new branch] gh/guilhermeleobas/222/base -> origin/gh/guilhermeleobas/222/base 2025-09-07T06:39:15.3005214Z * [new branch] gh/guilhermeleobas/222/head -> origin/gh/guilhermeleobas/222/head 2025-09-07T06:39:15.3005311Z * [new branch] gh/guilhermeleobas/222/orig -> origin/gh/guilhermeleobas/222/orig 2025-09-07T06:39:15.3005399Z * [new branch] gh/guilhermeleobas/223/base -> origin/gh/guilhermeleobas/223/base 2025-09-07T06:39:15.3005488Z * [new branch] gh/guilhermeleobas/223/head -> origin/gh/guilhermeleobas/223/head 2025-09-07T06:39:15.3005582Z * [new branch] gh/guilhermeleobas/223/orig -> origin/gh/guilhermeleobas/223/orig 2025-09-07T06:39:15.3005732Z * [new branch] gh/guilhermeleobas/224/base -> origin/gh/guilhermeleobas/224/base 2025-09-07T06:39:15.3005830Z * [new branch] gh/guilhermeleobas/224/head -> origin/gh/guilhermeleobas/224/head 2025-09-07T06:39:15.3005921Z * [new branch] gh/guilhermeleobas/224/orig -> origin/gh/guilhermeleobas/224/orig 2025-09-07T06:39:15.3006010Z * [new branch] gh/guilhermeleobas/225/base -> origin/gh/guilhermeleobas/225/base 2025-09-07T06:39:15.3006108Z * [new branch] gh/guilhermeleobas/225/head -> origin/gh/guilhermeleobas/225/head 2025-09-07T06:39:15.3006195Z * [new branch] gh/guilhermeleobas/225/orig -> origin/gh/guilhermeleobas/225/orig 2025-09-07T06:39:15.3006287Z * [new branch] gh/guilhermeleobas/226/base -> origin/gh/guilhermeleobas/226/base 2025-09-07T06:39:15.3006376Z * [new branch] gh/guilhermeleobas/226/head -> origin/gh/guilhermeleobas/226/head 2025-09-07T06:39:15.3006474Z * [new branch] gh/guilhermeleobas/226/orig -> origin/gh/guilhermeleobas/226/orig 2025-09-07T06:39:15.3006568Z * [new branch] gh/guilhermeleobas/227/base -> origin/gh/guilhermeleobas/227/base 2025-09-07T06:39:15.3006659Z * [new branch] gh/guilhermeleobas/227/head -> origin/gh/guilhermeleobas/227/head 2025-09-07T06:39:15.3006750Z * [new branch] gh/guilhermeleobas/227/orig -> origin/gh/guilhermeleobas/227/orig 2025-09-07T06:39:15.3006838Z * [new branch] gh/guilhermeleobas/228/base -> origin/gh/guilhermeleobas/228/base 2025-09-07T06:39:15.3006933Z * [new branch] gh/guilhermeleobas/228/head -> origin/gh/guilhermeleobas/228/head 2025-09-07T06:39:15.3007020Z * [new branch] gh/guilhermeleobas/228/orig -> origin/gh/guilhermeleobas/228/orig 2025-09-07T06:39:15.3007107Z * [new branch] gh/guilhermeleobas/229/base -> origin/gh/guilhermeleobas/229/base 2025-09-07T06:39:15.3007200Z * [new branch] gh/guilhermeleobas/229/head -> origin/gh/guilhermeleobas/229/head 2025-09-07T06:39:15.3007290Z * [new branch] gh/guilhermeleobas/229/orig -> origin/gh/guilhermeleobas/229/orig 2025-09-07T06:39:15.3007379Z * [new branch] gh/guilhermeleobas/230/base -> origin/gh/guilhermeleobas/230/base 2025-09-07T06:39:15.3007467Z * [new branch] gh/guilhermeleobas/230/head -> origin/gh/guilhermeleobas/230/head 2025-09-07T06:39:15.3007554Z * [new branch] gh/guilhermeleobas/230/orig -> origin/gh/guilhermeleobas/230/orig 2025-09-07T06:39:15.3007641Z * [new branch] gh/guilhermeleobas/231/base -> origin/gh/guilhermeleobas/231/base 2025-09-07T06:39:15.3007728Z * [new branch] gh/guilhermeleobas/231/head -> origin/gh/guilhermeleobas/231/head 2025-09-07T06:39:15.3007824Z * [new branch] gh/guilhermeleobas/231/orig -> origin/gh/guilhermeleobas/231/orig 2025-09-07T06:39:15.3007911Z * [new branch] gh/guilhermeleobas/232/base -> origin/gh/guilhermeleobas/232/base 2025-09-07T06:39:15.3008007Z * [new branch] gh/guilhermeleobas/232/head -> origin/gh/guilhermeleobas/232/head 2025-09-07T06:39:15.3008097Z * [new branch] gh/guilhermeleobas/232/orig -> origin/gh/guilhermeleobas/232/orig 2025-09-07T06:39:15.3008228Z * [new branch] gh/guilhermeleobas/233/base -> origin/gh/guilhermeleobas/233/base 2025-09-07T06:39:15.3008412Z * [new branch] gh/guilhermeleobas/233/head -> origin/gh/guilhermeleobas/233/head 2025-09-07T06:39:15.3008500Z * [new branch] gh/guilhermeleobas/233/orig -> origin/gh/guilhermeleobas/233/orig 2025-09-07T06:39:15.3008588Z * [new branch] gh/guilhermeleobas/234/base -> origin/gh/guilhermeleobas/234/base 2025-09-07T06:39:15.3008676Z * [new branch] gh/guilhermeleobas/234/head -> origin/gh/guilhermeleobas/234/head 2025-09-07T06:39:15.3008767Z * [new branch] gh/guilhermeleobas/234/orig -> origin/gh/guilhermeleobas/234/orig 2025-09-07T06:39:15.3008887Z * [new branch] gh/guilhermeleobas/235/base -> origin/gh/guilhermeleobas/235/base 2025-09-07T06:39:15.3008974Z * [new branch] gh/guilhermeleobas/235/head -> origin/gh/guilhermeleobas/235/head 2025-09-07T06:39:15.3009064Z * [new branch] gh/guilhermeleobas/235/orig -> origin/gh/guilhermeleobas/235/orig 2025-09-07T06:39:15.3009161Z * [new branch] gh/guilhermeleobas/236/base -> origin/gh/guilhermeleobas/236/base 2025-09-07T06:39:15.3009251Z * [new branch] gh/guilhermeleobas/236/head -> origin/gh/guilhermeleobas/236/head 2025-09-07T06:39:15.3009339Z * [new branch] gh/guilhermeleobas/236/orig -> origin/gh/guilhermeleobas/236/orig 2025-09-07T06:39:15.3009433Z * [new branch] gh/guilhermeleobas/237/base -> origin/gh/guilhermeleobas/237/base 2025-09-07T06:39:15.3009520Z * [new branch] gh/guilhermeleobas/237/head -> origin/gh/guilhermeleobas/237/head 2025-09-07T06:39:15.3009612Z * [new branch] gh/guilhermeleobas/237/orig -> origin/gh/guilhermeleobas/237/orig 2025-09-07T06:39:15.3009699Z * [new branch] gh/guilhermeleobas/238/base -> origin/gh/guilhermeleobas/238/base 2025-09-07T06:39:15.3009789Z * [new branch] gh/guilhermeleobas/238/head -> origin/gh/guilhermeleobas/238/head 2025-09-07T06:39:15.3009885Z * [new branch] gh/guilhermeleobas/238/orig -> origin/gh/guilhermeleobas/238/orig 2025-09-07T06:39:15.3009981Z * [new branch] gh/guilhermeleobas/239/base -> origin/gh/guilhermeleobas/239/base 2025-09-07T06:39:15.3010075Z * [new branch] gh/guilhermeleobas/239/head -> origin/gh/guilhermeleobas/239/head 2025-09-07T06:39:15.3010164Z * [new branch] gh/guilhermeleobas/239/orig -> origin/gh/guilhermeleobas/239/orig 2025-09-07T06:39:15.3010251Z * [new branch] gh/guilhermeleobas/240/base -> origin/gh/guilhermeleobas/240/base 2025-09-07T06:39:15.3010340Z * [new branch] gh/guilhermeleobas/240/head -> origin/gh/guilhermeleobas/240/head 2025-09-07T06:39:15.3010427Z * [new branch] gh/guilhermeleobas/240/orig -> origin/gh/guilhermeleobas/240/orig 2025-09-07T06:39:15.3010517Z * [new branch] gh/guilhermeleobas/241/base -> origin/gh/guilhermeleobas/241/base 2025-09-07T06:39:15.3010606Z * [new branch] gh/guilhermeleobas/241/head -> origin/gh/guilhermeleobas/241/head 2025-09-07T06:39:15.3010693Z * [new branch] gh/guilhermeleobas/241/orig -> origin/gh/guilhermeleobas/241/orig 2025-09-07T06:39:15.3010783Z * [new branch] gh/guilhermeleobas/242/base -> origin/gh/guilhermeleobas/242/base 2025-09-07T06:39:15.3010870Z * [new branch] gh/guilhermeleobas/242/head -> origin/gh/guilhermeleobas/242/head 2025-09-07T06:39:15.3010963Z * [new branch] gh/guilhermeleobas/242/orig -> origin/gh/guilhermeleobas/242/orig 2025-09-07T06:39:15.3011052Z * [new branch] gh/guilhermeleobas/243/base -> origin/gh/guilhermeleobas/243/base 2025-09-07T06:39:15.3011142Z * [new branch] gh/guilhermeleobas/243/head -> origin/gh/guilhermeleobas/243/head 2025-09-07T06:39:15.3011237Z * [new branch] gh/guilhermeleobas/243/orig -> origin/gh/guilhermeleobas/243/orig 2025-09-07T06:39:15.3011357Z * [new branch] gh/guilhermeleobas/244/base -> origin/gh/guilhermeleobas/244/base 2025-09-07T06:39:15.3011454Z * [new branch] gh/guilhermeleobas/244/head -> origin/gh/guilhermeleobas/244/head 2025-09-07T06:39:15.3011544Z * [new branch] gh/guilhermeleobas/244/orig -> origin/gh/guilhermeleobas/244/orig 2025-09-07T06:39:15.3011635Z * [new branch] gh/guilhermeleobas/245/base -> origin/gh/guilhermeleobas/245/base 2025-09-07T06:39:15.3011725Z * [new branch] gh/guilhermeleobas/245/head -> origin/gh/guilhermeleobas/245/head 2025-09-07T06:39:15.3011812Z * [new branch] gh/guilhermeleobas/245/orig -> origin/gh/guilhermeleobas/245/orig 2025-09-07T06:39:15.3011932Z * [new branch] gh/guilhermeleobas/73/base -> origin/gh/guilhermeleobas/73/base 2025-09-07T06:39:15.3012021Z * [new branch] gh/guilhermeleobas/73/head -> origin/gh/guilhermeleobas/73/head 2025-09-07T06:39:15.3012109Z * [new branch] gh/guilhermeleobas/73/orig -> origin/gh/guilhermeleobas/73/orig 2025-09-07T06:39:15.3012197Z * [new branch] gh/henrylhtsang/140/base -> origin/gh/henrylhtsang/140/base 2025-09-07T06:39:15.3012282Z * [new branch] gh/henrylhtsang/140/head -> origin/gh/henrylhtsang/140/head 2025-09-07T06:39:15.3012368Z * [new branch] gh/henrylhtsang/140/orig -> origin/gh/henrylhtsang/140/orig 2025-09-07T06:39:15.3012450Z * [new branch] gh/henrylhtsang/141/base -> origin/gh/henrylhtsang/141/base 2025-09-07T06:39:15.3012532Z * [new branch] gh/henrylhtsang/141/head -> origin/gh/henrylhtsang/141/head 2025-09-07T06:39:15.3012615Z * [new branch] gh/henrylhtsang/141/orig -> origin/gh/henrylhtsang/141/orig 2025-09-07T06:39:15.3012704Z * [new branch] gh/henrylhtsang/142/base -> origin/gh/henrylhtsang/142/base 2025-09-07T06:39:15.3012786Z * [new branch] gh/henrylhtsang/142/head -> origin/gh/henrylhtsang/142/head 2025-09-07T06:39:15.3012868Z * [new branch] gh/henrylhtsang/142/orig -> origin/gh/henrylhtsang/142/orig 2025-09-07T06:39:15.3012957Z * [new branch] gh/henrylhtsang/143/base -> origin/gh/henrylhtsang/143/base 2025-09-07T06:39:15.3013042Z * [new branch] gh/henrylhtsang/143/head -> origin/gh/henrylhtsang/143/head 2025-09-07T06:39:15.3013212Z * [new branch] gh/henrylhtsang/143/orig -> origin/gh/henrylhtsang/143/orig 2025-09-07T06:39:15.3013295Z * [new branch] gh/henrylhtsang/144/base -> origin/gh/henrylhtsang/144/base 2025-09-07T06:39:15.3013383Z * [new branch] gh/henrylhtsang/144/head -> origin/gh/henrylhtsang/144/head 2025-09-07T06:39:15.3013465Z * [new branch] gh/henrylhtsang/144/orig -> origin/gh/henrylhtsang/144/orig 2025-09-07T06:39:15.3013546Z * [new branch] gh/henrylhtsang/145/base -> origin/gh/henrylhtsang/145/base 2025-09-07T06:39:15.3013629Z * [new branch] gh/henrylhtsang/145/head -> origin/gh/henrylhtsang/145/head 2025-09-07T06:39:15.3013710Z * [new branch] gh/henrylhtsang/145/orig -> origin/gh/henrylhtsang/145/orig 2025-09-07T06:39:15.3013791Z * [new branch] gh/henrylhtsang/146/base -> origin/gh/henrylhtsang/146/base 2025-09-07T06:39:15.3013875Z * [new branch] gh/henrylhtsang/146/head -> origin/gh/henrylhtsang/146/head 2025-09-07T06:39:15.3013956Z * [new branch] gh/henrylhtsang/146/orig -> origin/gh/henrylhtsang/146/orig 2025-09-07T06:39:15.3014041Z * [new branch] gh/henrylhtsang/147/base -> origin/gh/henrylhtsang/147/base 2025-09-07T06:39:15.3014124Z * [new branch] gh/henrylhtsang/147/head -> origin/gh/henrylhtsang/147/head 2025-09-07T06:39:15.3014205Z * [new branch] gh/henrylhtsang/147/orig -> origin/gh/henrylhtsang/147/orig 2025-09-07T06:39:15.3014337Z * [new branch] gh/henrylhtsang/148/base -> origin/gh/henrylhtsang/148/base 2025-09-07T06:39:15.3014419Z * [new branch] gh/henrylhtsang/148/head -> origin/gh/henrylhtsang/148/head 2025-09-07T06:39:15.3014500Z * [new branch] gh/henrylhtsang/148/orig -> origin/gh/henrylhtsang/148/orig 2025-09-07T06:39:15.3014581Z * [new branch] gh/henrylhtsang/149/base -> origin/gh/henrylhtsang/149/base 2025-09-07T06:39:15.3014663Z * [new branch] gh/henrylhtsang/149/head -> origin/gh/henrylhtsang/149/head 2025-09-07T06:39:15.3014744Z * [new branch] gh/henrylhtsang/149/orig -> origin/gh/henrylhtsang/149/orig 2025-09-07T06:39:15.3014822Z * [new branch] gh/huydhn/1/next -> origin/gh/huydhn/1/next 2025-09-07T06:39:15.3014930Z * [new branch] gh/huydhn/2/next -> origin/gh/huydhn/2/next 2025-09-07T06:39:15.3015003Z * [new branch] gh/huydhn/3/next -> origin/gh/huydhn/3/next 2025-09-07T06:39:15.3015075Z * [new branch] gh/huydhn/4/next -> origin/gh/huydhn/4/next 2025-09-07T06:39:15.3015153Z * [new branch] gh/huydhn/5/next -> origin/gh/huydhn/5/next 2025-09-07T06:39:15.3015226Z * [new branch] gh/huydhn/6/next -> origin/gh/huydhn/6/next 2025-09-07T06:39:15.3015297Z * [new branch] gh/int3/97/base -> origin/gh/int3/97/base 2025-09-07T06:39:15.3016899Z * [new branch] gh/int3/97/head -> origin/gh/int3/97/head 2025-09-07T06:39:15.3017000Z * [new branch] gh/isuruf/101/base -> origin/gh/isuruf/101/base 2025-09-07T06:39:15.3017079Z * [new branch] gh/isuruf/101/head -> origin/gh/isuruf/101/head 2025-09-07T06:39:15.3017161Z * [new branch] gh/isuruf/141/base -> origin/gh/isuruf/141/base 2025-09-07T06:39:15.3017236Z * [new branch] gh/isuruf/141/head -> origin/gh/isuruf/141/head 2025-09-07T06:39:15.3017315Z * [new branch] gh/isuruf/141/orig -> origin/gh/isuruf/141/orig 2025-09-07T06:39:15.3017386Z * [new branch] gh/isuruf/142/base -> origin/gh/isuruf/142/base 2025-09-07T06:39:15.3017458Z * [new branch] gh/isuruf/142/head -> origin/gh/isuruf/142/head 2025-09-07T06:39:15.3017536Z * [new branch] gh/isuruf/142/orig -> origin/gh/isuruf/142/orig 2025-09-07T06:39:15.3017608Z * [new branch] gh/isuruf/143/base -> origin/gh/isuruf/143/base 2025-09-07T06:39:15.3017679Z * [new branch] gh/isuruf/143/head -> origin/gh/isuruf/143/head 2025-09-07T06:39:15.3017751Z * [new branch] gh/isuruf/143/orig -> origin/gh/isuruf/143/orig 2025-09-07T06:39:15.3017827Z * [new branch] gh/isuruf/144/base -> origin/gh/isuruf/144/base 2025-09-07T06:39:15.3017902Z * [new branch] gh/isuruf/144/head -> origin/gh/isuruf/144/head 2025-09-07T06:39:15.3017975Z * [new branch] gh/isuruf/144/orig -> origin/gh/isuruf/144/orig 2025-09-07T06:39:15.3018047Z * [new branch] gh/isuruf/145/base -> origin/gh/isuruf/145/base 2025-09-07T06:39:15.3018118Z * [new branch] gh/isuruf/145/head -> origin/gh/isuruf/145/head 2025-09-07T06:39:15.3018189Z * [new branch] gh/isuruf/145/orig -> origin/gh/isuruf/145/orig 2025-09-07T06:39:15.3018267Z * [new branch] gh/isuruf/146/base -> origin/gh/isuruf/146/base 2025-09-07T06:39:15.3018345Z * [new branch] gh/isuruf/146/head -> origin/gh/isuruf/146/head 2025-09-07T06:39:15.3018419Z * [new branch] gh/isuruf/146/orig -> origin/gh/isuruf/146/orig 2025-09-07T06:39:15.3018494Z * [new branch] gh/isuruf/81/base -> origin/gh/isuruf/81/base 2025-09-07T06:39:15.3018566Z * [new branch] gh/isuruf/81/head -> origin/gh/isuruf/81/head 2025-09-07T06:39:15.3018682Z * [new branch] gh/isuruf/81/orig -> origin/gh/isuruf/81/orig 2025-09-07T06:39:15.3018768Z * [new branch] gh/jamesjwu/150/base -> origin/gh/jamesjwu/150/base 2025-09-07T06:39:15.3018845Z * [new branch] gh/jamesjwu/150/head -> origin/gh/jamesjwu/150/head 2025-09-07T06:39:15.3018920Z * [new branch] gh/jamesjwu/150/orig -> origin/gh/jamesjwu/150/orig 2025-09-07T06:39:15.3018995Z * [new branch] gh/jamesjwu/154/base -> origin/gh/jamesjwu/154/base 2025-09-07T06:39:15.3019068Z * [new branch] gh/jamesjwu/154/head -> origin/gh/jamesjwu/154/head 2025-09-07T06:39:15.3019177Z * [new branch] gh/jamesjwu/154/orig -> origin/gh/jamesjwu/154/orig 2025-09-07T06:39:15.3019252Z * [new branch] gh/jamesjwu/155/base -> origin/gh/jamesjwu/155/base 2025-09-07T06:39:15.3019327Z * [new branch] gh/jamesjwu/155/head -> origin/gh/jamesjwu/155/head 2025-09-07T06:39:15.3019403Z * [new branch] gh/jamesjwu/155/orig -> origin/gh/jamesjwu/155/orig 2025-09-07T06:39:15.3020793Z * [new branch] gh/jamesjwu/159/base -> origin/gh/jamesjwu/159/base 2025-09-07T06:39:15.3020883Z * [new branch] gh/jamesjwu/159/head -> origin/gh/jamesjwu/159/head 2025-09-07T06:39:15.3020959Z * [new branch] gh/jamesjwu/159/orig -> origin/gh/jamesjwu/159/orig 2025-09-07T06:39:15.3021034Z * [new branch] gh/jamesjwu/163/base -> origin/gh/jamesjwu/163/base 2025-09-07T06:39:15.3021112Z * [new branch] gh/jamesjwu/163/head -> origin/gh/jamesjwu/163/head 2025-09-07T06:39:15.3021191Z * [new branch] gh/jamesjwu/163/orig -> origin/gh/jamesjwu/163/orig 2025-09-07T06:39:15.3021270Z * [new branch] gh/jamesjwu/171/base -> origin/gh/jamesjwu/171/base 2025-09-07T06:39:15.3021344Z * [new branch] gh/jamesjwu/171/head -> origin/gh/jamesjwu/171/head 2025-09-07T06:39:15.3021421Z * [new branch] gh/jamesjwu/171/orig -> origin/gh/jamesjwu/171/orig 2025-09-07T06:39:15.3021495Z * [new branch] gh/jamesjwu/176/base -> origin/gh/jamesjwu/176/base 2025-09-07T06:39:15.3021570Z * [new branch] gh/jamesjwu/176/head -> origin/gh/jamesjwu/176/head 2025-09-07T06:39:15.3021651Z * [new branch] gh/jamesjwu/176/orig -> origin/gh/jamesjwu/176/orig 2025-09-07T06:39:15.3021725Z * [new branch] gh/jamesjwu/181/base -> origin/gh/jamesjwu/181/base 2025-09-07T06:39:15.3021798Z * [new branch] gh/jamesjwu/181/head -> origin/gh/jamesjwu/181/head 2025-09-07T06:39:15.3021874Z * [new branch] gh/jamesjwu/181/orig -> origin/gh/jamesjwu/181/orig 2025-09-07T06:39:15.3021948Z * [new branch] gh/jamesjwu/182/base -> origin/gh/jamesjwu/182/base 2025-09-07T06:39:15.3022022Z * [new branch] gh/jamesjwu/182/head -> origin/gh/jamesjwu/182/head 2025-09-07T06:39:15.3022096Z * [new branch] gh/jamesjwu/182/orig -> origin/gh/jamesjwu/182/orig 2025-09-07T06:39:15.3022173Z * [new branch] gh/jamesjwu/183/base -> origin/gh/jamesjwu/183/base 2025-09-07T06:39:15.3022247Z * [new branch] gh/jamesjwu/183/head -> origin/gh/jamesjwu/183/head 2025-09-07T06:39:15.3022320Z * [new branch] gh/jamesjwu/183/orig -> origin/gh/jamesjwu/183/orig 2025-09-07T06:39:15.3022394Z * [new branch] gh/jamesjwu/184/base -> origin/gh/jamesjwu/184/base 2025-09-07T06:39:15.3022467Z * [new branch] gh/jamesjwu/184/head -> origin/gh/jamesjwu/184/head 2025-09-07T06:39:15.3022542Z * [new branch] gh/jamesjwu/184/orig -> origin/gh/jamesjwu/184/orig 2025-09-07T06:39:15.3024008Z * [new branch] gh/jamesjwu/185/base -> origin/gh/jamesjwu/185/base 2025-09-07T06:39:15.3024151Z * [new branch] gh/jamesjwu/185/head -> origin/gh/jamesjwu/185/head 2025-09-07T06:39:15.3024227Z * [new branch] gh/jamesjwu/185/orig -> origin/gh/jamesjwu/185/orig 2025-09-07T06:39:15.3024301Z * [new branch] gh/jamesjwu/186/base -> origin/gh/jamesjwu/186/base 2025-09-07T06:39:15.3024375Z * [new branch] gh/jamesjwu/186/head -> origin/gh/jamesjwu/186/head 2025-09-07T06:39:15.3024448Z * [new branch] gh/jamesjwu/186/orig -> origin/gh/jamesjwu/186/orig 2025-09-07T06:39:15.3024524Z * [new branch] gh/jamesjwu/187/base -> origin/gh/jamesjwu/187/base 2025-09-07T06:39:15.3024638Z * [new branch] gh/jamesjwu/187/head -> origin/gh/jamesjwu/187/head 2025-09-07T06:39:15.3024712Z * [new branch] gh/jamesjwu/187/orig -> origin/gh/jamesjwu/187/orig 2025-09-07T06:39:15.3024786Z * [new branch] gh/jamesjwu/188/base -> origin/gh/jamesjwu/188/base 2025-09-07T06:39:15.3024862Z * [new branch] gh/jamesjwu/188/head -> origin/gh/jamesjwu/188/head 2025-09-07T06:39:15.3024935Z * [new branch] gh/jamesjwu/188/orig -> origin/gh/jamesjwu/188/orig 2025-09-07T06:39:15.3025009Z * [new branch] gh/jamesjwu/189/base -> origin/gh/jamesjwu/189/base 2025-09-07T06:39:15.3025084Z * [new branch] gh/jamesjwu/189/head -> origin/gh/jamesjwu/189/head 2025-09-07T06:39:15.3025158Z * [new branch] gh/jamesjwu/189/orig -> origin/gh/jamesjwu/189/orig 2025-09-07T06:39:15.3025232Z * [new branch] gh/jamesjwu/190/base -> origin/gh/jamesjwu/190/base 2025-09-07T06:39:15.3025308Z * [new branch] gh/jamesjwu/190/head -> origin/gh/jamesjwu/190/head 2025-09-07T06:39:15.3025382Z * [new branch] gh/jamesjwu/190/orig -> origin/gh/jamesjwu/190/orig 2025-09-07T06:39:15.3025468Z * [new branch] gh/jamesjwu/52/base -> origin/gh/jamesjwu/52/base 2025-09-07T06:39:15.3025543Z * [new branch] gh/jamesjwu/52/head -> origin/gh/jamesjwu/52/head 2025-09-07T06:39:15.3025624Z * [new branch] gh/jamesjwu/53/base -> origin/gh/jamesjwu/53/base 2025-09-07T06:39:15.3025697Z * [new branch] gh/jamesjwu/53/head -> origin/gh/jamesjwu/53/head 2025-09-07T06:39:15.3025772Z * [new branch] gh/jamesjwu/54/base -> origin/gh/jamesjwu/54/base 2025-09-07T06:39:15.3027125Z * [new branch] gh/jamesjwu/54/head -> origin/gh/jamesjwu/54/head 2025-09-07T06:39:15.3027219Z * [new branch] gh/jamesjwu/55/base -> origin/gh/jamesjwu/55/base 2025-09-07T06:39:15.3027310Z * [new branch] gh/jamesjwu/55/head -> origin/gh/jamesjwu/55/head 2025-09-07T06:39:15.3027391Z * [new branch] gh/jamesjwu/56/base -> origin/gh/jamesjwu/56/base 2025-09-07T06:39:15.3027472Z * [new branch] gh/jamesjwu/56/head -> origin/gh/jamesjwu/56/head 2025-09-07T06:39:15.3027555Z * [new branch] gh/jamesjwu/57/base -> origin/gh/jamesjwu/57/base 2025-09-07T06:39:15.3027627Z * [new branch] gh/jamesjwu/57/head -> origin/gh/jamesjwu/57/head 2025-09-07T06:39:15.3027700Z * [new branch] gh/jamesjwu/58/base -> origin/gh/jamesjwu/58/base 2025-09-07T06:39:15.3027775Z * [new branch] gh/jamesjwu/58/head -> origin/gh/jamesjwu/58/head 2025-09-07T06:39:15.3027848Z * [new branch] gh/jamesjwu/59/base -> origin/gh/jamesjwu/59/base 2025-09-07T06:39:15.3027921Z * [new branch] gh/jamesjwu/59/head -> origin/gh/jamesjwu/59/head 2025-09-07T06:39:15.3028001Z * [new branch] gh/jamesjwu/60/base -> origin/gh/jamesjwu/60/base 2025-09-07T06:39:15.3028073Z * [new branch] gh/jamesjwu/60/head -> origin/gh/jamesjwu/60/head 2025-09-07T06:39:15.3028192Z * [new branch] gh/jamesjwu/61/base -> origin/gh/jamesjwu/61/base 2025-09-07T06:39:15.3028265Z * [new branch] gh/jamesjwu/61/head -> origin/gh/jamesjwu/61/head 2025-09-07T06:39:15.3028339Z * [new branch] gh/jamesjwu/62/base -> origin/gh/jamesjwu/62/base 2025-09-07T06:39:15.3028412Z * [new branch] gh/jamesjwu/62/head -> origin/gh/jamesjwu/62/head 2025-09-07T06:39:15.3028484Z * [new branch] gh/jamesjwu/63/base -> origin/gh/jamesjwu/63/base 2025-09-07T06:39:15.3028558Z * [new branch] gh/jamesjwu/63/head -> origin/gh/jamesjwu/63/head 2025-09-07T06:39:15.3028631Z * [new branch] gh/jamesjwu/64/base -> origin/gh/jamesjwu/64/base 2025-09-07T06:39:15.3028739Z * [new branch] gh/jamesjwu/64/head -> origin/gh/jamesjwu/64/head 2025-09-07T06:39:15.3028813Z * [new branch] gh/jamesjwu/65/base -> origin/gh/jamesjwu/65/base 2025-09-07T06:39:15.3028887Z * [new branch] gh/jamesjwu/65/head -> origin/gh/jamesjwu/65/head 2025-09-07T06:39:15.3028962Z * [new branch] gh/janeyx99/165/base -> origin/gh/janeyx99/165/base 2025-09-07T06:39:15.3029042Z * [new branch] gh/janeyx99/165/head -> origin/gh/janeyx99/165/head 2025-09-07T06:39:15.3029116Z * [new branch] gh/janeyx99/165/orig -> origin/gh/janeyx99/165/orig 2025-09-07T06:39:15.3029189Z * [new branch] gh/janeyx99/201/base -> origin/gh/janeyx99/201/base 2025-09-07T06:39:15.3029264Z * [new branch] gh/janeyx99/201/head -> origin/gh/janeyx99/201/head 2025-09-07T06:39:15.3029345Z * [new branch] gh/janeyx99/201/orig -> origin/gh/janeyx99/201/orig 2025-09-07T06:39:15.3029419Z * [new branch] gh/janeyx99/225/base -> origin/gh/janeyx99/225/base 2025-09-07T06:39:15.3029494Z * [new branch] gh/janeyx99/225/head -> origin/gh/janeyx99/225/head 2025-09-07T06:39:15.3029573Z * [new branch] gh/janeyx99/225/orig -> origin/gh/janeyx99/225/orig 2025-09-07T06:39:15.3030847Z * [new branch] gh/janeyx99/296/base -> origin/gh/janeyx99/296/base 2025-09-07T06:39:15.3030933Z * [new branch] gh/janeyx99/296/head -> origin/gh/janeyx99/296/head 2025-09-07T06:39:15.3031010Z * [new branch] gh/janeyx99/296/orig -> origin/gh/janeyx99/296/orig 2025-09-07T06:39:15.3031083Z * [new branch] gh/janeyx99/297/base -> origin/gh/janeyx99/297/base 2025-09-07T06:39:15.3031156Z * [new branch] gh/janeyx99/297/head -> origin/gh/janeyx99/297/head 2025-09-07T06:39:15.3031232Z * [new branch] gh/janeyx99/297/orig -> origin/gh/janeyx99/297/orig 2025-09-07T06:39:15.3031309Z * [new branch] gh/janeyx99/298/base -> origin/gh/janeyx99/298/base 2025-09-07T06:39:15.3031383Z * [new branch] gh/janeyx99/298/head -> origin/gh/janeyx99/298/head 2025-09-07T06:39:15.3031456Z * [new branch] gh/janeyx99/298/orig -> origin/gh/janeyx99/298/orig 2025-09-07T06:39:15.3031530Z * [new branch] gh/janeyx99/299/base -> origin/gh/janeyx99/299/base 2025-09-07T06:39:15.3031602Z * [new branch] gh/janeyx99/299/head -> origin/gh/janeyx99/299/head 2025-09-07T06:39:15.3031677Z * [new branch] gh/janeyx99/299/orig -> origin/gh/janeyx99/299/orig 2025-09-07T06:39:15.3031755Z * [new branch] gh/janeyx99/300/base -> origin/gh/janeyx99/300/base 2025-09-07T06:39:15.3031827Z * [new branch] gh/janeyx99/300/head -> origin/gh/janeyx99/300/head 2025-09-07T06:39:15.3031902Z * [new branch] gh/janeyx99/300/orig -> origin/gh/janeyx99/300/orig 2025-09-07T06:39:15.3031976Z * [new branch] gh/janeyx99/301/base -> origin/gh/janeyx99/301/base 2025-09-07T06:39:15.3032084Z * [new branch] gh/janeyx99/301/head -> origin/gh/janeyx99/301/head 2025-09-07T06:39:15.3032157Z * [new branch] gh/janeyx99/301/orig -> origin/gh/janeyx99/301/orig 2025-09-07T06:39:15.3032235Z * [new branch] gh/janeyx99/302/base -> origin/gh/janeyx99/302/base 2025-09-07T06:39:15.3032307Z * [new branch] gh/janeyx99/302/head -> origin/gh/janeyx99/302/head 2025-09-07T06:39:15.3032380Z * [new branch] gh/janeyx99/303/base -> origin/gh/janeyx99/303/base 2025-09-07T06:39:15.3032454Z * [new branch] gh/janeyx99/303/head -> origin/gh/janeyx99/303/head 2025-09-07T06:39:15.3032528Z * [new branch] gh/janeyx99/88/base -> origin/gh/janeyx99/88/base 2025-09-07T06:39:15.3032630Z * [new branch] gh/janeyx99/88/head -> origin/gh/janeyx99/88/head 2025-09-07T06:39:15.3034069Z * [new branch] gh/janeyx99/88/orig -> origin/gh/janeyx99/88/orig 2025-09-07T06:39:15.3034154Z * [new branch] gh/jansel/360/base -> origin/gh/jansel/360/base 2025-09-07T06:39:15.3034227Z * [new branch] gh/jansel/360/head -> origin/gh/jansel/360/head 2025-09-07T06:39:15.3034299Z * [new branch] gh/jansel/451/base -> origin/gh/jansel/451/base 2025-09-07T06:39:15.3034371Z * [new branch] gh/jansel/451/head -> origin/gh/jansel/451/head 2025-09-07T06:39:15.3034442Z * [new branch] gh/jansel/451/orig -> origin/gh/jansel/451/orig 2025-09-07T06:39:15.3034514Z * [new branch] gh/jansel/462/base -> origin/gh/jansel/462/base 2025-09-07T06:39:15.3034591Z * [new branch] gh/jansel/462/head -> origin/gh/jansel/462/head 2025-09-07T06:39:15.3034661Z * [new branch] gh/jansel/462/orig -> origin/gh/jansel/462/orig 2025-09-07T06:39:15.3034734Z * [new branch] gh/jansel/531/base -> origin/gh/jansel/531/base 2025-09-07T06:39:15.3034807Z * [new branch] gh/jansel/531/head -> origin/gh/jansel/531/head 2025-09-07T06:39:15.3034878Z * [new branch] gh/jansel/531/orig -> origin/gh/jansel/531/orig 2025-09-07T06:39:15.3034964Z * [new branch] gh/jbschlosser/208/head -> origin/gh/jbschlosser/208/head 2025-09-07T06:39:15.3035055Z * [new branch] gh/jbschlosser/247/base -> origin/gh/jbschlosser/247/base 2025-09-07T06:39:15.3035143Z * [new branch] gh/jbschlosser/247/head -> origin/gh/jbschlosser/247/head 2025-09-07T06:39:15.3035222Z * [new branch] gh/jbschlosser/247/orig -> origin/gh/jbschlosser/247/orig 2025-09-07T06:39:15.3035305Z * [new branch] gh/jbschlosser/248/base -> origin/gh/jbschlosser/248/base 2025-09-07T06:39:15.3035383Z * [new branch] gh/jbschlosser/248/head -> origin/gh/jbschlosser/248/head 2025-09-07T06:39:15.3035463Z * [new branch] gh/jbschlosser/248/orig -> origin/gh/jbschlosser/248/orig 2025-09-07T06:39:15.3035547Z * [new branch] gh/jbschlosser/250/base -> origin/gh/jbschlosser/250/base 2025-09-07T06:39:15.3035625Z * [new branch] gh/jbschlosser/250/head -> origin/gh/jbschlosser/250/head 2025-09-07T06:39:15.3035704Z * [new branch] gh/jbschlosser/250/orig -> origin/gh/jbschlosser/250/orig 2025-09-07T06:39:15.3035781Z * [new branch] gh/jiayisunx/59/base -> origin/gh/jiayisunx/59/base 2025-09-07T06:39:15.3037125Z * [new branch] gh/jiayisunx/59/head -> origin/gh/jiayisunx/59/head 2025-09-07T06:39:15.3037218Z * [new branch] gh/jiayisunx/59/orig -> origin/gh/jiayisunx/59/orig 2025-09-07T06:39:15.3037297Z * [new branch] gh/jiayisunx/61/base -> origin/gh/jiayisunx/61/base 2025-09-07T06:39:15.3037379Z * [new branch] gh/jiayisunx/61/head -> origin/gh/jiayisunx/61/head 2025-09-07T06:39:15.3037507Z * [new branch] gh/jiayisunx/61/orig -> origin/gh/jiayisunx/61/orig 2025-09-07T06:39:15.3037582Z * [new branch] gh/jiayisunx/64/base -> origin/gh/jiayisunx/64/base 2025-09-07T06:39:15.3037656Z * [new branch] gh/jiayisunx/64/head -> origin/gh/jiayisunx/64/head 2025-09-07T06:39:15.3037730Z * [new branch] gh/jiayisunx/64/orig -> origin/gh/jiayisunx/64/orig 2025-09-07T06:39:15.3037804Z * [new branch] gh/jiayisunx/65/base -> origin/gh/jiayisunx/65/base 2025-09-07T06:39:15.3037877Z * [new branch] gh/jiayisunx/65/head -> origin/gh/jiayisunx/65/head 2025-09-07T06:39:15.3037954Z * [new branch] gh/jiayisunx/65/orig -> origin/gh/jiayisunx/65/orig 2025-09-07T06:39:15.3038078Z * [new branch] gh/jiayisunx/66/base -> origin/gh/jiayisunx/66/base 2025-09-07T06:39:15.3038151Z * [new branch] gh/jiayisunx/66/head -> origin/gh/jiayisunx/66/head 2025-09-07T06:39:15.3038225Z * [new branch] gh/jiayisunx/66/orig -> origin/gh/jiayisunx/66/orig 2025-09-07T06:39:15.3038300Z * [new branch] gh/jiayisunx/67/base -> origin/gh/jiayisunx/67/base 2025-09-07T06:39:15.3038373Z * [new branch] gh/jiayisunx/67/head -> origin/gh/jiayisunx/67/head 2025-09-07T06:39:15.3038447Z * [new branch] gh/jiayisunx/67/orig -> origin/gh/jiayisunx/67/orig 2025-09-07T06:39:15.3038522Z * [new branch] gh/jiayisunx/68/base -> origin/gh/jiayisunx/68/base 2025-09-07T06:39:15.3038596Z * [new branch] gh/jiayisunx/68/head -> origin/gh/jiayisunx/68/head 2025-09-07T06:39:15.3038670Z * [new branch] gh/jiayisunx/68/orig -> origin/gh/jiayisunx/68/orig 2025-09-07T06:39:15.3038748Z * [new branch] gh/jiayisunx/69/base -> origin/gh/jiayisunx/69/base 2025-09-07T06:39:15.3038823Z * [new branch] gh/jiayisunx/69/head -> origin/gh/jiayisunx/69/head 2025-09-07T06:39:15.3038898Z * [new branch] gh/jiayisunx/69/orig -> origin/gh/jiayisunx/69/orig 2025-09-07T06:39:15.3038972Z * [new branch] gh/jiayisunx/70/base -> origin/gh/jiayisunx/70/base 2025-09-07T06:39:15.3040325Z * [new branch] gh/jiayisunx/70/head -> origin/gh/jiayisunx/70/head 2025-09-07T06:39:15.3040417Z * [new branch] gh/jiayisunx/70/orig -> origin/gh/jiayisunx/70/orig 2025-09-07T06:39:15.3040496Z * [new branch] gh/jiayisunx/71/base -> origin/gh/jiayisunx/71/base 2025-09-07T06:39:15.3040571Z * [new branch] gh/jiayisunx/71/head -> origin/gh/jiayisunx/71/head 2025-09-07T06:39:15.3040651Z * [new branch] gh/jiayisunx/71/orig -> origin/gh/jiayisunx/71/orig 2025-09-07T06:39:15.3040724Z * [new branch] gh/jiayisunx/72/base -> origin/gh/jiayisunx/72/base 2025-09-07T06:39:15.3040800Z * [new branch] gh/jiayisunx/72/head -> origin/gh/jiayisunx/72/head 2025-09-07T06:39:15.3040874Z * [new branch] gh/jiayisunx/72/orig -> origin/gh/jiayisunx/72/orig 2025-09-07T06:39:15.3040948Z * [new branch] gh/jiayisunx/73/base -> origin/gh/jiayisunx/73/base 2025-09-07T06:39:15.3041031Z * [new branch] gh/jiayisunx/73/head -> origin/gh/jiayisunx/73/head 2025-09-07T06:39:15.3041105Z * [new branch] gh/jiayisunx/73/orig -> origin/gh/jiayisunx/73/orig 2025-09-07T06:39:15.3041186Z * [new branch] gh/jiayisunx/74/base -> origin/gh/jiayisunx/74/base 2025-09-07T06:39:15.3041259Z * [new branch] gh/jiayisunx/74/head -> origin/gh/jiayisunx/74/head 2025-09-07T06:39:15.3041337Z * [new branch] gh/jiayisunx/74/orig -> origin/gh/jiayisunx/74/orig 2025-09-07T06:39:15.3041410Z * [new branch] gh/jiayisunx/75/base -> origin/gh/jiayisunx/75/base 2025-09-07T06:39:15.3041518Z * [new branch] gh/jiayisunx/75/head -> origin/gh/jiayisunx/75/head 2025-09-07T06:39:15.3041593Z * [new branch] gh/jiayisunx/75/orig -> origin/gh/jiayisunx/75/orig 2025-09-07T06:39:15.3041667Z * [new branch] gh/jiayisunx/76/base -> origin/gh/jiayisunx/76/base 2025-09-07T06:39:15.3041740Z * [new branch] gh/jiayisunx/76/head -> origin/gh/jiayisunx/76/head 2025-09-07T06:39:15.3041814Z * [new branch] gh/jiayisunx/76/orig -> origin/gh/jiayisunx/76/orig 2025-09-07T06:39:15.3041896Z * [new branch] gh/jjwu@meta.com/1/base -> origin/gh/jjwu@meta.com/1/base 2025-09-07T06:39:15.3041973Z * [new branch] gh/jjwu@meta.com/1/head -> origin/gh/jjwu@meta.com/1/head 2025-09-07T06:39:15.3042092Z * [new branch] gh/justinchuby/111/base -> origin/gh/justinchuby/111/base 2025-09-07T06:39:15.3042172Z * [new branch] gh/justinchuby/111/head -> origin/gh/justinchuby/111/head 2025-09-07T06:39:15.3042256Z * [new branch] gh/justinchuby/111/orig -> origin/gh/justinchuby/111/orig 2025-09-07T06:39:15.3042344Z * [new branch] gh/justinchuby/112/base -> origin/gh/justinchuby/112/base 2025-09-07T06:39:15.3042423Z * [new branch] gh/justinchuby/112/head -> origin/gh/justinchuby/112/head 2025-09-07T06:39:15.3042501Z * [new branch] gh/justinchuby/112/orig -> origin/gh/justinchuby/112/orig 2025-09-07T06:39:15.3042581Z * [new branch] gh/justinchuby/113/base -> origin/gh/justinchuby/113/base 2025-09-07T06:39:15.3042659Z * [new branch] gh/justinchuby/113/head -> origin/gh/justinchuby/113/head 2025-09-07T06:39:15.3042742Z * [new branch] gh/justinchuby/113/orig -> origin/gh/justinchuby/113/orig 2025-09-07T06:39:15.3042825Z * [new branch] gh/justinchuby/114/base -> origin/gh/justinchuby/114/base 2025-09-07T06:39:15.3042911Z * [new branch] gh/justinchuby/114/head -> origin/gh/justinchuby/114/head 2025-09-07T06:39:15.3042989Z * [new branch] gh/justinchuby/114/orig -> origin/gh/justinchuby/114/orig 2025-09-07T06:39:15.3043172Z * [new branch] gh/justinchuby/115/base -> origin/gh/justinchuby/115/base 2025-09-07T06:39:15.3043253Z * [new branch] gh/justinchuby/115/head -> origin/gh/justinchuby/115/head 2025-09-07T06:39:15.3043331Z * [new branch] gh/justinchuby/115/orig -> origin/gh/justinchuby/115/orig 2025-09-07T06:39:15.3044671Z * [new branch] gh/karthickai/1/base -> origin/gh/karthickai/1/base 2025-09-07T06:39:15.3044760Z * [new branch] gh/karthickai/1/head -> origin/gh/karthickai/1/head 2025-09-07T06:39:15.3044840Z * [new branch] gh/karthickai/1/orig -> origin/gh/karthickai/1/orig 2025-09-07T06:39:15.3044915Z * [new branch] gh/karthickai/2/base -> origin/gh/karthickai/2/base 2025-09-07T06:39:15.3044992Z * [new branch] gh/karthickai/2/head -> origin/gh/karthickai/2/head 2025-09-07T06:39:15.3045066Z * [new branch] gh/karthickai/2/orig -> origin/gh/karthickai/2/orig 2025-09-07T06:39:15.3045149Z * [new branch] gh/kurtamohler/32/base -> origin/gh/kurtamohler/32/base 2025-09-07T06:39:15.3045229Z * [new branch] gh/kurtamohler/32/head -> origin/gh/kurtamohler/32/head 2025-09-07T06:39:15.3045307Z * [new branch] gh/kurtamohler/32/orig -> origin/gh/kurtamohler/32/orig 2025-09-07T06:39:15.3045385Z * [new branch] gh/kurtamohler/33/base -> origin/gh/kurtamohler/33/base 2025-09-07T06:39:15.3045465Z * [new branch] gh/kurtamohler/33/head -> origin/gh/kurtamohler/33/head 2025-09-07T06:39:15.3045543Z * [new branch] gh/kurtamohler/33/orig -> origin/gh/kurtamohler/33/orig 2025-09-07T06:39:15.3045620Z * [new branch] gh/kurtamohler/34/base -> origin/gh/kurtamohler/34/base 2025-09-07T06:39:15.3045752Z * [new branch] gh/kurtamohler/34/head -> origin/gh/kurtamohler/34/head 2025-09-07T06:39:15.3045831Z * [new branch] gh/kurtamohler/34/orig -> origin/gh/kurtamohler/34/orig 2025-09-07T06:39:15.3045908Z * [new branch] gh/kurtamohler/41/base -> origin/gh/kurtamohler/41/base 2025-09-07T06:39:15.3045987Z * [new branch] gh/kurtamohler/41/head -> origin/gh/kurtamohler/41/head 2025-09-07T06:39:15.3046065Z * [new branch] gh/kurtamohler/41/orig -> origin/gh/kurtamohler/41/orig 2025-09-07T06:39:15.3046142Z * [new branch] gh/kurtamohler/46/base -> origin/gh/kurtamohler/46/base 2025-09-07T06:39:15.3046256Z * [new branch] gh/kurtamohler/46/head -> origin/gh/kurtamohler/46/head 2025-09-07T06:39:15.3046334Z * [new branch] gh/kurtamohler/46/orig -> origin/gh/kurtamohler/46/orig 2025-09-07T06:39:15.3046413Z * [new branch] gh/kurtamohler/47/base -> origin/gh/kurtamohler/47/base 2025-09-07T06:39:15.3046492Z * [new branch] gh/kurtamohler/47/head -> origin/gh/kurtamohler/47/head 2025-09-07T06:39:15.3047647Z * [new branch] gh/kurtamohler/47/orig -> origin/gh/kurtamohler/47/orig 2025-09-07T06:39:15.3047732Z * [new branch] gh/kurtamohler/48/base -> origin/gh/kurtamohler/48/base 2025-09-07T06:39:15.3047816Z * [new branch] gh/kurtamohler/48/head -> origin/gh/kurtamohler/48/head 2025-09-07T06:39:15.3047893Z * [new branch] gh/kurtamohler/48/orig -> origin/gh/kurtamohler/48/orig 2025-09-07T06:39:15.3047970Z * [new branch] gh/kurtamohler/49/base -> origin/gh/kurtamohler/49/base 2025-09-07T06:39:15.3048054Z * [new branch] gh/kurtamohler/49/head -> origin/gh/kurtamohler/49/head 2025-09-07T06:39:15.3048132Z * [new branch] gh/kurtamohler/49/orig -> origin/gh/kurtamohler/49/orig 2025-09-07T06:39:15.3048213Z * [new branch] gh/kurtamohler/50/base -> origin/gh/kurtamohler/50/base 2025-09-07T06:39:15.3048352Z * [new branch] gh/kurtamohler/50/head -> origin/gh/kurtamohler/50/head 2025-09-07T06:39:15.3048430Z * [new branch] gh/kurtamohler/50/orig -> origin/gh/kurtamohler/50/orig 2025-09-07T06:39:15.3048505Z * [new branch] gh/kwen2501/130/base -> origin/gh/kwen2501/130/base 2025-09-07T06:39:15.3048580Z * [new branch] gh/kwen2501/130/head -> origin/gh/kwen2501/130/head 2025-09-07T06:39:15.3048653Z * [new branch] gh/kwen2501/130/orig -> origin/gh/kwen2501/130/orig 2025-09-07T06:39:15.3048731Z * [new branch] gh/kwen2501/15/base -> origin/gh/kwen2501/15/base 2025-09-07T06:39:15.3048805Z * [new branch] gh/kwen2501/15/head -> origin/gh/kwen2501/15/head 2025-09-07T06:39:15.3048879Z * [new branch] gh/kwen2501/156/base -> origin/gh/kwen2501/156/base 2025-09-07T06:39:15.3048954Z * [new branch] gh/kwen2501/156/head -> origin/gh/kwen2501/156/head 2025-09-07T06:39:15.3049026Z * [new branch] gh/kwen2501/156/orig -> origin/gh/kwen2501/156/orig 2025-09-07T06:39:15.3049099Z * [new branch] gh/kwen2501/170/base -> origin/gh/kwen2501/170/base 2025-09-07T06:39:15.3049171Z * [new branch] gh/kwen2501/170/head -> origin/gh/kwen2501/170/head 2025-09-07T06:39:15.3049243Z * [new branch] gh/kwen2501/186/base -> origin/gh/kwen2501/186/base 2025-09-07T06:39:15.3049316Z * [new branch] gh/kwen2501/186/head -> origin/gh/kwen2501/186/head 2025-09-07T06:39:15.3049392Z * [new branch] gh/kwen2501/186/orig -> origin/gh/kwen2501/186/orig 2025-09-07T06:39:15.3049464Z * [new branch] gh/kwen2501/187/base -> origin/gh/kwen2501/187/base 2025-09-07T06:39:15.3050536Z * [new branch] gh/kwen2501/187/head -> origin/gh/kwen2501/187/head 2025-09-07T06:39:15.3050613Z * [new branch] gh/kwen2501/187/orig -> origin/gh/kwen2501/187/orig 2025-09-07T06:39:15.3050686Z * [new branch] gh/kwen2501/188/base -> origin/gh/kwen2501/188/base 2025-09-07T06:39:15.3050758Z * [new branch] gh/kwen2501/188/head -> origin/gh/kwen2501/188/head 2025-09-07T06:39:15.3050830Z * [new branch] gh/kwen2501/188/orig -> origin/gh/kwen2501/188/orig 2025-09-07T06:39:15.3050903Z * [new branch] gh/kwen2501/194/base -> origin/gh/kwen2501/194/base 2025-09-07T06:39:15.3050976Z * [new branch] gh/kwen2501/194/head -> origin/gh/kwen2501/194/head 2025-09-07T06:39:15.3051078Z * [new branch] gh/kwen2501/194/orig -> origin/gh/kwen2501/194/orig 2025-09-07T06:39:15.3051150Z * [new branch] gh/kwen2501/199/base -> origin/gh/kwen2501/199/base 2025-09-07T06:39:15.3051228Z * [new branch] gh/kwen2501/199/head -> origin/gh/kwen2501/199/head 2025-09-07T06:39:15.3051300Z * [new branch] gh/kwen2501/199/orig -> origin/gh/kwen2501/199/orig 2025-09-07T06:39:15.3051372Z * [new branch] gh/kwen2501/200/base -> origin/gh/kwen2501/200/base 2025-09-07T06:39:15.3051445Z * [new branch] gh/kwen2501/200/head -> origin/gh/kwen2501/200/head 2025-09-07T06:39:15.3051517Z * [new branch] gh/kwen2501/200/orig -> origin/gh/kwen2501/200/orig 2025-09-07T06:39:15.3051590Z * [new branch] gh/kwen2501/201/base -> origin/gh/kwen2501/201/base 2025-09-07T06:39:15.3051665Z * [new branch] gh/kwen2501/201/head -> origin/gh/kwen2501/201/head 2025-09-07T06:39:15.3051737Z * [new branch] gh/kwen2501/201/orig -> origin/gh/kwen2501/201/orig 2025-09-07T06:39:15.3051809Z * [new branch] gh/kwen2501/203/base -> origin/gh/kwen2501/203/base 2025-09-07T06:39:15.3051884Z * [new branch] gh/kwen2501/203/head -> origin/gh/kwen2501/203/head 2025-09-07T06:39:15.3051957Z * [new branch] gh/kwen2501/203/orig -> origin/gh/kwen2501/203/orig 2025-09-07T06:39:15.3052029Z * [new branch] gh/kwen2501/204/base -> origin/gh/kwen2501/204/base 2025-09-07T06:39:15.3052101Z * [new branch] gh/kwen2501/204/head -> origin/gh/kwen2501/204/head 2025-09-07T06:39:15.3052173Z * [new branch] gh/kwen2501/204/orig -> origin/gh/kwen2501/204/orig 2025-09-07T06:39:15.3052245Z * [new branch] gh/kwen2501/205/base -> origin/gh/kwen2501/205/base 2025-09-07T06:39:15.3053340Z * [new branch] gh/kwen2501/205/head -> origin/gh/kwen2501/205/head 2025-09-07T06:39:15.3053420Z * [new branch] gh/kwen2501/205/orig -> origin/gh/kwen2501/205/orig 2025-09-07T06:39:15.3053492Z * [new branch] gh/kwen2501/206/base -> origin/gh/kwen2501/206/base 2025-09-07T06:39:15.3053567Z * [new branch] gh/kwen2501/206/head -> origin/gh/kwen2501/206/head 2025-09-07T06:39:15.3053639Z * [new branch] gh/kwen2501/206/orig -> origin/gh/kwen2501/206/orig 2025-09-07T06:39:15.3053711Z * [new branch] gh/kwen2501/207/base -> origin/gh/kwen2501/207/base 2025-09-07T06:39:15.3053783Z * [new branch] gh/kwen2501/207/head -> origin/gh/kwen2501/207/head 2025-09-07T06:39:15.3053856Z * [new branch] gh/kwen2501/207/orig -> origin/gh/kwen2501/207/orig 2025-09-07T06:39:15.3053929Z * [new branch] gh/kwen2501/208/base -> origin/gh/kwen2501/208/base 2025-09-07T06:39:15.3054006Z * [new branch] gh/kwen2501/208/head -> origin/gh/kwen2501/208/head 2025-09-07T06:39:15.3054079Z * [new branch] gh/kwen2501/208/orig -> origin/gh/kwen2501/208/orig 2025-09-07T06:39:15.3054204Z * [new branch] gh/kwen2501/209/base -> origin/gh/kwen2501/209/base 2025-09-07T06:39:15.3054277Z * [new branch] gh/kwen2501/209/head -> origin/gh/kwen2501/209/head 2025-09-07T06:39:15.3054349Z * [new branch] gh/kwen2501/209/orig -> origin/gh/kwen2501/209/orig 2025-09-07T06:39:15.3054421Z * [new branch] gh/kwen2501/210/base -> origin/gh/kwen2501/210/base 2025-09-07T06:39:15.3054493Z * [new branch] gh/kwen2501/210/head -> origin/gh/kwen2501/210/head 2025-09-07T06:39:15.3054566Z * [new branch] gh/kwen2501/210/orig -> origin/gh/kwen2501/210/orig 2025-09-07T06:39:15.3054638Z * [new branch] gh/kwen2501/211/base -> origin/gh/kwen2501/211/base 2025-09-07T06:39:15.3054747Z * [new branch] gh/kwen2501/211/head -> origin/gh/kwen2501/211/head 2025-09-07T06:39:15.3054820Z * [new branch] gh/kwen2501/212/base -> origin/gh/kwen2501/212/base 2025-09-07T06:39:15.3054893Z * [new branch] gh/kwen2501/212/head -> origin/gh/kwen2501/212/head 2025-09-07T06:39:15.3054965Z * [new branch] gh/kwen2501/212/orig -> origin/gh/kwen2501/212/orig 2025-09-07T06:39:15.3055038Z * [new branch] gh/kwen2501/213/base -> origin/gh/kwen2501/213/base 2025-09-07T06:39:15.3055110Z * [new branch] gh/kwen2501/213/head -> origin/gh/kwen2501/213/head 2025-09-07T06:39:15.3055183Z * [new branch] gh/kwen2501/213/orig -> origin/gh/kwen2501/213/orig 2025-09-07T06:39:15.3056218Z * [new branch] gh/kwen2501/214/base -> origin/gh/kwen2501/214/base 2025-09-07T06:39:15.3056300Z * [new branch] gh/kwen2501/214/head -> origin/gh/kwen2501/214/head 2025-09-07T06:39:15.3056373Z * [new branch] gh/kwen2501/214/orig -> origin/gh/kwen2501/214/orig 2025-09-07T06:39:15.3056446Z * [new branch] gh/kwen2501/215/base -> origin/gh/kwen2501/215/base 2025-09-07T06:39:15.3056520Z * [new branch] gh/kwen2501/215/head -> origin/gh/kwen2501/215/head 2025-09-07T06:39:15.3056592Z * [new branch] gh/kwen2501/215/orig -> origin/gh/kwen2501/215/orig 2025-09-07T06:39:15.3056666Z * [new branch] gh/kwen2501/216/base -> origin/gh/kwen2501/216/base 2025-09-07T06:39:15.3056737Z * [new branch] gh/kwen2501/216/head -> origin/gh/kwen2501/216/head 2025-09-07T06:39:15.3056809Z * [new branch] gh/kwen2501/216/orig -> origin/gh/kwen2501/216/orig 2025-09-07T06:39:15.3056881Z * [new branch] gh/kwen2501/217/base -> origin/gh/kwen2501/217/base 2025-09-07T06:39:15.3056959Z * [new branch] gh/kwen2501/217/head -> origin/gh/kwen2501/217/head 2025-09-07T06:39:15.3057031Z * [new branch] gh/kwen2501/217/orig -> origin/gh/kwen2501/217/orig 2025-09-07T06:39:15.3057103Z * [new branch] gh/kwen2501/218/base -> origin/gh/kwen2501/218/base 2025-09-07T06:39:15.3057177Z * [new branch] gh/kwen2501/218/head -> origin/gh/kwen2501/218/head 2025-09-07T06:39:15.3057250Z * [new branch] gh/kwen2501/218/orig -> origin/gh/kwen2501/218/orig 2025-09-07T06:39:15.3057322Z * [new branch] gh/kwen2501/219/base -> origin/gh/kwen2501/219/base 2025-09-07T06:39:15.3057395Z * [new branch] gh/kwen2501/219/head -> origin/gh/kwen2501/219/head 2025-09-07T06:39:15.3057467Z * [new branch] gh/kwen2501/219/orig -> origin/gh/kwen2501/219/orig 2025-09-07T06:39:15.3057540Z * [new branch] gh/kwen2501/220/base -> origin/gh/kwen2501/220/base 2025-09-07T06:39:15.3057614Z * [new branch] gh/kwen2501/220/head -> origin/gh/kwen2501/220/head 2025-09-07T06:39:15.3057687Z * [new branch] gh/kwen2501/220/orig -> origin/gh/kwen2501/220/orig 2025-09-07T06:39:15.3057799Z * [new branch] gh/kwen2501/221/base -> origin/gh/kwen2501/221/base 2025-09-07T06:39:15.3057873Z * [new branch] gh/kwen2501/221/head -> origin/gh/kwen2501/221/head 2025-09-07T06:39:15.3057945Z * [new branch] gh/kwen2501/221/orig -> origin/gh/kwen2501/221/orig 2025-09-07T06:39:15.3059023Z * [new branch] gh/kwen2501/222/base -> origin/gh/kwen2501/222/base 2025-09-07T06:39:15.3059106Z * [new branch] gh/kwen2501/222/head -> origin/gh/kwen2501/222/head 2025-09-07T06:39:15.3059180Z * [new branch] gh/kwen2501/222/orig -> origin/gh/kwen2501/222/orig 2025-09-07T06:39:15.3059253Z * [new branch] gh/kwen2501/223/base -> origin/gh/kwen2501/223/base 2025-09-07T06:39:15.3059392Z * [new branch] gh/kwen2501/223/head -> origin/gh/kwen2501/223/head 2025-09-07T06:39:15.3059467Z * [new branch] gh/kwen2501/223/orig -> origin/gh/kwen2501/223/orig 2025-09-07T06:39:15.3059541Z * [new branch] gh/kwen2501/224/base -> origin/gh/kwen2501/224/base 2025-09-07T06:39:15.3059614Z * [new branch] gh/kwen2501/224/head -> origin/gh/kwen2501/224/head 2025-09-07T06:39:15.3059687Z * [new branch] gh/kwen2501/224/orig -> origin/gh/kwen2501/224/orig 2025-09-07T06:39:15.3059759Z * [new branch] gh/kwen2501/225/base -> origin/gh/kwen2501/225/base 2025-09-07T06:39:15.3059832Z * [new branch] gh/kwen2501/225/head -> origin/gh/kwen2501/225/head 2025-09-07T06:39:15.3059905Z * [new branch] gh/kwen2501/225/orig -> origin/gh/kwen2501/225/orig 2025-09-07T06:39:15.3059978Z * [new branch] gh/kwen2501/226/base -> origin/gh/kwen2501/226/base 2025-09-07T06:39:15.3060051Z * [new branch] gh/kwen2501/226/head -> origin/gh/kwen2501/226/head 2025-09-07T06:39:15.3060123Z * [new branch] gh/kwen2501/226/orig -> origin/gh/kwen2501/226/orig 2025-09-07T06:39:15.3060197Z * [new branch] gh/kwen2501/227/base -> origin/gh/kwen2501/227/base 2025-09-07T06:39:15.3060269Z * [new branch] gh/kwen2501/227/head -> origin/gh/kwen2501/227/head 2025-09-07T06:39:15.3060342Z * [new branch] gh/kwen2501/227/orig -> origin/gh/kwen2501/227/orig 2025-09-07T06:39:15.3060414Z * [new branch] gh/kwen2501/228/base -> origin/gh/kwen2501/228/base 2025-09-07T06:39:15.3060486Z * [new branch] gh/kwen2501/228/head -> origin/gh/kwen2501/228/head 2025-09-07T06:39:15.3060560Z * [new branch] gh/kwen2501/228/orig -> origin/gh/kwen2501/228/orig 2025-09-07T06:39:15.3060635Z * [new branch] gh/kwen2501/229/base -> origin/gh/kwen2501/229/base 2025-09-07T06:39:15.3060708Z * [new branch] gh/kwen2501/229/head -> origin/gh/kwen2501/229/head 2025-09-07T06:39:15.3061792Z * [new branch] gh/kwen2501/229/orig -> origin/gh/kwen2501/229/orig 2025-09-07T06:39:15.3061868Z * [new branch] gh/kwen2501/230/base -> origin/gh/kwen2501/230/base 2025-09-07T06:39:15.3061940Z * [new branch] gh/kwen2501/230/head -> origin/gh/kwen2501/230/head 2025-09-07T06:39:15.3062014Z * [new branch] gh/kwen2501/230/orig -> origin/gh/kwen2501/230/orig 2025-09-07T06:39:15.3062089Z * [new branch] gh/kwen2501/231/base -> origin/gh/kwen2501/231/base 2025-09-07T06:39:15.3062161Z * [new branch] gh/kwen2501/231/head -> origin/gh/kwen2501/231/head 2025-09-07T06:39:15.3062235Z * [new branch] gh/kwen2501/231/orig -> origin/gh/kwen2501/231/orig 2025-09-07T06:39:15.3062311Z * [new branch] gh/kwen2501/232/base -> origin/gh/kwen2501/232/base 2025-09-07T06:39:15.3062383Z * [new branch] gh/kwen2501/232/head -> origin/gh/kwen2501/232/head 2025-09-07T06:39:15.3062495Z * [new branch] gh/kwen2501/232/orig -> origin/gh/kwen2501/232/orig 2025-09-07T06:39:15.3062576Z * [new branch] gh/laithsakka/156/base -> origin/gh/laithsakka/156/base 2025-09-07T06:39:15.3062655Z * [new branch] gh/laithsakka/156/head -> origin/gh/laithsakka/156/head 2025-09-07T06:39:15.3062734Z * [new branch] gh/laithsakka/156/orig -> origin/gh/laithsakka/156/orig 2025-09-07T06:39:15.3062811Z * [new branch] gh/laithsakka/160/base -> origin/gh/laithsakka/160/base 2025-09-07T06:39:15.3062889Z * [new branch] gh/laithsakka/160/head -> origin/gh/laithsakka/160/head 2025-09-07T06:39:15.3062966Z * [new branch] gh/laithsakka/160/orig -> origin/gh/laithsakka/160/orig 2025-09-07T06:39:15.3063149Z * [new branch] gh/laithsakka/178/base -> origin/gh/laithsakka/178/base 2025-09-07T06:39:15.3063229Z * [new branch] gh/laithsakka/178/head -> origin/gh/laithsakka/178/head 2025-09-07T06:39:15.3063308Z * [new branch] gh/laithsakka/178/orig -> origin/gh/laithsakka/178/orig 2025-09-07T06:39:15.3063386Z * [new branch] gh/laithsakka/191/base -> origin/gh/laithsakka/191/base 2025-09-07T06:39:15.3063463Z * [new branch] gh/laithsakka/191/head -> origin/gh/laithsakka/191/head 2025-09-07T06:39:15.3063541Z * [new branch] gh/laithsakka/191/orig -> origin/gh/laithsakka/191/orig 2025-09-07T06:39:15.3063618Z * [new branch] gh/laithsakka/237/base -> origin/gh/laithsakka/237/base 2025-09-07T06:39:15.3063696Z * [new branch] gh/laithsakka/237/head -> origin/gh/laithsakka/237/head 2025-09-07T06:39:15.3064742Z * [new branch] gh/laithsakka/237/orig -> origin/gh/laithsakka/237/orig 2025-09-07T06:39:15.3064822Z * [new branch] gh/laithsakka/249/base -> origin/gh/laithsakka/249/base 2025-09-07T06:39:15.3064899Z * [new branch] gh/laithsakka/249/head -> origin/gh/laithsakka/249/head 2025-09-07T06:39:15.3064980Z * [new branch] gh/laithsakka/249/orig -> origin/gh/laithsakka/249/orig 2025-09-07T06:39:15.3065057Z * [new branch] gh/laithsakka/251/base -> origin/gh/laithsakka/251/base 2025-09-07T06:39:15.3065134Z * [new branch] gh/laithsakka/251/head -> origin/gh/laithsakka/251/head 2025-09-07T06:39:15.3065212Z * [new branch] gh/laithsakka/251/orig -> origin/gh/laithsakka/251/orig 2025-09-07T06:39:15.3065289Z * [new branch] gh/laithsakka/254/base -> origin/gh/laithsakka/254/base 2025-09-07T06:39:15.3065366Z * [new branch] gh/laithsakka/254/head -> origin/gh/laithsakka/254/head 2025-09-07T06:39:15.3065448Z * [new branch] gh/laithsakka/254/orig -> origin/gh/laithsakka/254/orig 2025-09-07T06:39:15.3065526Z * [new branch] gh/laithsakka/255/base -> origin/gh/laithsakka/255/base 2025-09-07T06:39:15.3065605Z * [new branch] gh/laithsakka/255/head -> origin/gh/laithsakka/255/head 2025-09-07T06:39:15.3065682Z * [new branch] gh/laithsakka/255/orig -> origin/gh/laithsakka/255/orig 2025-09-07T06:39:15.3065760Z * [new branch] gh/laithsakka/256/base -> origin/gh/laithsakka/256/base 2025-09-07T06:39:15.3065836Z * [new branch] gh/laithsakka/256/head -> origin/gh/laithsakka/256/head 2025-09-07T06:39:15.3065913Z * [new branch] gh/laithsakka/256/orig -> origin/gh/laithsakka/256/orig 2025-09-07T06:39:15.3065991Z * [new branch] gh/laithsakka/257/base -> origin/gh/laithsakka/257/base 2025-09-07T06:39:15.3066069Z * [new branch] gh/laithsakka/257/head -> origin/gh/laithsakka/257/head 2025-09-07T06:39:15.3066146Z * [new branch] gh/laithsakka/257/orig -> origin/gh/laithsakka/257/orig 2025-09-07T06:39:15.3066224Z * [new branch] gh/laithsakka/258/base -> origin/gh/laithsakka/258/base 2025-09-07T06:39:15.3066357Z * [new branch] gh/laithsakka/258/head -> origin/gh/laithsakka/258/head 2025-09-07T06:39:15.3066435Z * [new branch] gh/laithsakka/258/orig -> origin/gh/laithsakka/258/orig 2025-09-07T06:39:15.3066513Z * [new branch] gh/laithsakka/259/base -> origin/gh/laithsakka/259/base 2025-09-07T06:39:15.3066591Z * [new branch] gh/laithsakka/259/head -> origin/gh/laithsakka/259/head 2025-09-07T06:39:15.3066668Z * [new branch] gh/laithsakka/259/orig -> origin/gh/laithsakka/259/orig 2025-09-07T06:39:15.3067703Z * [new branch] gh/laithsakka/260/base -> origin/gh/laithsakka/260/base 2025-09-07T06:39:15.3067848Z * [new branch] gh/laithsakka/260/head -> origin/gh/laithsakka/260/head 2025-09-07T06:39:15.3067926Z * [new branch] gh/laithsakka/260/orig -> origin/gh/laithsakka/260/orig 2025-09-07T06:39:15.3068006Z * [new branch] gh/laithsakka/261/base -> origin/gh/laithsakka/261/base 2025-09-07T06:39:15.3068084Z * [new branch] gh/laithsakka/261/head -> origin/gh/laithsakka/261/head 2025-09-07T06:39:15.3068162Z * [new branch] gh/laithsakka/261/orig -> origin/gh/laithsakka/261/orig 2025-09-07T06:39:15.3068240Z * [new branch] gh/laithsakka/262/base -> origin/gh/laithsakka/262/base 2025-09-07T06:39:15.3068318Z * [new branch] gh/laithsakka/262/head -> origin/gh/laithsakka/262/head 2025-09-07T06:39:15.3068395Z * [new branch] gh/laithsakka/262/orig -> origin/gh/laithsakka/262/orig 2025-09-07T06:39:15.3068473Z * [new branch] gh/laithsakka/263/base -> origin/gh/laithsakka/263/base 2025-09-07T06:39:15.3068552Z * [new branch] gh/laithsakka/263/head -> origin/gh/laithsakka/263/head 2025-09-07T06:39:15.3068629Z * [new branch] gh/laithsakka/263/orig -> origin/gh/laithsakka/263/orig 2025-09-07T06:39:15.3068709Z * [new branch] gh/laithsakka/264/base -> origin/gh/laithsakka/264/base 2025-09-07T06:39:15.3068786Z * [new branch] gh/laithsakka/264/head -> origin/gh/laithsakka/264/head 2025-09-07T06:39:15.3068863Z * [new branch] gh/laithsakka/264/orig -> origin/gh/laithsakka/264/orig 2025-09-07T06:39:15.3068941Z * [new branch] gh/laithsakka/265/base -> origin/gh/laithsakka/265/base 2025-09-07T06:39:15.3069018Z * [new branch] gh/laithsakka/265/head -> origin/gh/laithsakka/265/head 2025-09-07T06:39:15.3069096Z * [new branch] gh/laithsakka/265/orig -> origin/gh/laithsakka/265/orig 2025-09-07T06:39:15.3069177Z * [new branch] gh/laithsakka/266/base -> origin/gh/laithsakka/266/base 2025-09-07T06:39:15.3069255Z * [new branch] gh/laithsakka/266/head -> origin/gh/laithsakka/266/head 2025-09-07T06:39:15.3069333Z * [new branch] gh/laithsakka/266/orig -> origin/gh/laithsakka/266/orig 2025-09-07T06:39:15.3069411Z * [new branch] gh/laithsakka/267/base -> origin/gh/laithsakka/267/base 2025-09-07T06:39:15.3069490Z * [new branch] gh/laithsakka/267/head -> origin/gh/laithsakka/267/head 2025-09-07T06:39:15.3069567Z * [new branch] gh/laithsakka/267/orig -> origin/gh/laithsakka/267/orig 2025-09-07T06:39:15.3070604Z * [new branch] gh/laithsakka/268/base -> origin/gh/laithsakka/268/base 2025-09-07T06:39:15.3070684Z * [new branch] gh/laithsakka/268/head -> origin/gh/laithsakka/268/head 2025-09-07T06:39:15.3070762Z * [new branch] gh/laithsakka/268/orig -> origin/gh/laithsakka/268/orig 2025-09-07T06:39:15.3070846Z * [new branch] gh/laithsakka/28/base -> origin/gh/laithsakka/28/base 2025-09-07T06:39:15.3070925Z * [new branch] gh/laithsakka/29/base -> origin/gh/laithsakka/29/base 2025-09-07T06:39:15.3071039Z * [new branch] gh/laithsakka/30/base -> origin/gh/laithsakka/30/base 2025-09-07T06:39:15.3071116Z * [new branch] gh/laithsakka/30/head -> origin/gh/laithsakka/30/head 2025-09-07T06:39:15.3071193Z * [new branch] gh/laithsakka/31/base -> origin/gh/laithsakka/31/base 2025-09-07T06:39:15.3071269Z * [new branch] gh/laithsakka/31/head -> origin/gh/laithsakka/31/head 2025-09-07T06:39:15.3071346Z * [new branch] gh/laithsakka/32/base -> origin/gh/laithsakka/32/base 2025-09-07T06:39:15.3071423Z * [new branch] gh/laithsakka/32/head -> origin/gh/laithsakka/32/head 2025-09-07T06:39:15.3071501Z * [new branch] gh/lucaskabela/1/base -> origin/gh/lucaskabela/1/base 2025-09-07T06:39:15.3071612Z * [new branch] gh/lucaskabela/1/head -> origin/gh/lucaskabela/1/head 2025-09-07T06:39:15.3071693Z * [new branch] gh/lucaskabela/10/base -> origin/gh/lucaskabela/10/base 2025-09-07T06:39:15.3071774Z * [new branch] gh/lucaskabela/10/head -> origin/gh/lucaskabela/10/head 2025-09-07T06:39:15.3071852Z * [new branch] gh/lucaskabela/10/orig -> origin/gh/lucaskabela/10/orig 2025-09-07T06:39:15.3071931Z * [new branch] gh/lucaskabela/11/base -> origin/gh/lucaskabela/11/base 2025-09-07T06:39:15.3072009Z * [new branch] gh/lucaskabela/11/head -> origin/gh/lucaskabela/11/head 2025-09-07T06:39:15.3072087Z * [new branch] gh/lucaskabela/11/orig -> origin/gh/lucaskabela/11/orig 2025-09-07T06:39:15.3072166Z * [new branch] gh/lucaskabela/12/base -> origin/gh/lucaskabela/12/base 2025-09-07T06:39:15.3072245Z * [new branch] gh/lucaskabela/12/head -> origin/gh/lucaskabela/12/head 2025-09-07T06:39:15.3072323Z * [new branch] gh/lucaskabela/12/orig -> origin/gh/lucaskabela/12/orig 2025-09-07T06:39:15.3072403Z * [new branch] gh/lucaskabela/13/base -> origin/gh/lucaskabela/13/base 2025-09-07T06:39:15.3072481Z * [new branch] gh/lucaskabela/13/head -> origin/gh/lucaskabela/13/head 2025-09-07T06:39:15.3073616Z * [new branch] gh/lucaskabela/13/orig -> origin/gh/lucaskabela/13/orig 2025-09-07T06:39:15.3073700Z * [new branch] gh/lucaskabela/14/base -> origin/gh/lucaskabela/14/base 2025-09-07T06:39:15.3073778Z * [new branch] gh/lucaskabela/14/head -> origin/gh/lucaskabela/14/head 2025-09-07T06:39:15.3073855Z * [new branch] gh/lucaskabela/14/orig -> origin/gh/lucaskabela/14/orig 2025-09-07T06:39:15.3073934Z * [new branch] gh/lucaskabela/15/base -> origin/gh/lucaskabela/15/base 2025-09-07T06:39:15.3074017Z * [new branch] gh/lucaskabela/15/head -> origin/gh/lucaskabela/15/head 2025-09-07T06:39:15.3074095Z * [new branch] gh/lucaskabela/15/orig -> origin/gh/lucaskabela/15/orig 2025-09-07T06:39:15.3074175Z * [new branch] gh/lucaskabela/16/base -> origin/gh/lucaskabela/16/base 2025-09-07T06:39:15.3074253Z * [new branch] gh/lucaskabela/16/head -> origin/gh/lucaskabela/16/head 2025-09-07T06:39:15.3074330Z * [new branch] gh/lucaskabela/16/orig -> origin/gh/lucaskabela/16/orig 2025-09-07T06:39:15.3074408Z * [new branch] gh/lucaskabela/17/base -> origin/gh/lucaskabela/17/base 2025-09-07T06:39:15.3074487Z * [new branch] gh/lucaskabela/17/head -> origin/gh/lucaskabela/17/head 2025-09-07T06:39:15.3074564Z * [new branch] gh/lucaskabela/17/orig -> origin/gh/lucaskabela/17/orig 2025-09-07T06:39:15.3074644Z * [new branch] gh/lucaskabela/2/base -> origin/gh/lucaskabela/2/base 2025-09-07T06:39:15.3074723Z * [new branch] gh/lucaskabela/2/head -> origin/gh/lucaskabela/2/head 2025-09-07T06:39:15.3074800Z * [new branch] gh/lucaskabela/2/orig -> origin/gh/lucaskabela/2/orig 2025-09-07T06:39:15.3074947Z * [new branch] gh/lucaskabela/3/base -> origin/gh/lucaskabela/3/base 2025-09-07T06:39:15.3075026Z * [new branch] gh/lucaskabela/3/head -> origin/gh/lucaskabela/3/head 2025-09-07T06:39:15.3075102Z * [new branch] gh/lucaskabela/3/orig -> origin/gh/lucaskabela/3/orig 2025-09-07T06:39:15.3075179Z * [new branch] gh/lucaskabela/4/base -> origin/gh/lucaskabela/4/base 2025-09-07T06:39:15.3075256Z * [new branch] gh/lucaskabela/4/head -> origin/gh/lucaskabela/4/head 2025-09-07T06:39:15.3075333Z * [new branch] gh/lucaskabela/4/orig -> origin/gh/lucaskabela/4/orig 2025-09-07T06:39:15.3075465Z * [new branch] gh/lucaskabela/5/base -> origin/gh/lucaskabela/5/base 2025-09-07T06:39:15.3075542Z * [new branch] gh/lucaskabela/5/head -> origin/gh/lucaskabela/5/head 2025-09-07T06:39:15.3076589Z * [new branch] gh/lucaskabela/5/orig -> origin/gh/lucaskabela/5/orig 2025-09-07T06:39:15.3076670Z * [new branch] gh/lucaskabela/6/base -> origin/gh/lucaskabela/6/base 2025-09-07T06:39:15.3076748Z * [new branch] gh/lucaskabela/6/head -> origin/gh/lucaskabela/6/head 2025-09-07T06:39:15.3076824Z * [new branch] gh/lucaskabela/6/orig -> origin/gh/lucaskabela/6/orig 2025-09-07T06:39:15.3076900Z * [new branch] gh/lucaskabela/7/base -> origin/gh/lucaskabela/7/base 2025-09-07T06:39:15.3076978Z * [new branch] gh/lucaskabela/7/head -> origin/gh/lucaskabela/7/head 2025-09-07T06:39:15.3077055Z * [new branch] gh/lucaskabela/7/orig -> origin/gh/lucaskabela/7/orig 2025-09-07T06:39:15.3077137Z * [new branch] gh/lucaskabela/8/base -> origin/gh/lucaskabela/8/base 2025-09-07T06:39:15.3077214Z * [new branch] gh/lucaskabela/8/head -> origin/gh/lucaskabela/8/head 2025-09-07T06:39:15.3077292Z * [new branch] gh/lucaskabela/8/orig -> origin/gh/lucaskabela/8/orig 2025-09-07T06:39:15.3077368Z * [new branch] gh/lucaskabela/9/base -> origin/gh/lucaskabela/9/base 2025-09-07T06:39:15.3077446Z * [new branch] gh/lucaskabela/9/head -> origin/gh/lucaskabela/9/head 2025-09-07T06:39:15.3077523Z * [new branch] gh/lucaskabela/9/orig -> origin/gh/lucaskabela/9/orig 2025-09-07T06:39:15.3077592Z * [new branch] gh/lw/3/base -> origin/gh/lw/3/base 2025-09-07T06:39:15.3077659Z * [new branch] gh/lw/3/head -> origin/gh/lw/3/head 2025-09-07T06:39:15.3077722Z * [new branch] gh/lw/3/orig -> origin/gh/lw/3/orig 2025-09-07T06:39:15.3077799Z * [new branch] gh/malfet/14/base -> origin/gh/malfet/14/base 2025-09-07T06:39:15.3077874Z * [new branch] gh/malfet/330/base -> origin/gh/malfet/330/base 2025-09-07T06:39:15.3077950Z * [new branch] gh/malfet/330/head -> origin/gh/malfet/330/head 2025-09-07T06:39:15.3078021Z * [new branch] gh/malfet/330/orig -> origin/gh/malfet/330/orig 2025-09-07T06:39:15.3078091Z * [new branch] gh/malfet/396/base -> origin/gh/malfet/396/base 2025-09-07T06:39:15.3078163Z * [new branch] gh/malfet/396/head -> origin/gh/malfet/396/head 2025-09-07T06:39:15.3078234Z * [new branch] gh/malfet/396/orig -> origin/gh/malfet/396/orig 2025-09-07T06:39:15.3078304Z * [new branch] gh/malfet/397/base -> origin/gh/malfet/397/base 2025-09-07T06:39:15.3079323Z * [new branch] gh/malfet/397/head -> origin/gh/malfet/397/head 2025-09-07T06:39:15.3079400Z * [new branch] gh/malfet/397/orig -> origin/gh/malfet/397/orig 2025-09-07T06:39:15.3079471Z * [new branch] gh/malfet/398/base -> origin/gh/malfet/398/base 2025-09-07T06:39:15.3079651Z * [new branch] gh/malfet/398/head -> origin/gh/malfet/398/head 2025-09-07T06:39:15.3079722Z * [new branch] gh/malfet/398/orig -> origin/gh/malfet/398/orig 2025-09-07T06:39:15.3079793Z * [new branch] gh/malfet/399/base -> origin/gh/malfet/399/base 2025-09-07T06:39:15.3079865Z * [new branch] gh/malfet/399/head -> origin/gh/malfet/399/head 2025-09-07T06:39:15.3079936Z * [new branch] gh/malfet/399/orig -> origin/gh/malfet/399/orig 2025-09-07T06:39:15.3080013Z * [new branch] gh/malfet/414/base -> origin/gh/malfet/414/base 2025-09-07T06:39:15.3080131Z * [new branch] gh/malfet/414/head -> origin/gh/malfet/414/head 2025-09-07T06:39:15.3080202Z * [new branch] gh/malfet/414/orig -> origin/gh/malfet/414/orig 2025-09-07T06:39:15.3080272Z * [new branch] gh/malfet/417/base -> origin/gh/malfet/417/base 2025-09-07T06:39:15.3080345Z * [new branch] gh/malfet/417/head -> origin/gh/malfet/417/head 2025-09-07T06:39:15.3080415Z * [new branch] gh/malfet/417/orig -> origin/gh/malfet/417/orig 2025-09-07T06:39:15.3080486Z * [new branch] gh/malfet/418/base -> origin/gh/malfet/418/base 2025-09-07T06:39:15.3080558Z * [new branch] gh/malfet/418/head -> origin/gh/malfet/418/head 2025-09-07T06:39:15.3080628Z * [new branch] gh/malfet/418/orig -> origin/gh/malfet/418/orig 2025-09-07T06:39:15.3080698Z * [new branch] gh/malfet/475/base -> origin/gh/malfet/475/base 2025-09-07T06:39:15.3080771Z * [new branch] gh/malfet/475/head -> origin/gh/malfet/475/head 2025-09-07T06:39:15.3080842Z * [new branch] gh/malfet/475/orig -> origin/gh/malfet/475/orig 2025-09-07T06:39:15.3080913Z * [new branch] gh/malfet/476/base -> origin/gh/malfet/476/base 2025-09-07T06:39:15.3080985Z * [new branch] gh/malfet/476/head -> origin/gh/malfet/476/head 2025-09-07T06:39:15.3081057Z * [new branch] gh/malfet/476/orig -> origin/gh/malfet/476/orig 2025-09-07T06:39:15.3081127Z * [new branch] gh/malfet/477/base -> origin/gh/malfet/477/base 2025-09-07T06:39:15.3082156Z * [new branch] gh/malfet/477/head -> origin/gh/malfet/477/head 2025-09-07T06:39:15.3082230Z * [new branch] gh/malfet/477/orig -> origin/gh/malfet/477/orig 2025-09-07T06:39:15.3082302Z * [new branch] gh/malfet/478/base -> origin/gh/malfet/478/base 2025-09-07T06:39:15.3082378Z * [new branch] gh/malfet/478/head -> origin/gh/malfet/478/head 2025-09-07T06:39:15.3082450Z * [new branch] gh/malfet/478/orig -> origin/gh/malfet/478/orig 2025-09-07T06:39:15.3082520Z * [new branch] gh/malfet/479/base -> origin/gh/malfet/479/base 2025-09-07T06:39:15.3082592Z * [new branch] gh/malfet/479/head -> origin/gh/malfet/479/head 2025-09-07T06:39:15.3082664Z * [new branch] gh/malfet/479/orig -> origin/gh/malfet/479/orig 2025-09-07T06:39:15.3082735Z * [new branch] gh/malfet/480/base -> origin/gh/malfet/480/base 2025-09-07T06:39:15.3082806Z * [new branch] gh/malfet/480/head -> origin/gh/malfet/480/head 2025-09-07T06:39:15.3082877Z * [new branch] gh/malfet/480/orig -> origin/gh/malfet/480/orig 2025-09-07T06:39:15.3082947Z * [new branch] gh/malfet/481/base -> origin/gh/malfet/481/base 2025-09-07T06:39:15.3083021Z * [new branch] gh/malfet/481/head -> origin/gh/malfet/481/head 2025-09-07T06:39:15.3083155Z * [new branch] gh/malfet/481/orig -> origin/gh/malfet/481/orig 2025-09-07T06:39:15.3083227Z * [new branch] gh/malfet/482/base -> origin/gh/malfet/482/base 2025-09-07T06:39:15.3083372Z * [new branch] gh/malfet/482/head -> origin/gh/malfet/482/head 2025-09-07T06:39:15.3083443Z * [new branch] gh/malfet/482/orig -> origin/gh/malfet/482/orig 2025-09-07T06:39:15.3083514Z * [new branch] gh/malfet/483/base -> origin/gh/malfet/483/base 2025-09-07T06:39:15.3083585Z * [new branch] gh/malfet/483/head -> origin/gh/malfet/483/head 2025-09-07T06:39:15.3083656Z * [new branch] gh/malfet/483/orig -> origin/gh/malfet/483/orig 2025-09-07T06:39:15.3083726Z * [new branch] gh/malfet/484/base -> origin/gh/malfet/484/base 2025-09-07T06:39:15.3083853Z * [new branch] gh/malfet/484/head -> origin/gh/malfet/484/head 2025-09-07T06:39:15.3083924Z * [new branch] gh/malfet/484/orig -> origin/gh/malfet/484/orig 2025-09-07T06:39:15.3083996Z * [new branch] gh/malfet/485/base -> origin/gh/malfet/485/base 2025-09-07T06:39:15.3084067Z * [new branch] gh/malfet/485/head -> origin/gh/malfet/485/head 2025-09-07T06:39:15.3085113Z * [new branch] gh/malfet/485/orig -> origin/gh/malfet/485/orig 2025-09-07T06:39:15.3085187Z * [new branch] gh/malfet/486/base -> origin/gh/malfet/486/base 2025-09-07T06:39:15.3085257Z * [new branch] gh/malfet/486/head -> origin/gh/malfet/486/head 2025-09-07T06:39:15.3085329Z * [new branch] gh/malfet/486/orig -> origin/gh/malfet/486/orig 2025-09-07T06:39:15.3085399Z * [new branch] gh/malfet/487/base -> origin/gh/malfet/487/base 2025-09-07T06:39:15.3085474Z * [new branch] gh/malfet/487/head -> origin/gh/malfet/487/head 2025-09-07T06:39:15.3085546Z * [new branch] gh/malfet/487/orig -> origin/gh/malfet/487/orig 2025-09-07T06:39:15.3085619Z * [new branch] gh/malfet/488/base -> origin/gh/malfet/488/base 2025-09-07T06:39:15.3085689Z * [new branch] gh/malfet/488/head -> origin/gh/malfet/488/head 2025-09-07T06:39:15.3085759Z * [new branch] gh/malfet/488/orig -> origin/gh/malfet/488/orig 2025-09-07T06:39:15.3085831Z * [new branch] gh/malfet/489/base -> origin/gh/malfet/489/base 2025-09-07T06:39:15.3085901Z * [new branch] gh/malfet/489/head -> origin/gh/malfet/489/head 2025-09-07T06:39:15.3085971Z * [new branch] gh/malfet/489/orig -> origin/gh/malfet/489/orig 2025-09-07T06:39:15.3086043Z * [new branch] gh/malfet/490/base -> origin/gh/malfet/490/base 2025-09-07T06:39:15.3086118Z * [new branch] gh/malfet/490/head -> origin/gh/malfet/490/head 2025-09-07T06:39:15.3086188Z * [new branch] gh/malfet/490/orig -> origin/gh/malfet/490/orig 2025-09-07T06:39:15.3086262Z * [new branch] gh/malfet/491/base -> origin/gh/malfet/491/base 2025-09-07T06:39:15.3086332Z * [new branch] gh/malfet/491/head -> origin/gh/malfet/491/head 2025-09-07T06:39:15.3086403Z * [new branch] gh/malfet/491/orig -> origin/gh/malfet/491/orig 2025-09-07T06:39:15.3086475Z * [new branch] gh/malfet/492/base -> origin/gh/malfet/492/base 2025-09-07T06:39:15.3086545Z * [new branch] gh/malfet/492/head -> origin/gh/malfet/492/head 2025-09-07T06:39:15.3086615Z * [new branch] gh/malfet/492/orig -> origin/gh/malfet/492/orig 2025-09-07T06:39:15.3086686Z * [new branch] gh/malfet/493/base -> origin/gh/malfet/493/base 2025-09-07T06:39:15.3086762Z * [new branch] gh/malfet/493/head -> origin/gh/malfet/493/head 2025-09-07T06:39:15.3087784Z * [new branch] gh/malfet/493/orig -> origin/gh/malfet/493/orig 2025-09-07T06:39:15.3087901Z * [new branch] gh/malfet/494/base -> origin/gh/malfet/494/base 2025-09-07T06:39:15.3087972Z * [new branch] gh/malfet/494/head -> origin/gh/malfet/494/head 2025-09-07T06:39:15.3088043Z * [new branch] gh/malfet/494/orig -> origin/gh/malfet/494/orig 2025-09-07T06:39:15.3088114Z * [new branch] gh/malfet/495/base -> origin/gh/malfet/495/base 2025-09-07T06:39:15.3088184Z * [new branch] gh/malfet/495/head -> origin/gh/malfet/495/head 2025-09-07T06:39:15.3088254Z * [new branch] gh/malfet/495/orig -> origin/gh/malfet/495/orig 2025-09-07T06:39:15.3088378Z * [new branch] gh/malfet/496/base -> origin/gh/malfet/496/base 2025-09-07T06:39:15.3088489Z * [new branch] gh/malfet/496/head -> origin/gh/malfet/496/head 2025-09-07T06:39:15.3088560Z * [new branch] gh/malfet/496/orig -> origin/gh/malfet/496/orig 2025-09-07T06:39:15.3088632Z * [new branch] gh/malfet/497/base -> origin/gh/malfet/497/base 2025-09-07T06:39:15.3088703Z * [new branch] gh/malfet/497/head -> origin/gh/malfet/497/head 2025-09-07T06:39:15.3088774Z * [new branch] gh/malfet/497/orig -> origin/gh/malfet/497/orig 2025-09-07T06:39:15.3088846Z * [new branch] gh/malfet/498/base -> origin/gh/malfet/498/base 2025-09-07T06:39:15.3088916Z * [new branch] gh/malfet/498/head -> origin/gh/malfet/498/head 2025-09-07T06:39:15.3088987Z * [new branch] gh/malfet/498/orig -> origin/gh/malfet/498/orig 2025-09-07T06:39:15.3089057Z * [new branch] gh/malfet/499/base -> origin/gh/malfet/499/base 2025-09-07T06:39:15.3089130Z * [new branch] gh/malfet/499/head -> origin/gh/malfet/499/head 2025-09-07T06:39:15.3089200Z * [new branch] gh/malfet/499/orig -> origin/gh/malfet/499/orig 2025-09-07T06:39:15.3089272Z * [new branch] gh/malfet/500/base -> origin/gh/malfet/500/base 2025-09-07T06:39:15.3089344Z * [new branch] gh/malfet/500/head -> origin/gh/malfet/500/head 2025-09-07T06:39:15.3089415Z * [new branch] gh/malfet/500/orig -> origin/gh/malfet/500/orig 2025-09-07T06:39:15.3089485Z * [new branch] gh/malfet/501/base -> origin/gh/malfet/501/base 2025-09-07T06:39:15.3089557Z * [new branch] gh/malfet/501/head -> origin/gh/malfet/501/head 2025-09-07T06:39:15.3090595Z * [new branch] gh/malfet/501/orig -> origin/gh/malfet/501/orig 2025-09-07T06:39:15.3090689Z * [new branch] gh/malfet/502/base -> origin/gh/malfet/502/base 2025-09-07T06:39:15.3090760Z * [new branch] gh/malfet/502/head -> origin/gh/malfet/502/head 2025-09-07T06:39:15.3090831Z * [new branch] gh/malfet/502/orig -> origin/gh/malfet/502/orig 2025-09-07T06:39:15.3090903Z * [new branch] gh/malfet/503/base -> origin/gh/malfet/503/base 2025-09-07T06:39:15.3090974Z * [new branch] gh/malfet/503/head -> origin/gh/malfet/503/head 2025-09-07T06:39:15.3091045Z * [new branch] gh/malfet/503/orig -> origin/gh/malfet/503/orig 2025-09-07T06:39:15.3091116Z * [new branch] gh/malfet/504/base -> origin/gh/malfet/504/base 2025-09-07T06:39:15.3091188Z * [new branch] gh/malfet/504/head -> origin/gh/malfet/504/head 2025-09-07T06:39:15.3091258Z * [new branch] gh/malfet/504/orig -> origin/gh/malfet/504/orig 2025-09-07T06:39:15.3091334Z * [new branch] gh/malfet/505/base -> origin/gh/malfet/505/base 2025-09-07T06:39:15.3091405Z * [new branch] gh/malfet/505/head -> origin/gh/malfet/505/head 2025-09-07T06:39:15.3091475Z * [new branch] gh/malfet/505/orig -> origin/gh/malfet/505/orig 2025-09-07T06:39:15.3091593Z * [new branch] gh/malfet/506/base -> origin/gh/malfet/506/base 2025-09-07T06:39:15.3091664Z * [new branch] gh/malfet/506/head -> origin/gh/malfet/506/head 2025-09-07T06:39:15.3091735Z * [new branch] gh/malfet/506/orig -> origin/gh/malfet/506/orig 2025-09-07T06:39:15.3091805Z * [new branch] gh/malfet/507/base -> origin/gh/malfet/507/base 2025-09-07T06:39:15.3091876Z * [new branch] gh/malfet/507/head -> origin/gh/malfet/507/head 2025-09-07T06:39:15.3091947Z * [new branch] gh/malfet/507/orig -> origin/gh/malfet/507/orig 2025-09-07T06:39:15.3092054Z * [new branch] gh/malfet/508/base -> origin/gh/malfet/508/base 2025-09-07T06:39:15.3092125Z * [new branch] gh/malfet/508/head -> origin/gh/malfet/508/head 2025-09-07T06:39:15.3092196Z * [new branch] gh/malfet/508/orig -> origin/gh/malfet/508/orig 2025-09-07T06:39:15.3092268Z * [new branch] gh/malfet/509/base -> origin/gh/malfet/509/base 2025-09-07T06:39:15.3092339Z * [new branch] gh/malfet/509/head -> origin/gh/malfet/509/head 2025-09-07T06:39:15.3093439Z * [new branch] gh/malfet/509/orig -> origin/gh/malfet/509/orig 2025-09-07T06:39:15.3093514Z * [new branch] gh/malfet/510/base -> origin/gh/malfet/510/base 2025-09-07T06:39:15.3093585Z * [new branch] gh/malfet/510/head -> origin/gh/malfet/510/head 2025-09-07T06:39:15.3093656Z * [new branch] gh/malfet/510/orig -> origin/gh/malfet/510/orig 2025-09-07T06:39:15.3093733Z * [new branch] gh/malfet/511/base -> origin/gh/malfet/511/base 2025-09-07T06:39:15.3093803Z * [new branch] gh/malfet/511/head -> origin/gh/malfet/511/head 2025-09-07T06:39:15.3093875Z * [new branch] gh/malfet/511/orig -> origin/gh/malfet/511/orig 2025-09-07T06:39:15.3093948Z * [new branch] gh/malfet/512/base -> origin/gh/malfet/512/base 2025-09-07T06:39:15.3094018Z * [new branch] gh/malfet/512/head -> origin/gh/malfet/512/head 2025-09-07T06:39:15.3094090Z * [new branch] gh/malfet/512/orig -> origin/gh/malfet/512/orig 2025-09-07T06:39:15.3094160Z * [new branch] gh/malfet/513/base -> origin/gh/malfet/513/base 2025-09-07T06:39:15.3094231Z * [new branch] gh/malfet/513/head -> origin/gh/malfet/513/head 2025-09-07T06:39:15.3094302Z * [new branch] gh/malfet/513/orig -> origin/gh/malfet/513/orig 2025-09-07T06:39:15.3094378Z * [new branch] gh/malfet/64/base -> origin/gh/malfet/64/base 2025-09-07T06:39:15.3094449Z * [new branch] gh/malfet/64/head -> origin/gh/malfet/64/head 2025-09-07T06:39:15.3094543Z * [new branch] gh/manuelcandales/10/base -> origin/gh/manuelcandales/10/base 2025-09-07T06:39:15.3094632Z * [new branch] gh/manuelcandales/10/head -> origin/gh/manuelcandales/10/head 2025-09-07T06:39:15.3094716Z * [new branch] gh/manuelcandales/10/orig -> origin/gh/manuelcandales/10/orig 2025-09-07T06:39:15.3094802Z * [new branch] gh/manuelcandales/11/base -> origin/gh/manuelcandales/11/base 2025-09-07T06:39:15.3094886Z * [new branch] gh/manuelcandales/11/head -> origin/gh/manuelcandales/11/head 2025-09-07T06:39:15.3094970Z * [new branch] gh/manuelcandales/11/orig -> origin/gh/manuelcandales/11/orig 2025-09-07T06:39:15.3095060Z * [new branch] gh/manuelcandales/9/base -> origin/gh/manuelcandales/9/base 2025-09-07T06:39:15.3095147Z * [new branch] gh/manuelcandales/9/head -> origin/gh/manuelcandales/9/head 2025-09-07T06:39:15.3095231Z * [new branch] gh/manuelcandales/9/orig -> origin/gh/manuelcandales/9/orig 2025-09-07T06:39:15.3096329Z * [new branch] gh/markkm/1/base -> origin/gh/markkm/1/base 2025-09-07T06:39:15.3096415Z * [new branch] gh/masnesral/204/base -> origin/gh/masnesral/204/base 2025-09-07T06:39:15.3096493Z * [new branch] gh/masnesral/204/head -> origin/gh/masnesral/204/head 2025-09-07T06:39:15.3096570Z * [new branch] gh/masnesral/204/orig -> origin/gh/masnesral/204/orig 2025-09-07T06:39:15.3096646Z * [new branch] gh/masnesral/235/base -> origin/gh/masnesral/235/base 2025-09-07T06:39:15.3096722Z * [new branch] gh/masnesral/235/head -> origin/gh/masnesral/235/head 2025-09-07T06:39:15.3096852Z * [new branch] gh/masnesral/235/orig -> origin/gh/masnesral/235/orig 2025-09-07T06:39:15.3096929Z * [new branch] gh/masnesral/34/base -> origin/gh/masnesral/34/base 2025-09-07T06:39:15.3097006Z * [new branch] gh/mhorowitz/0/base -> origin/gh/mhorowitz/0/base 2025-09-07T06:39:15.3097084Z * [new branch] gh/mhorowitz/0/head -> origin/gh/mhorowitz/0/head 2025-09-07T06:39:15.3097159Z * [new branch] gh/mhorowitz/1/base -> origin/gh/mhorowitz/1/base 2025-09-07T06:39:15.3097232Z * [new branch] gh/mhorowitz/1/head -> origin/gh/mhorowitz/1/head 2025-09-07T06:39:15.3097306Z * [new branch] gh/mhorowitz/2/base -> origin/gh/mhorowitz/2/base 2025-09-07T06:39:15.3097380Z * [new branch] gh/mhorowitz/2/head -> origin/gh/mhorowitz/2/head 2025-09-07T06:39:15.3097454Z * [new branch] gh/mhorowitz/3/base -> origin/gh/mhorowitz/3/base 2025-09-07T06:39:15.3097529Z * [new branch] gh/mhorowitz/3/head -> origin/gh/mhorowitz/3/head 2025-09-07T06:39:15.3097604Z * [new branch] gh/mhorowitz/4/base -> origin/gh/mhorowitz/4/base 2025-09-07T06:39:15.3097679Z * [new branch] gh/mhorowitz/4/head -> origin/gh/mhorowitz/4/head 2025-09-07T06:39:15.3097752Z * [new branch] gh/mhorowitz/5/base -> origin/gh/mhorowitz/5/base 2025-09-07T06:39:15.3097827Z * [new branch] gh/mhorowitz/5/head -> origin/gh/mhorowitz/5/head 2025-09-07T06:39:15.3097901Z * [new branch] gh/mhorowitz/6/base -> origin/gh/mhorowitz/6/base 2025-09-07T06:39:15.3097974Z * [new branch] gh/mhorowitz/6/head -> origin/gh/mhorowitz/6/head 2025-09-07T06:39:15.3098076Z * [new branch] gh/mikaylagawarecki/234/base -> origin/gh/mikaylagawarecki/234/base 2025-09-07T06:39:15.3098171Z * [new branch] gh/mikaylagawarecki/234/head -> origin/gh/mikaylagawarecki/234/head 2025-09-07T06:39:15.3098266Z * [new branch] gh/mikaylagawarecki/235/base -> origin/gh/mikaylagawarecki/235/base 2025-09-07T06:39:15.3099326Z * [new branch] gh/mikaylagawarecki/235/head -> origin/gh/mikaylagawarecki/235/head 2025-09-07T06:39:15.3099420Z * [new branch] gh/mikaylagawarecki/236/base -> origin/gh/mikaylagawarecki/236/base 2025-09-07T06:39:15.3099510Z * [new branch] gh/mikaylagawarecki/236/head -> origin/gh/mikaylagawarecki/236/head 2025-09-07T06:39:15.3099601Z * [new branch] gh/mikaylagawarecki/237/base -> origin/gh/mikaylagawarecki/237/base 2025-09-07T06:39:15.3099692Z * [new branch] gh/mikaylagawarecki/237/head -> origin/gh/mikaylagawarecki/237/head 2025-09-07T06:39:15.3099782Z * [new branch] gh/mikaylagawarecki/238/base -> origin/gh/mikaylagawarecki/238/base 2025-09-07T06:39:15.3099872Z * [new branch] gh/mikaylagawarecki/238/head -> origin/gh/mikaylagawarecki/238/head 2025-09-07T06:39:15.3099965Z * [new branch] gh/mikaylagawarecki/317/base -> origin/gh/mikaylagawarecki/317/base 2025-09-07T06:39:15.3100054Z * [new branch] gh/mikaylagawarecki/317/head -> origin/gh/mikaylagawarecki/317/head 2025-09-07T06:39:15.3100186Z * [new branch] gh/mikaylagawarecki/317/orig -> origin/gh/mikaylagawarecki/317/orig 2025-09-07T06:39:15.3100276Z * [new branch] gh/mikaylagawarecki/320/base -> origin/gh/mikaylagawarecki/320/base 2025-09-07T06:39:15.3100366Z * [new branch] gh/mikaylagawarecki/320/head -> origin/gh/mikaylagawarecki/320/head 2025-09-07T06:39:15.3100457Z * [new branch] gh/mikaylagawarecki/320/orig -> origin/gh/mikaylagawarecki/320/orig 2025-09-07T06:39:15.3100546Z * [new branch] gh/mikaylagawarecki/329/base -> origin/gh/mikaylagawarecki/329/base 2025-09-07T06:39:15.3100636Z * [new branch] gh/mikaylagawarecki/329/head -> origin/gh/mikaylagawarecki/329/head 2025-09-07T06:39:15.3100759Z * [new branch] gh/mikaylagawarecki/329/orig -> origin/gh/mikaylagawarecki/329/orig 2025-09-07T06:39:15.3100848Z * [new branch] gh/mikaylagawarecki/330/base -> origin/gh/mikaylagawarecki/330/base 2025-09-07T06:39:15.3100939Z * [new branch] gh/mikaylagawarecki/330/head -> origin/gh/mikaylagawarecki/330/head 2025-09-07T06:39:15.3101030Z * [new branch] gh/mikaylagawarecki/330/orig -> origin/gh/mikaylagawarecki/330/orig 2025-09-07T06:39:15.3101120Z * [new branch] gh/mikaylagawarecki/331/base -> origin/gh/mikaylagawarecki/331/base 2025-09-07T06:39:15.3101210Z * [new branch] gh/mikaylagawarecki/331/head -> origin/gh/mikaylagawarecki/331/head 2025-09-07T06:39:15.3101299Z * [new branch] gh/mikaylagawarecki/331/orig -> origin/gh/mikaylagawarecki/331/orig 2025-09-07T06:39:15.3101390Z * [new branch] gh/mikaylagawarecki/332/base -> origin/gh/mikaylagawarecki/332/base 2025-09-07T06:39:15.3101481Z * [new branch] gh/mikaylagawarecki/332/head -> origin/gh/mikaylagawarecki/332/head 2025-09-07T06:39:15.3102524Z * [new branch] gh/mikaylagawarecki/332/orig -> origin/gh/mikaylagawarecki/332/orig 2025-09-07T06:39:15.3102619Z * [new branch] gh/mikaylagawarecki/334/base -> origin/gh/mikaylagawarecki/334/base 2025-09-07T06:39:15.3102709Z * [new branch] gh/mikaylagawarecki/334/head -> origin/gh/mikaylagawarecki/334/head 2025-09-07T06:39:15.3102800Z * [new branch] gh/mikaylagawarecki/334/orig -> origin/gh/mikaylagawarecki/334/orig 2025-09-07T06:39:15.3102889Z * [new branch] gh/mikaylagawarecki/335/base -> origin/gh/mikaylagawarecki/335/base 2025-09-07T06:39:15.3102979Z * [new branch] gh/mikaylagawarecki/335/head -> origin/gh/mikaylagawarecki/335/head 2025-09-07T06:39:15.3103150Z * [new branch] gh/mikaylagawarecki/335/orig -> origin/gh/mikaylagawarecki/335/orig 2025-09-07T06:39:15.3103248Z * [new branch] gh/mikaylagawarecki/336/base -> origin/gh/mikaylagawarecki/336/base 2025-09-07T06:39:15.3103339Z * [new branch] gh/mikaylagawarecki/336/head -> origin/gh/mikaylagawarecki/336/head 2025-09-07T06:39:15.3103430Z * [new branch] gh/mikaylagawarecki/336/orig -> origin/gh/mikaylagawarecki/336/orig 2025-09-07T06:39:15.3103521Z * [new branch] gh/mikaylagawarecki/337/base -> origin/gh/mikaylagawarecki/337/base 2025-09-07T06:39:15.3103610Z * [new branch] gh/mikaylagawarecki/337/head -> origin/gh/mikaylagawarecki/337/head 2025-09-07T06:39:15.3103700Z * [new branch] gh/mikaylagawarecki/337/orig -> origin/gh/mikaylagawarecki/337/orig 2025-09-07T06:39:15.3103791Z * [new branch] gh/mikaylagawarecki/338/base -> origin/gh/mikaylagawarecki/338/base 2025-09-07T06:39:15.3103881Z * [new branch] gh/mikaylagawarecki/338/head -> origin/gh/mikaylagawarecki/338/head 2025-09-07T06:39:15.3103974Z * [new branch] gh/mikaylagawarecki/338/orig -> origin/gh/mikaylagawarecki/338/orig 2025-09-07T06:39:15.3104065Z * [new branch] gh/mikaylagawarecki/339/base -> origin/gh/mikaylagawarecki/339/base 2025-09-07T06:39:15.3104154Z * [new branch] gh/mikaylagawarecki/339/head -> origin/gh/mikaylagawarecki/339/head 2025-09-07T06:39:15.3104307Z * [new branch] gh/mikaylagawarecki/339/orig -> origin/gh/mikaylagawarecki/339/orig 2025-09-07T06:39:15.3104382Z * [new branch] gh/mlazos/1/base -> origin/gh/mlazos/1/base 2025-09-07T06:39:15.3104454Z * [new branch] gh/mlazos/1/head -> origin/gh/mlazos/1/head 2025-09-07T06:39:15.3104525Z * [new branch] gh/mlazos/1/orig -> origin/gh/mlazos/1/orig 2025-09-07T06:39:15.3104599Z * [new branch] gh/mlazos/12/base -> origin/gh/mlazos/12/base 2025-09-07T06:39:15.3104671Z * [new branch] gh/mlazos/12/head -> origin/gh/mlazos/12/head 2025-09-07T06:39:15.3105776Z * [new branch] gh/mlazos/12/orig -> origin/gh/mlazos/12/orig 2025-09-07T06:39:15.3105850Z * [new branch] gh/mlazos/13/base -> origin/gh/mlazos/13/base 2025-09-07T06:39:15.3105924Z * [new branch] gh/mlazos/13/head -> origin/gh/mlazos/13/head 2025-09-07T06:39:15.3105993Z * [new branch] gh/mlazos/13/orig -> origin/gh/mlazos/13/orig 2025-09-07T06:39:15.3106063Z * [new branch] gh/mlazos/14/base -> origin/gh/mlazos/14/base 2025-09-07T06:39:15.3106132Z * [new branch] gh/mlazos/14/head -> origin/gh/mlazos/14/head 2025-09-07T06:39:15.3106202Z * [new branch] gh/mlazos/14/orig -> origin/gh/mlazos/14/orig 2025-09-07T06:39:15.3106272Z * [new branch] gh/mlazos/15/base -> origin/gh/mlazos/15/base 2025-09-07T06:39:15.3106341Z * [new branch] gh/mlazos/15/head -> origin/gh/mlazos/15/head 2025-09-07T06:39:15.3106416Z * [new branch] gh/mlazos/15/orig -> origin/gh/mlazos/15/orig 2025-09-07T06:39:15.3106486Z * [new branch] gh/mlazos/16/base -> origin/gh/mlazos/16/base 2025-09-07T06:39:15.3106556Z * [new branch] gh/mlazos/16/head -> origin/gh/mlazos/16/head 2025-09-07T06:39:15.3106625Z * [new branch] gh/mlazos/16/orig -> origin/gh/mlazos/16/orig 2025-09-07T06:39:15.3106695Z * [new branch] gh/mlazos/17/base -> origin/gh/mlazos/17/base 2025-09-07T06:39:15.3106765Z * [new branch] gh/mlazos/17/head -> origin/gh/mlazos/17/head 2025-09-07T06:39:15.3106834Z * [new branch] gh/mlazos/17/orig -> origin/gh/mlazos/17/orig 2025-09-07T06:39:15.3106903Z * [new branch] gh/mlazos/2/base -> origin/gh/mlazos/2/base 2025-09-07T06:39:15.3106974Z * [new branch] gh/mlazos/2/head -> origin/gh/mlazos/2/head 2025-09-07T06:39:15.3107044Z * [new branch] gh/mlazos/2/orig -> origin/gh/mlazos/2/orig 2025-09-07T06:39:15.3107113Z * [new branch] gh/mlazos/3/base -> origin/gh/mlazos/3/base 2025-09-07T06:39:15.3107185Z * [new branch] gh/mlazos/3/head -> origin/gh/mlazos/3/head 2025-09-07T06:39:15.3107253Z * [new branch] gh/mlazos/3/orig -> origin/gh/mlazos/3/orig 2025-09-07T06:39:15.3107327Z * [new branch] gh/mrmiywj/1/base -> origin/gh/mrmiywj/1/base 2025-09-07T06:39:15.3107399Z * [new branch] gh/mrmiywj/1/head -> origin/gh/mrmiywj/1/head 2025-09-07T06:39:15.3108436Z * [new branch] gh/muchulee8/62/base -> origin/gh/muchulee8/62/base 2025-09-07T06:39:15.3108516Z * [new branch] gh/muchulee8/62/head -> origin/gh/muchulee8/62/head 2025-09-07T06:39:15.3108593Z * [new branch] gh/muchulee8/62/orig -> origin/gh/muchulee8/62/orig 2025-09-07T06:39:15.3108669Z * [new branch] gh/muchulee8/63/base -> origin/gh/muchulee8/63/base 2025-09-07T06:39:15.3108743Z * [new branch] gh/muchulee8/63/head -> origin/gh/muchulee8/63/head 2025-09-07T06:39:15.3108854Z * [new branch] gh/muchulee8/63/orig -> origin/gh/muchulee8/63/orig 2025-09-07T06:39:15.3108928Z * [new branch] gh/muchulee8/64/base -> origin/gh/muchulee8/64/base 2025-09-07T06:39:15.3109001Z * [new branch] gh/muchulee8/64/head -> origin/gh/muchulee8/64/head 2025-09-07T06:39:15.3109076Z * [new branch] gh/muchulee8/64/orig -> origin/gh/muchulee8/64/orig 2025-09-07T06:39:15.3109149Z * [new branch] gh/muchulee8/65/base -> origin/gh/muchulee8/65/base 2025-09-07T06:39:15.3109223Z * [new branch] gh/muchulee8/65/head -> origin/gh/muchulee8/65/head 2025-09-07T06:39:15.3109297Z * [new branch] gh/muchulee8/65/orig -> origin/gh/muchulee8/65/orig 2025-09-07T06:39:15.3109418Z * [new branch] gh/naveenthangudu/1/base -> origin/gh/naveenthangudu/1/base 2025-09-07T06:39:15.3109504Z * [new branch] gh/naveenthangudu/1/head -> origin/gh/naveenthangudu/1/head 2025-09-07T06:39:15.3109591Z * [new branch] gh/naveenthangudu/1/orig -> origin/gh/naveenthangudu/1/orig 2025-09-07T06:39:15.3109675Z * [new branch] gh/naveenthangudu/2/base -> origin/gh/naveenthangudu/2/base 2025-09-07T06:39:15.3109758Z * [new branch] gh/naveenthangudu/2/head -> origin/gh/naveenthangudu/2/head 2025-09-07T06:39:15.3109841Z * [new branch] gh/naveenthangudu/2/orig -> origin/gh/naveenthangudu/2/orig 2025-09-07T06:39:15.3109923Z * [new branch] gh/naveenthangudu/3/base -> origin/gh/naveenthangudu/3/base 2025-09-07T06:39:15.3110005Z * [new branch] gh/naveenthangudu/3/head -> origin/gh/naveenthangudu/3/head 2025-09-07T06:39:15.3110091Z * [new branch] gh/naveenthangudu/3/orig -> origin/gh/naveenthangudu/3/orig 2025-09-07T06:39:15.3110174Z * [new branch] gh/naveenthangudu/4/base -> origin/gh/naveenthangudu/4/base 2025-09-07T06:39:15.3110258Z * [new branch] gh/naveenthangudu/4/head -> origin/gh/naveenthangudu/4/head 2025-09-07T06:39:15.3110340Z * [new branch] gh/naveenthangudu/4/orig -> origin/gh/naveenthangudu/4/orig 2025-09-07T06:39:15.3111369Z * [new branch] gh/naveenthangudu/5/base -> origin/gh/naveenthangudu/5/base 2025-09-07T06:39:15.3111455Z * [new branch] gh/naveenthangudu/5/head -> origin/gh/naveenthangudu/5/head 2025-09-07T06:39:15.3111538Z * [new branch] gh/naveenthangudu/5/orig -> origin/gh/naveenthangudu/5/orig 2025-09-07T06:39:15.3111620Z * [new branch] gh/naveenthangudu/6/base -> origin/gh/naveenthangudu/6/base 2025-09-07T06:39:15.3111702Z * [new branch] gh/naveenthangudu/6/head -> origin/gh/naveenthangudu/6/head 2025-09-07T06:39:15.3111789Z * [new branch] gh/naveenthangudu/6/orig -> origin/gh/naveenthangudu/6/orig 2025-09-07T06:39:15.3111862Z * [new branch] gh/oulgen/35/base -> origin/gh/oulgen/35/base 2025-09-07T06:39:15.3111936Z * [new branch] gh/oulgen/35/head -> origin/gh/oulgen/35/head 2025-09-07T06:39:15.3112006Z * [new branch] gh/oulgen/35/orig -> origin/gh/oulgen/35/orig 2025-09-07T06:39:15.3112077Z * [new branch] gh/oulgen/48/base -> origin/gh/oulgen/48/base 2025-09-07T06:39:15.3112147Z * [new branch] gh/oulgen/48/head -> origin/gh/oulgen/48/head 2025-09-07T06:39:15.3112216Z * [new branch] gh/oulgen/48/orig -> origin/gh/oulgen/48/orig 2025-09-07T06:39:15.3112286Z * [new branch] gh/oulgen/49/base -> origin/gh/oulgen/49/base 2025-09-07T06:39:15.3112356Z * [new branch] gh/oulgen/49/head -> origin/gh/oulgen/49/head 2025-09-07T06:39:15.3112426Z * [new branch] gh/oulgen/49/orig -> origin/gh/oulgen/49/orig 2025-09-07T06:39:15.3112498Z * [new branch] gh/pearu/108/base -> origin/gh/pearu/108/base 2025-09-07T06:39:15.3112610Z * [new branch] gh/pearu/108/head -> origin/gh/pearu/108/head 2025-09-07T06:39:15.3112681Z * [new branch] gh/pearu/108/orig -> origin/gh/pearu/108/orig 2025-09-07T06:39:15.3112752Z * [new branch] gh/pearu/109/base -> origin/gh/pearu/109/base 2025-09-07T06:39:15.3112821Z * [new branch] gh/pearu/109/head -> origin/gh/pearu/109/head 2025-09-07T06:39:15.3112890Z * [new branch] gh/pearu/109/orig -> origin/gh/pearu/109/orig 2025-09-07T06:39:15.3112960Z * [new branch] gh/pearu/110/base -> origin/gh/pearu/110/base 2025-09-07T06:39:15.3113030Z * [new branch] gh/pearu/110/head -> origin/gh/pearu/110/head 2025-09-07T06:39:15.3113202Z * [new branch] gh/pearu/110/orig -> origin/gh/pearu/110/orig 2025-09-07T06:39:15.3114238Z * [new branch] gh/pearu/111/base -> origin/gh/pearu/111/base 2025-09-07T06:39:15.3114313Z * [new branch] gh/pearu/111/head -> origin/gh/pearu/111/head 2025-09-07T06:39:15.3114382Z * [new branch] gh/pearu/111/orig -> origin/gh/pearu/111/orig 2025-09-07T06:39:15.3114453Z * [new branch] gh/pearu/112/base -> origin/gh/pearu/112/base 2025-09-07T06:39:15.3114523Z * [new branch] gh/pearu/112/head -> origin/gh/pearu/112/head 2025-09-07T06:39:15.3114593Z * [new branch] gh/pearu/112/orig -> origin/gh/pearu/112/orig 2025-09-07T06:39:15.3114662Z * [new branch] gh/pearu/113/base -> origin/gh/pearu/113/base 2025-09-07T06:39:15.3114733Z * [new branch] gh/pearu/113/head -> origin/gh/pearu/113/head 2025-09-07T06:39:15.3114808Z * [new branch] gh/pearu/113/orig -> origin/gh/pearu/113/orig 2025-09-07T06:39:15.3114877Z * [new branch] gh/pearu/114/base -> origin/gh/pearu/114/base 2025-09-07T06:39:15.3114949Z * [new branch] gh/pearu/114/head -> origin/gh/pearu/114/head 2025-09-07T06:39:15.3115019Z * [new branch] gh/pearu/114/orig -> origin/gh/pearu/114/orig 2025-09-07T06:39:15.3115088Z * [new branch] gh/pearu/115/base -> origin/gh/pearu/115/base 2025-09-07T06:39:15.3115159Z * [new branch] gh/pearu/115/head -> origin/gh/pearu/115/head 2025-09-07T06:39:15.3115229Z * [new branch] gh/pearu/115/orig -> origin/gh/pearu/115/orig 2025-09-07T06:39:15.3115298Z * [new branch] gh/pearu/116/base -> origin/gh/pearu/116/base 2025-09-07T06:39:15.3115370Z * [new branch] gh/pearu/116/head -> origin/gh/pearu/116/head 2025-09-07T06:39:15.3115440Z * [new branch] gh/pearu/116/orig -> origin/gh/pearu/116/orig 2025-09-07T06:39:15.3115509Z * [new branch] gh/pearu/117/base -> origin/gh/pearu/117/base 2025-09-07T06:39:15.3115581Z * [new branch] gh/pearu/117/head -> origin/gh/pearu/117/head 2025-09-07T06:39:15.3115651Z * [new branch] gh/pearu/117/orig -> origin/gh/pearu/117/orig 2025-09-07T06:39:15.3115721Z * [new branch] gh/pearu/56/base -> origin/gh/pearu/56/base 2025-09-07T06:39:15.3115793Z * [new branch] gh/pearu/56/head -> origin/gh/pearu/56/head 2025-09-07T06:39:15.3115862Z * [new branch] gh/pearu/56/orig -> origin/gh/pearu/56/orig 2025-09-07T06:39:15.3115931Z * [new branch] gh/pearu/97/base -> origin/gh/pearu/97/base 2025-09-07T06:39:15.3116949Z * [new branch] gh/pearu/97/head -> origin/gh/pearu/97/head 2025-09-07T06:39:15.3117023Z * [new branch] gh/pearu/97/orig -> origin/gh/pearu/97/orig 2025-09-07T06:39:15.3117094Z * [new branch] gh/qqaatw/29/base -> origin/gh/qqaatw/29/base 2025-09-07T06:39:15.3117234Z * [new branch] gh/qqaatw/29/head -> origin/gh/qqaatw/29/head 2025-09-07T06:39:15.3117304Z * [new branch] gh/qqaatw/29/orig -> origin/gh/qqaatw/29/orig 2025-09-07T06:39:15.3117394Z * [new branch] gh/raymo/refresh-script -> origin/gh/raymo/refresh-script 2025-09-07T06:39:15.3117465Z * [new branch] gh/rec/141/base -> origin/gh/rec/141/base 2025-09-07T06:39:15.3117534Z * [new branch] gh/rec/141/head -> origin/gh/rec/141/head 2025-09-07T06:39:15.3117601Z * [new branch] gh/rec/153/base -> origin/gh/rec/153/base 2025-09-07T06:39:15.3117667Z * [new branch] gh/rec/153/head -> origin/gh/rec/153/head 2025-09-07T06:39:15.3117799Z * [new branch] gh/rec/153/orig -> origin/gh/rec/153/orig 2025-09-07T06:39:15.3117865Z * [new branch] gh/rec/154/base -> origin/gh/rec/154/base 2025-09-07T06:39:15.3117932Z * [new branch] gh/rec/154/head -> origin/gh/rec/154/head 2025-09-07T06:39:15.3117999Z * [new branch] gh/rec/154/orig -> origin/gh/rec/154/orig 2025-09-07T06:39:15.3118065Z * [new branch] gh/rec/156/base -> origin/gh/rec/156/base 2025-09-07T06:39:15.3118131Z * [new branch] gh/rec/156/head -> origin/gh/rec/156/head 2025-09-07T06:39:15.3118197Z * [new branch] gh/rec/156/orig -> origin/gh/rec/156/orig 2025-09-07T06:39:15.3118264Z * [new branch] gh/rec/160/base -> origin/gh/rec/160/base 2025-09-07T06:39:15.3118329Z * [new branch] gh/rec/160/head -> origin/gh/rec/160/head 2025-09-07T06:39:15.3118398Z * [new branch] gh/rec/160/orig -> origin/gh/rec/160/orig 2025-09-07T06:39:15.3118464Z * [new branch] gh/rec/162/base -> origin/gh/rec/162/base 2025-09-07T06:39:15.3118531Z * [new branch] gh/rec/162/head -> origin/gh/rec/162/head 2025-09-07T06:39:15.3118598Z * [new branch] gh/rec/162/orig -> origin/gh/rec/162/orig 2025-09-07T06:39:15.3118663Z * [new branch] gh/rec/163/base -> origin/gh/rec/163/base 2025-09-07T06:39:15.3119679Z * [new branch] gh/rec/163/head -> origin/gh/rec/163/head 2025-09-07T06:39:15.3119749Z * [new branch] gh/rec/163/orig -> origin/gh/rec/163/orig 2025-09-07T06:39:15.3119814Z * [new branch] gh/rec/164/base -> origin/gh/rec/164/base 2025-09-07T06:39:15.3119880Z * [new branch] gh/rec/164/head -> origin/gh/rec/164/head 2025-09-07T06:39:15.3119951Z * [new branch] gh/rec/164/orig -> origin/gh/rec/164/orig 2025-09-07T06:39:15.3120017Z * [new branch] gh/rec/165/base -> origin/gh/rec/165/base 2025-09-07T06:39:15.3120084Z * [new branch] gh/rec/165/head -> origin/gh/rec/165/head 2025-09-07T06:39:15.3120151Z * [new branch] gh/rec/165/orig -> origin/gh/rec/165/orig 2025-09-07T06:39:15.3120216Z * [new branch] gh/rec/166/base -> origin/gh/rec/166/base 2025-09-07T06:39:15.3120281Z * [new branch] gh/rec/166/head -> origin/gh/rec/166/head 2025-09-07T06:39:15.3120347Z * [new branch] gh/rec/166/orig -> origin/gh/rec/166/orig 2025-09-07T06:39:15.3120439Z * [new branch] gh/robert-hardwick/1/base -> origin/gh/robert-hardwick/1/base 2025-09-07T06:39:15.3120527Z * [new branch] gh/robert-hardwick/1/head -> origin/gh/robert-hardwick/1/head 2025-09-07T06:39:15.3120615Z * [new branch] gh/robert-hardwick/1/orig -> origin/gh/robert-hardwick/1/orig 2025-09-07T06:39:15.3120701Z * [new branch] gh/robert-hardwick/2/base -> origin/gh/robert-hardwick/2/base 2025-09-07T06:39:15.3120829Z * [new branch] gh/robert-hardwick/2/head -> origin/gh/robert-hardwick/2/head 2025-09-07T06:39:15.3120914Z * [new branch] gh/robert-hardwick/2/orig -> origin/gh/robert-hardwick/2/orig 2025-09-07T06:39:15.3120998Z * [new branch] gh/robert-hardwick/3/base -> origin/gh/robert-hardwick/3/base 2025-09-07T06:39:15.3121082Z * [new branch] gh/robert-hardwick/3/head -> origin/gh/robert-hardwick/3/head 2025-09-07T06:39:15.3121166Z * [new branch] gh/robert-hardwick/3/orig -> origin/gh/robert-hardwick/3/orig 2025-09-07T06:39:15.3121251Z * [new branch] gh/robert-hardwick/4/base -> origin/gh/robert-hardwick/4/base 2025-09-07T06:39:15.3121375Z * [new branch] gh/robert-hardwick/4/head -> origin/gh/robert-hardwick/4/head 2025-09-07T06:39:15.3121458Z * [new branch] gh/robert-hardwick/4/orig -> origin/gh/robert-hardwick/4/orig 2025-09-07T06:39:15.3121532Z * [new branch] gh/rtimpe/1/base -> origin/gh/rtimpe/1/base 2025-09-07T06:39:15.3122550Z * [new branch] gh/rtimpe/1/head -> origin/gh/rtimpe/1/head 2025-09-07T06:39:15.3122625Z * [new branch] gh/rtimpe/10/base -> origin/gh/rtimpe/10/base 2025-09-07T06:39:15.3122698Z * [new branch] gh/rtimpe/10/head -> origin/gh/rtimpe/10/head 2025-09-07T06:39:15.3122769Z * [new branch] gh/rtimpe/10/orig -> origin/gh/rtimpe/10/orig 2025-09-07T06:39:15.3122839Z * [new branch] gh/rtimpe/11/base -> origin/gh/rtimpe/11/base 2025-09-07T06:39:15.3122910Z * [new branch] gh/rtimpe/11/head -> origin/gh/rtimpe/11/head 2025-09-07T06:39:15.3122984Z * [new branch] gh/rtimpe/11/orig -> origin/gh/rtimpe/11/orig 2025-09-07T06:39:15.3123054Z * [new branch] gh/rtimpe/12/base -> origin/gh/rtimpe/12/base 2025-09-07T06:39:15.3123198Z * [new branch] gh/rtimpe/12/head -> origin/gh/rtimpe/12/head 2025-09-07T06:39:15.3123270Z * [new branch] gh/rtimpe/12/orig -> origin/gh/rtimpe/12/orig 2025-09-07T06:39:15.3123340Z * [new branch] gh/rtimpe/13/base -> origin/gh/rtimpe/13/base 2025-09-07T06:39:15.3123411Z * [new branch] gh/rtimpe/13/head -> origin/gh/rtimpe/13/head 2025-09-07T06:39:15.3123481Z * [new branch] gh/rtimpe/13/orig -> origin/gh/rtimpe/13/orig 2025-09-07T06:39:15.3123551Z * [new branch] gh/rtimpe/14/base -> origin/gh/rtimpe/14/base 2025-09-07T06:39:15.3123621Z * [new branch] gh/rtimpe/14/head -> origin/gh/rtimpe/14/head 2025-09-07T06:39:15.3123696Z * [new branch] gh/rtimpe/14/orig -> origin/gh/rtimpe/14/orig 2025-09-07T06:39:15.3123765Z * [new branch] gh/rtimpe/15/base -> origin/gh/rtimpe/15/base 2025-09-07T06:39:15.3123836Z * [new branch] gh/rtimpe/15/head -> origin/gh/rtimpe/15/head 2025-09-07T06:39:15.3123906Z * [new branch] gh/rtimpe/15/orig -> origin/gh/rtimpe/15/orig 2025-09-07T06:39:15.3123975Z * [new branch] gh/rtimpe/2/base -> origin/gh/rtimpe/2/base 2025-09-07T06:39:15.3124045Z * [new branch] gh/rtimpe/2/head -> origin/gh/rtimpe/2/head 2025-09-07T06:39:15.3124115Z * [new branch] gh/rtimpe/3/base -> origin/gh/rtimpe/3/base 2025-09-07T06:39:15.3124184Z * [new branch] gh/rtimpe/3/head -> origin/gh/rtimpe/3/head 2025-09-07T06:39:15.3124252Z * [new branch] gh/rtimpe/4/base -> origin/gh/rtimpe/4/base 2025-09-07T06:39:15.3125284Z * [new branch] gh/rtimpe/4/head -> origin/gh/rtimpe/4/head 2025-09-07T06:39:15.3125355Z * [new branch] gh/rtimpe/9/base -> origin/gh/rtimpe/9/base 2025-09-07T06:39:15.3125489Z * [new branch] gh/rtimpe/9/head -> origin/gh/rtimpe/9/head 2025-09-07T06:39:15.3125559Z * [new branch] gh/rtimpe/9/orig -> origin/gh/rtimpe/9/orig 2025-09-07T06:39:15.3125645Z * [new branch] gh/ruisizhang123/1/base -> origin/gh/ruisizhang123/1/base 2025-09-07T06:39:15.3125727Z * [new branch] gh/ruisizhang123/1/head -> origin/gh/ruisizhang123/1/head 2025-09-07T06:39:15.3125808Z * [new branch] gh/ruisizhang123/1/orig -> origin/gh/ruisizhang123/1/orig 2025-09-07T06:39:15.3125887Z * [new branch] gh/ruisizhang123/4/base -> origin/gh/ruisizhang123/4/base 2025-09-07T06:39:15.3125966Z * [new branch] gh/ruisizhang123/4/head -> origin/gh/ruisizhang123/4/head 2025-09-07T06:39:15.3126107Z * [new branch] gh/ruisizhang123/4/orig -> origin/gh/ruisizhang123/4/orig 2025-09-07T06:39:15.3126186Z * [new branch] gh/ruisizhang123/5/base -> origin/gh/ruisizhang123/5/base 2025-09-07T06:39:15.3126266Z * [new branch] gh/ruisizhang123/5/head -> origin/gh/ruisizhang123/5/head 2025-09-07T06:39:15.3126345Z * [new branch] gh/ruisizhang123/5/orig -> origin/gh/ruisizhang123/5/orig 2025-09-07T06:39:15.3126423Z * [new branch] gh/ruisizhang123/6/base -> origin/gh/ruisizhang123/6/base 2025-09-07T06:39:15.3126501Z * [new branch] gh/ruisizhang123/6/head -> origin/gh/ruisizhang123/6/head 2025-09-07T06:39:15.3126580Z * [new branch] gh/ruisizhang123/6/orig -> origin/gh/ruisizhang123/6/orig 2025-09-07T06:39:15.3126659Z * [new branch] gh/ruisizhang123/7/base -> origin/gh/ruisizhang123/7/base 2025-09-07T06:39:15.3126738Z * [new branch] gh/ruisizhang123/7/head -> origin/gh/ruisizhang123/7/head 2025-09-07T06:39:15.3126818Z * [new branch] gh/ruisizhang123/7/orig -> origin/gh/ruisizhang123/7/orig 2025-09-07T06:39:15.3126897Z * [new branch] gh/ruisizhang123/8/base -> origin/gh/ruisizhang123/8/base 2025-09-07T06:39:15.3126978Z * [new branch] gh/ruisizhang123/8/head -> origin/gh/ruisizhang123/8/head 2025-09-07T06:39:15.3127057Z * [new branch] gh/ruisizhang123/8/orig -> origin/gh/ruisizhang123/8/orig 2025-09-07T06:39:15.3127136Z * [new branch] gh/ruisizhang123/9/base -> origin/gh/ruisizhang123/9/base 2025-09-07T06:39:15.3127215Z * [new branch] gh/ruisizhang123/9/head -> origin/gh/ruisizhang123/9/head 2025-09-07T06:39:15.3128253Z * [new branch] gh/ruisizhang123/9/orig -> origin/gh/ruisizhang123/9/orig 2025-09-07T06:39:15.3128899Z * [new branch] gh/sarckk/2/base -> origin/gh/sarckk/2/base 2025-09-07T06:39:15.3128973Z * [new branch] gh/sarckk/2/head -> origin/gh/sarckk/2/head 2025-09-07T06:39:15.3129043Z * [new branch] gh/sarckk/2/orig -> origin/gh/sarckk/2/orig 2025-09-07T06:39:15.3129125Z * [new branch] gh/seemethere/35/base -> origin/gh/seemethere/35/base 2025-09-07T06:39:15.3129204Z * [new branch] gh/seemethere/35/head -> origin/gh/seemethere/35/head 2025-09-07T06:39:15.3129281Z * [new branch] gh/seemethere/35/orig -> origin/gh/seemethere/35/orig 2025-09-07T06:39:15.3129359Z * [new branch] gh/seemethere/37/base -> origin/gh/seemethere/37/base 2025-09-07T06:39:15.3129436Z * [new branch] gh/seemethere/37/head -> origin/gh/seemethere/37/head 2025-09-07T06:39:15.3129512Z * [new branch] gh/seemethere/37/orig -> origin/gh/seemethere/37/orig 2025-09-07T06:39:15.3129589Z * [new branch] gh/seemethere/43/base -> origin/gh/seemethere/43/base 2025-09-07T06:39:15.3129667Z * [new branch] gh/seemethere/43/head -> origin/gh/seemethere/43/head 2025-09-07T06:39:15.3129744Z * [new branch] gh/seemethere/43/orig -> origin/gh/seemethere/43/orig 2025-09-07T06:39:15.3129860Z * [new branch] gh/seemethere/44/base -> origin/gh/seemethere/44/base 2025-09-07T06:39:15.3129937Z * [new branch] gh/seemethere/44/head -> origin/gh/seemethere/44/head 2025-09-07T06:39:15.3130013Z * [new branch] gh/seemethere/44/orig -> origin/gh/seemethere/44/orig 2025-09-07T06:39:15.3130090Z * [new branch] gh/seemethere/48/base -> origin/gh/seemethere/48/base 2025-09-07T06:39:15.3130166Z * [new branch] gh/seemethere/48/head -> origin/gh/seemethere/48/head 2025-09-07T06:39:15.3130241Z * [new branch] gh/seemethere/48/orig -> origin/gh/seemethere/48/orig 2025-09-07T06:39:15.3130353Z * [new branch] gh/seemethere/49/base -> origin/gh/seemethere/49/base 2025-09-07T06:39:15.3130429Z * [new branch] gh/seemethere/49/head -> origin/gh/seemethere/49/head 2025-09-07T06:39:15.3130505Z * [new branch] gh/seemethere/49/orig -> origin/gh/seemethere/49/orig 2025-09-07T06:39:15.3130584Z * [new branch] gh/seemethere/52/base -> origin/gh/seemethere/52/base 2025-09-07T06:39:15.3130660Z * [new branch] gh/seemethere/52/head -> origin/gh/seemethere/52/head 2025-09-07T06:39:15.3130736Z * [new branch] gh/seemethere/52/orig -> origin/gh/seemethere/52/orig 2025-09-07T06:39:15.3131815Z * [new branch] gh/seemethere/53/base -> origin/gh/seemethere/53/base 2025-09-07T06:39:15.3131895Z * [new branch] gh/seemethere/53/head -> origin/gh/seemethere/53/head 2025-09-07T06:39:15.3131971Z * [new branch] gh/seemethere/53/orig -> origin/gh/seemethere/53/orig 2025-09-07T06:39:15.3132053Z * [new branch] gh/seemethere/54/base -> origin/gh/seemethere/54/base 2025-09-07T06:39:15.3132130Z * [new branch] gh/seemethere/54/head -> origin/gh/seemethere/54/head 2025-09-07T06:39:15.3132208Z * [new branch] gh/seemethere/54/orig -> origin/gh/seemethere/54/orig 2025-09-07T06:39:15.3132285Z * [new branch] gh/seemethere/55/base -> origin/gh/seemethere/55/base 2025-09-07T06:39:15.3132362Z * [new branch] gh/seemethere/55/head -> origin/gh/seemethere/55/head 2025-09-07T06:39:15.3132438Z * [new branch] gh/seemethere/55/orig -> origin/gh/seemethere/55/orig 2025-09-07T06:39:15.3132515Z * [new branch] gh/seemethere/56/base -> origin/gh/seemethere/56/base 2025-09-07T06:39:15.3132591Z * [new branch] gh/seemethere/56/head -> origin/gh/seemethere/56/head 2025-09-07T06:39:15.3132667Z * [new branch] gh/seemethere/56/orig -> origin/gh/seemethere/56/orig 2025-09-07T06:39:15.3132744Z * [new branch] gh/seemethere/57/base -> origin/gh/seemethere/57/base 2025-09-07T06:39:15.3132821Z * [new branch] gh/seemethere/57/head -> origin/gh/seemethere/57/head 2025-09-07T06:39:15.3132898Z * [new branch] gh/seemethere/57/orig -> origin/gh/seemethere/57/orig 2025-09-07T06:39:15.3132974Z * [new branch] gh/seemethere/58/base -> origin/gh/seemethere/58/base 2025-09-07T06:39:15.3133051Z * [new branch] gh/seemethere/58/head -> origin/gh/seemethere/58/head 2025-09-07T06:39:15.3133186Z * [new branch] gh/seemethere/58/orig -> origin/gh/seemethere/58/orig 2025-09-07T06:39:15.3133265Z * [new branch] gh/seemethere/59/base -> origin/gh/seemethere/59/base 2025-09-07T06:39:15.3133342Z * [new branch] gh/seemethere/59/head -> origin/gh/seemethere/59/head 2025-09-07T06:39:15.3133420Z * [new branch] gh/seemethere/59/orig -> origin/gh/seemethere/59/orig 2025-09-07T06:39:15.3133496Z * [new branch] gh/seemethere/60/base -> origin/gh/seemethere/60/base 2025-09-07T06:39:15.3133573Z * [new branch] gh/seemethere/60/head -> origin/gh/seemethere/60/head 2025-09-07T06:39:15.3133721Z * [new branch] gh/seemethere/60/orig -> origin/gh/seemethere/60/orig 2025-09-07T06:39:15.3134766Z * [new branch] gh/seemethere/61/base -> origin/gh/seemethere/61/base 2025-09-07T06:39:15.3134849Z * [new branch] gh/seemethere/61/head -> origin/gh/seemethere/61/head 2025-09-07T06:39:15.3134926Z * [new branch] gh/seemethere/61/orig -> origin/gh/seemethere/61/orig 2025-09-07T06:39:15.3135002Z * [new branch] gh/seemethere/62/base -> origin/gh/seemethere/62/base 2025-09-07T06:39:15.3135080Z * [new branch] gh/seemethere/62/head -> origin/gh/seemethere/62/head 2025-09-07T06:39:15.3135216Z * [new branch] gh/seemethere/62/orig -> origin/gh/seemethere/62/orig 2025-09-07T06:39:15.3135292Z * [new branch] gh/seemethere/63/base -> origin/gh/seemethere/63/base 2025-09-07T06:39:15.3135373Z * [new branch] gh/seemethere/63/head -> origin/gh/seemethere/63/head 2025-09-07T06:39:15.3135449Z * [new branch] gh/seemethere/63/orig -> origin/gh/seemethere/63/orig 2025-09-07T06:39:15.3135531Z * [new branch] gh/shunting314/145/base -> origin/gh/shunting314/145/base 2025-09-07T06:39:15.3135611Z * [new branch] gh/shunting314/145/head -> origin/gh/shunting314/145/head 2025-09-07T06:39:15.3135690Z * [new branch] gh/shunting314/145/orig -> origin/gh/shunting314/145/orig 2025-09-07T06:39:15.3135768Z * [new branch] gh/shunting314/176/base -> origin/gh/shunting314/176/base 2025-09-07T06:39:15.3135847Z * [new branch] gh/shunting314/176/head -> origin/gh/shunting314/176/head 2025-09-07T06:39:15.3135927Z * [new branch] gh/shunting314/176/orig -> origin/gh/shunting314/176/orig 2025-09-07T06:39:15.3136005Z * [new branch] gh/shunting314/211/base -> origin/gh/shunting314/211/base 2025-09-07T06:39:15.3136084Z * [new branch] gh/shunting314/211/head -> origin/gh/shunting314/211/head 2025-09-07T06:39:15.3136163Z * [new branch] gh/shunting314/211/orig -> origin/gh/shunting314/211/orig 2025-09-07T06:39:15.3136241Z * [new branch] gh/shunting314/212/base -> origin/gh/shunting314/212/base 2025-09-07T06:39:15.3136319Z * [new branch] gh/shunting314/212/head -> origin/gh/shunting314/212/head 2025-09-07T06:39:15.3136398Z * [new branch] gh/shunting314/212/orig -> origin/gh/shunting314/212/orig 2025-09-07T06:39:15.3136476Z * [new branch] gh/shunting314/213/base -> origin/gh/shunting314/213/base 2025-09-07T06:39:15.3136557Z * [new branch] gh/shunting314/213/head -> origin/gh/shunting314/213/head 2025-09-07T06:39:15.3136636Z * [new branch] gh/shunting314/213/orig -> origin/gh/shunting314/213/orig 2025-09-07T06:39:15.3137666Z * [new branch] gh/shunting314/214/base -> origin/gh/shunting314/214/base 2025-09-07T06:39:15.3137748Z * [new branch] gh/shunting314/214/head -> origin/gh/shunting314/214/head 2025-09-07T06:39:15.3137827Z * [new branch] gh/shunting314/214/orig -> origin/gh/shunting314/214/orig 2025-09-07T06:39:15.3137904Z * [new branch] gh/shunting314/215/base -> origin/gh/shunting314/215/base 2025-09-07T06:39:15.3137982Z * [new branch] gh/shunting314/215/head -> origin/gh/shunting314/215/head 2025-09-07T06:39:15.3138061Z * [new branch] gh/shunting314/215/orig -> origin/gh/shunting314/215/orig 2025-09-07T06:39:15.3138139Z * [new branch] gh/shunting314/216/base -> origin/gh/shunting314/216/base 2025-09-07T06:39:15.3138222Z * [new branch] gh/shunting314/216/head -> origin/gh/shunting314/216/head 2025-09-07T06:39:15.3138300Z * [new branch] gh/shunting314/216/orig -> origin/gh/shunting314/216/orig 2025-09-07T06:39:15.3138425Z * [new branch] gh/shunting314/217/base -> origin/gh/shunting314/217/base 2025-09-07T06:39:15.3138504Z * [new branch] gh/shunting314/217/head -> origin/gh/shunting314/217/head 2025-09-07T06:39:15.3138582Z * [new branch] gh/shunting314/217/orig -> origin/gh/shunting314/217/orig 2025-09-07T06:39:15.3138660Z * [new branch] gh/shunting314/218/base -> origin/gh/shunting314/218/base 2025-09-07T06:39:15.3138737Z * [new branch] gh/shunting314/218/head -> origin/gh/shunting314/218/head 2025-09-07T06:39:15.3138816Z * [new branch] gh/shunting314/218/orig -> origin/gh/shunting314/218/orig 2025-09-07T06:39:15.3138931Z * [new branch] gh/shunting314/219/base -> origin/gh/shunting314/219/base 2025-09-07T06:39:15.3139009Z * [new branch] gh/shunting314/219/head -> origin/gh/shunting314/219/head 2025-09-07T06:39:15.3139088Z * [new branch] gh/shunting314/219/orig -> origin/gh/shunting314/219/orig 2025-09-07T06:39:15.3139168Z * [new branch] gh/shunting314/220/base -> origin/gh/shunting314/220/base 2025-09-07T06:39:15.3139246Z * [new branch] gh/shunting314/220/head -> origin/gh/shunting314/220/head 2025-09-07T06:39:15.3139324Z * [new branch] gh/shunting314/220/orig -> origin/gh/shunting314/220/orig 2025-09-07T06:39:15.3139402Z * [new branch] gh/shunting314/221/base -> origin/gh/shunting314/221/base 2025-09-07T06:39:15.3139480Z * [new branch] gh/shunting314/221/head -> origin/gh/shunting314/221/head 2025-09-07T06:39:15.3139559Z * [new branch] gh/shunting314/221/orig -> origin/gh/shunting314/221/orig 2025-09-07T06:39:15.3140592Z * [new branch] gh/shunting314/222/base -> origin/gh/shunting314/222/base 2025-09-07T06:39:15.3140673Z * [new branch] gh/shunting314/222/head -> origin/gh/shunting314/222/head 2025-09-07T06:39:15.3140755Z * [new branch] gh/shunting314/222/orig -> origin/gh/shunting314/222/orig 2025-09-07T06:39:15.3140833Z * [new branch] gh/shunting314/223/base -> origin/gh/shunting314/223/base 2025-09-07T06:39:15.3140911Z * [new branch] gh/shunting314/223/head -> origin/gh/shunting314/223/head 2025-09-07T06:39:15.3140990Z * [new branch] gh/shunting314/223/orig -> origin/gh/shunting314/223/orig 2025-09-07T06:39:15.3141070Z * [new branch] gh/silverguo/1/base -> origin/gh/silverguo/1/base 2025-09-07T06:39:15.3141147Z * [new branch] gh/silverguo/1/head -> origin/gh/silverguo/1/head 2025-09-07T06:39:15.3141231Z * [new branch] gh/silverguo/2/base -> origin/gh/silverguo/2/base 2025-09-07T06:39:15.3141308Z * [new branch] gh/silverguo/2/head -> origin/gh/silverguo/2/head 2025-09-07T06:39:15.3141387Z * [new branch] gh/silverguo/3/base -> origin/gh/silverguo/3/base 2025-09-07T06:39:15.3141463Z * [new branch] gh/silverguo/3/head -> origin/gh/silverguo/3/head 2025-09-07T06:39:15.3141539Z * [new branch] gh/silverguo/4/base -> origin/gh/silverguo/4/base 2025-09-07T06:39:15.3141612Z * [new branch] gh/silverguo/4/head -> origin/gh/silverguo/4/head 2025-09-07T06:39:15.3141692Z * [new branch] gh/sinhaanhsul/1/base -> origin/gh/sinhaanhsul/1/base 2025-09-07T06:39:15.3141771Z * [new branch] gh/sinhaanhsul/1/head -> origin/gh/sinhaanhsul/1/head 2025-09-07T06:39:15.3141845Z * [new branch] gh/skarjala/17/base -> origin/gh/skarjala/17/base 2025-09-07T06:39:15.3141921Z * [new branch] gh/skarjala/17/head -> origin/gh/skarjala/17/head 2025-09-07T06:39:15.3141995Z * [new branch] gh/skarjala/17/orig -> origin/gh/skarjala/17/orig 2025-09-07T06:39:15.3142068Z * [new branch] gh/skarjala/18/base -> origin/gh/skarjala/18/base 2025-09-07T06:39:15.3142182Z * [new branch] gh/skarjala/18/head -> origin/gh/skarjala/18/head 2025-09-07T06:39:15.3142257Z * [new branch] gh/skarjala/18/orig -> origin/gh/skarjala/18/orig 2025-09-07T06:39:15.3142332Z * [new branch] gh/skarjala/19/base -> origin/gh/skarjala/19/base 2025-09-07T06:39:15.3142405Z * [new branch] gh/skarjala/19/head -> origin/gh/skarjala/19/head 2025-09-07T06:39:15.3143513Z * [new branch] gh/skarjala/19/orig -> origin/gh/skarjala/19/orig 2025-09-07T06:39:15.3143595Z * [new branch] gh/slayton58/1/base -> origin/gh/slayton58/1/base 2025-09-07T06:39:15.3143727Z * [new branch] gh/slayton58/1/head -> origin/gh/slayton58/1/head 2025-09-07T06:39:15.3143801Z * [new branch] gh/slayton58/1/orig -> origin/gh/slayton58/1/orig 2025-09-07T06:39:15.3143877Z * [new branch] gh/slayton58/2/base -> origin/gh/slayton58/2/base 2025-09-07T06:39:15.3143950Z * [new branch] gh/slayton58/2/head -> origin/gh/slayton58/2/head 2025-09-07T06:39:15.3144024Z * [new branch] gh/slayton58/2/orig -> origin/gh/slayton58/2/orig 2025-09-07T06:39:15.3144097Z * [new branch] gh/slayton58/3/base -> origin/gh/slayton58/3/base 2025-09-07T06:39:15.3144170Z * [new branch] gh/slayton58/3/head -> origin/gh/slayton58/3/head 2025-09-07T06:39:15.3144244Z * [new branch] gh/slayton58/3/orig -> origin/gh/slayton58/3/orig 2025-09-07T06:39:15.3144317Z * [new branch] gh/slayton58/4/base -> origin/gh/slayton58/4/base 2025-09-07T06:39:15.3144395Z * [new branch] gh/slayton58/4/head -> origin/gh/slayton58/4/head 2025-09-07T06:39:15.3144469Z * [new branch] gh/slayton58/4/orig -> origin/gh/slayton58/4/orig 2025-09-07T06:39:15.3144544Z * [new branch] gh/slayton58/5/base -> origin/gh/slayton58/5/base 2025-09-07T06:39:15.3144617Z * [new branch] gh/slayton58/5/head -> origin/gh/slayton58/5/head 2025-09-07T06:39:15.3144691Z * [new branch] gh/slayton58/5/orig -> origin/gh/slayton58/5/orig 2025-09-07T06:39:15.3144769Z * [new branch] gh/soulitzer/269/base -> origin/gh/soulitzer/269/base 2025-09-07T06:39:15.3144846Z * [new branch] gh/soulitzer/269/head -> origin/gh/soulitzer/269/head 2025-09-07T06:39:15.3144924Z * [new branch] gh/soulitzer/269/orig -> origin/gh/soulitzer/269/orig 2025-09-07T06:39:15.3145000Z * [new branch] gh/soulitzer/276/base -> origin/gh/soulitzer/276/base 2025-09-07T06:39:15.3145078Z * [new branch] gh/soulitzer/276/head -> origin/gh/soulitzer/276/head 2025-09-07T06:39:15.3145154Z * [new branch] gh/soulitzer/276/orig -> origin/gh/soulitzer/276/orig 2025-09-07T06:39:15.3145232Z * [new branch] gh/soulitzer/287/base -> origin/gh/soulitzer/287/base 2025-09-07T06:39:15.3145307Z * [new branch] gh/soulitzer/287/head -> origin/gh/soulitzer/287/head 2025-09-07T06:39:15.3145383Z * [new branch] gh/soulitzer/287/orig -> origin/gh/soulitzer/287/orig 2025-09-07T06:39:15.3146438Z * [new branch] gh/soulitzer/296/base -> origin/gh/soulitzer/296/base 2025-09-07T06:39:15.3146514Z * [new branch] gh/soulitzer/296/head -> origin/gh/soulitzer/296/head 2025-09-07T06:39:15.3146590Z * [new branch] gh/soulitzer/296/orig -> origin/gh/soulitzer/296/orig 2025-09-07T06:39:15.3146672Z * [new branch] gh/soulitzer/299/base -> origin/gh/soulitzer/299/base 2025-09-07T06:39:15.3146747Z * [new branch] gh/soulitzer/299/head -> origin/gh/soulitzer/299/head 2025-09-07T06:39:15.3146823Z * [new branch] gh/soulitzer/299/orig -> origin/gh/soulitzer/299/orig 2025-09-07T06:39:15.3146958Z * [new branch] gh/soulitzer/300/base -> origin/gh/soulitzer/300/base 2025-09-07T06:39:15.3147035Z * [new branch] gh/soulitzer/300/head -> origin/gh/soulitzer/300/head 2025-09-07T06:39:15.3147110Z * [new branch] gh/soulitzer/300/orig -> origin/gh/soulitzer/300/orig 2025-09-07T06:39:15.3147186Z * [new branch] gh/soulitzer/301/base -> origin/gh/soulitzer/301/base 2025-09-07T06:39:15.3147262Z * [new branch] gh/soulitzer/301/head -> origin/gh/soulitzer/301/head 2025-09-07T06:39:15.3147338Z * [new branch] gh/soulitzer/301/orig -> origin/gh/soulitzer/301/orig 2025-09-07T06:39:15.3147449Z * [new branch] gh/soulitzer/313/base -> origin/gh/soulitzer/313/base 2025-09-07T06:39:15.3147525Z * [new branch] gh/soulitzer/313/head -> origin/gh/soulitzer/313/head 2025-09-07T06:39:15.3147601Z * [new branch] gh/soulitzer/313/orig -> origin/gh/soulitzer/313/orig 2025-09-07T06:39:15.3147678Z * [new branch] gh/soulitzer/319/base -> origin/gh/soulitzer/319/base 2025-09-07T06:39:15.3147754Z * [new branch] gh/soulitzer/319/head -> origin/gh/soulitzer/319/head 2025-09-07T06:39:15.3147830Z * [new branch] gh/soulitzer/319/orig -> origin/gh/soulitzer/319/orig 2025-09-07T06:39:15.3147907Z * [new branch] gh/soulitzer/320/base -> origin/gh/soulitzer/320/base 2025-09-07T06:39:15.3147982Z * [new branch] gh/soulitzer/320/head -> origin/gh/soulitzer/320/head 2025-09-07T06:39:15.3148058Z * [new branch] gh/soulitzer/320/orig -> origin/gh/soulitzer/320/orig 2025-09-07T06:39:15.3148136Z * [new branch] gh/soulitzer/336/base -> origin/gh/soulitzer/336/base 2025-09-07T06:39:15.3148213Z * [new branch] gh/soulitzer/336/head -> origin/gh/soulitzer/336/head 2025-09-07T06:39:15.3148291Z * [new branch] gh/soulitzer/336/orig -> origin/gh/soulitzer/336/orig 2025-09-07T06:39:15.3149318Z * [new branch] gh/soulitzer/347/base -> origin/gh/soulitzer/347/base 2025-09-07T06:39:15.3149396Z * [new branch] gh/soulitzer/347/head -> origin/gh/soulitzer/347/head 2025-09-07T06:39:15.3149472Z * [new branch] gh/soulitzer/347/orig -> origin/gh/soulitzer/347/orig 2025-09-07T06:39:15.3149548Z * [new branch] gh/soulitzer/349/base -> origin/gh/soulitzer/349/base 2025-09-07T06:39:15.3149624Z * [new branch] gh/soulitzer/349/head -> origin/gh/soulitzer/349/head 2025-09-07T06:39:15.3149705Z * [new branch] gh/soulitzer/349/orig -> origin/gh/soulitzer/349/orig 2025-09-07T06:39:15.3149780Z * [new branch] gh/soulitzer/350/base -> origin/gh/soulitzer/350/base 2025-09-07T06:39:15.3149857Z * [new branch] gh/soulitzer/350/head -> origin/gh/soulitzer/350/head 2025-09-07T06:39:15.3149934Z * [new branch] gh/soulitzer/350/orig -> origin/gh/soulitzer/350/orig 2025-09-07T06:39:15.3150010Z * [new branch] gh/soulitzer/351/base -> origin/gh/soulitzer/351/base 2025-09-07T06:39:15.3150086Z * [new branch] gh/soulitzer/351/head -> origin/gh/soulitzer/351/head 2025-09-07T06:39:15.3150161Z * [new branch] gh/soulitzer/351/orig -> origin/gh/soulitzer/351/orig 2025-09-07T06:39:15.3150237Z * [new branch] gh/soulitzer/353/base -> origin/gh/soulitzer/353/base 2025-09-07T06:39:15.3150314Z * [new branch] gh/soulitzer/353/head -> origin/gh/soulitzer/353/head 2025-09-07T06:39:15.3150391Z * [new branch] gh/soulitzer/353/orig -> origin/gh/soulitzer/353/orig 2025-09-07T06:39:15.3150467Z * [new branch] gh/soulitzer/358/base -> origin/gh/soulitzer/358/base 2025-09-07T06:39:15.3150581Z * [new branch] gh/soulitzer/358/head -> origin/gh/soulitzer/358/head 2025-09-07T06:39:15.3150659Z * [new branch] gh/soulitzer/358/orig -> origin/gh/soulitzer/358/orig 2025-09-07T06:39:15.3150736Z * [new branch] gh/soulitzer/359/base -> origin/gh/soulitzer/359/base 2025-09-07T06:39:15.3150812Z * [new branch] gh/soulitzer/359/head -> origin/gh/soulitzer/359/head 2025-09-07T06:39:15.3150889Z * [new branch] gh/soulitzer/359/orig -> origin/gh/soulitzer/359/orig 2025-09-07T06:39:15.3150964Z * [new branch] gh/soulitzer/362/base -> origin/gh/soulitzer/362/base 2025-09-07T06:39:15.3151043Z * [new branch] gh/soulitzer/362/head -> origin/gh/soulitzer/362/head 2025-09-07T06:39:15.3151152Z * [new branch] gh/soulitzer/362/orig -> origin/gh/soulitzer/362/orig 2025-09-07T06:39:15.3152178Z * [new branch] gh/soulitzer/372/base -> origin/gh/soulitzer/372/base 2025-09-07T06:39:15.3152259Z * [new branch] gh/soulitzer/372/head -> origin/gh/soulitzer/372/head 2025-09-07T06:39:15.3152335Z * [new branch] gh/soulitzer/372/orig -> origin/gh/soulitzer/372/orig 2025-09-07T06:39:15.3152410Z * [new branch] gh/soulitzer/373/base -> origin/gh/soulitzer/373/base 2025-09-07T06:39:15.3152487Z * [new branch] gh/soulitzer/373/head -> origin/gh/soulitzer/373/head 2025-09-07T06:39:15.3152563Z * [new branch] gh/soulitzer/373/orig -> origin/gh/soulitzer/373/orig 2025-09-07T06:39:15.3152639Z * [new branch] gh/soulitzer/374/base -> origin/gh/soulitzer/374/base 2025-09-07T06:39:15.3152721Z * [new branch] gh/soulitzer/374/head -> origin/gh/soulitzer/374/head 2025-09-07T06:39:15.3152797Z * [new branch] gh/soulitzer/374/orig -> origin/gh/soulitzer/374/orig 2025-09-07T06:39:15.3152873Z * [new branch] gh/soulitzer/375/base -> origin/gh/soulitzer/375/base 2025-09-07T06:39:15.3152950Z * [new branch] gh/soulitzer/375/head -> origin/gh/soulitzer/375/head 2025-09-07T06:39:15.3153027Z * [new branch] gh/soulitzer/375/orig -> origin/gh/soulitzer/375/orig 2025-09-07T06:39:15.3153186Z * [new branch] gh/soulitzer/376/base -> origin/gh/soulitzer/376/base 2025-09-07T06:39:15.3153263Z * [new branch] gh/soulitzer/376/head -> origin/gh/soulitzer/376/head 2025-09-07T06:39:15.3153340Z * [new branch] gh/soulitzer/376/orig -> origin/gh/soulitzer/376/orig 2025-09-07T06:39:15.3153416Z * [new branch] gh/soulitzer/377/base -> origin/gh/soulitzer/377/base 2025-09-07T06:39:15.3153493Z * [new branch] gh/soulitzer/377/head -> origin/gh/soulitzer/377/head 2025-09-07T06:39:15.3153570Z * [new branch] gh/soulitzer/377/orig -> origin/gh/soulitzer/377/orig 2025-09-07T06:39:15.3153647Z * [new branch] gh/soulitzer/378/base -> origin/gh/soulitzer/378/base 2025-09-07T06:39:15.3153723Z * [new branch] gh/soulitzer/378/head -> origin/gh/soulitzer/378/head 2025-09-07T06:39:15.3153799Z * [new branch] gh/soulitzer/378/orig -> origin/gh/soulitzer/378/orig 2025-09-07T06:39:15.3153875Z * [new branch] gh/soulitzer/379/base -> origin/gh/soulitzer/379/base 2025-09-07T06:39:15.3153950Z * [new branch] gh/soulitzer/379/head -> origin/gh/soulitzer/379/head 2025-09-07T06:39:15.3154026Z * [new branch] gh/soulitzer/379/orig -> origin/gh/soulitzer/379/orig 2025-09-07T06:39:15.3155057Z * [new branch] gh/swolchok/728/next -> origin/gh/swolchok/728/next 2025-09-07T06:39:15.3155141Z * [new branch] gh/swolchok/767/base -> origin/gh/swolchok/767/base 2025-09-07T06:39:15.3155217Z * [new branch] gh/swolchok/767/head -> origin/gh/swolchok/767/head 2025-09-07T06:39:15.3155370Z * [new branch] gh/swolchok/767/orig -> origin/gh/swolchok/767/orig 2025-09-07T06:39:15.3155446Z * [new branch] gh/swolchok/768/base -> origin/gh/swolchok/768/base 2025-09-07T06:39:15.3155521Z * [new branch] gh/swolchok/768/head -> origin/gh/swolchok/768/head 2025-09-07T06:39:15.3155595Z * [new branch] gh/swolchok/768/orig -> origin/gh/swolchok/768/orig 2025-09-07T06:39:15.3155669Z * [new branch] gh/swolchok/769/base -> origin/gh/swolchok/769/base 2025-09-07T06:39:15.3155743Z * [new branch] gh/swolchok/769/head -> origin/gh/swolchok/769/head 2025-09-07T06:39:15.3155817Z * [new branch] gh/swolchok/769/orig -> origin/gh/swolchok/769/orig 2025-09-07T06:39:15.3155957Z * [new branch] gh/swolchok/771/base -> origin/gh/swolchok/771/base 2025-09-07T06:39:15.3156032Z * [new branch] gh/swolchok/771/head -> origin/gh/swolchok/771/head 2025-09-07T06:39:15.3156107Z * [new branch] gh/swolchok/771/orig -> origin/gh/swolchok/771/orig 2025-09-07T06:39:15.3156181Z * [new branch] gh/swolchok/772/base -> origin/gh/swolchok/772/base 2025-09-07T06:39:15.3156256Z * [new branch] gh/swolchok/772/head -> origin/gh/swolchok/772/head 2025-09-07T06:39:15.3156329Z * [new branch] gh/swolchok/772/orig -> origin/gh/swolchok/772/orig 2025-09-07T06:39:15.3156403Z * [new branch] gh/swolchok/773/base -> origin/gh/swolchok/773/base 2025-09-07T06:39:15.3156477Z * [new branch] gh/swolchok/773/head -> origin/gh/swolchok/773/head 2025-09-07T06:39:15.3156553Z * [new branch] gh/swolchok/773/orig -> origin/gh/swolchok/773/orig 2025-09-07T06:39:15.3156627Z * [new branch] gh/swolchok/786/base -> origin/gh/swolchok/786/base 2025-09-07T06:39:15.3156700Z * [new branch] gh/swolchok/786/head -> origin/gh/swolchok/786/head 2025-09-07T06:39:15.3156776Z * [new branch] gh/swolchok/786/orig -> origin/gh/swolchok/786/orig 2025-09-07T06:39:15.3156850Z * [new branch] gh/swolchok/787/base -> origin/gh/swolchok/787/base 2025-09-07T06:39:15.3156923Z * [new branch] gh/swolchok/787/head -> origin/gh/swolchok/787/head 2025-09-07T06:39:15.3157947Z * [new branch] gh/swolchok/787/orig -> origin/gh/swolchok/787/orig 2025-09-07T06:39:15.3158025Z * [new branch] gh/swolchok/788/base -> origin/gh/swolchok/788/base 2025-09-07T06:39:15.3158099Z * [new branch] gh/swolchok/788/head -> origin/gh/swolchok/788/head 2025-09-07T06:39:15.3158178Z * [new branch] gh/swolchok/788/orig -> origin/gh/swolchok/788/orig 2025-09-07T06:39:15.3158251Z * [new branch] gh/swolchok/789/base -> origin/gh/swolchok/789/base 2025-09-07T06:39:15.3158326Z * [new branch] gh/swolchok/789/head -> origin/gh/swolchok/789/head 2025-09-07T06:39:15.3158401Z * [new branch] gh/swolchok/789/orig -> origin/gh/swolchok/789/orig 2025-09-07T06:39:15.3158474Z * [new branch] gh/swolchok/790/base -> origin/gh/swolchok/790/base 2025-09-07T06:39:15.3158548Z * [new branch] gh/swolchok/790/head -> origin/gh/swolchok/790/head 2025-09-07T06:39:15.3158623Z * [new branch] gh/swolchok/790/orig -> origin/gh/swolchok/790/orig 2025-09-07T06:39:15.3158696Z * [new branch] gh/swolchok/791/base -> origin/gh/swolchok/791/base 2025-09-07T06:39:15.3158770Z * [new branch] gh/swolchok/791/head -> origin/gh/swolchok/791/head 2025-09-07T06:39:15.3158846Z * [new branch] gh/swolchok/791/orig -> origin/gh/swolchok/791/orig 2025-09-07T06:39:15.3158920Z * [new branch] gh/swolchok/792/base -> origin/gh/swolchok/792/base 2025-09-07T06:39:15.3159031Z * [new branch] gh/swolchok/792/head -> origin/gh/swolchok/792/head 2025-09-07T06:39:15.3159107Z * [new branch] gh/swolchok/792/orig -> origin/gh/swolchok/792/orig 2025-09-07T06:39:15.3159181Z * [new branch] gh/swolchok/793/base -> origin/gh/swolchok/793/base 2025-09-07T06:39:15.3159254Z * [new branch] gh/swolchok/793/head -> origin/gh/swolchok/793/head 2025-09-07T06:39:15.3159328Z * [new branch] gh/swolchok/793/orig -> origin/gh/swolchok/793/orig 2025-09-07T06:39:15.3159402Z * [new branch] gh/swolchok/794/base -> origin/gh/swolchok/794/base 2025-09-07T06:39:15.3159476Z * [new branch] gh/swolchok/794/head -> origin/gh/swolchok/794/head 2025-09-07T06:39:15.3159583Z * [new branch] gh/swolchok/794/orig -> origin/gh/swolchok/794/orig 2025-09-07T06:39:15.3159657Z * [new branch] gh/swolchok/795/base -> origin/gh/swolchok/795/base 2025-09-07T06:39:15.3159732Z * [new branch] gh/swolchok/795/head -> origin/gh/swolchok/795/head 2025-09-07T06:39:15.3160760Z * [new branch] gh/swolchok/795/orig -> origin/gh/swolchok/795/orig 2025-09-07T06:39:15.3160837Z * [new branch] gh/swolchok/796/base -> origin/gh/swolchok/796/base 2025-09-07T06:39:15.3160911Z * [new branch] gh/swolchok/796/head -> origin/gh/swolchok/796/head 2025-09-07T06:39:15.3160986Z * [new branch] gh/swolchok/796/orig -> origin/gh/swolchok/796/orig 2025-09-07T06:39:15.3161060Z * [new branch] gh/swolchok/797/base -> origin/gh/swolchok/797/base 2025-09-07T06:39:15.3161137Z * [new branch] gh/swolchok/797/head -> origin/gh/swolchok/797/head 2025-09-07T06:39:15.3161211Z * [new branch] gh/swolchok/797/orig -> origin/gh/swolchok/797/orig 2025-09-07T06:39:15.3161286Z * [new branch] gh/swolchok/798/base -> origin/gh/swolchok/798/base 2025-09-07T06:39:15.3161363Z * [new branch] gh/swolchok/798/head -> origin/gh/swolchok/798/head 2025-09-07T06:39:15.3161437Z * [new branch] gh/swolchok/798/orig -> origin/gh/swolchok/798/orig 2025-09-07T06:39:15.3161512Z * [new branch] gh/swolchok/799/base -> origin/gh/swolchok/799/base 2025-09-07T06:39:15.3161586Z * [new branch] gh/swolchok/799/head -> origin/gh/swolchok/799/head 2025-09-07T06:39:15.3161659Z * [new branch] gh/swolchok/799/orig -> origin/gh/swolchok/799/orig 2025-09-07T06:39:15.3161734Z * [new branch] gh/swolchok/800/base -> origin/gh/swolchok/800/base 2025-09-07T06:39:15.3161809Z * [new branch] gh/swolchok/800/head -> origin/gh/swolchok/800/head 2025-09-07T06:39:15.3161882Z * [new branch] gh/swolchok/800/orig -> origin/gh/swolchok/800/orig 2025-09-07T06:39:15.3161958Z * [new branch] gh/swolchok/801/base -> origin/gh/swolchok/801/base 2025-09-07T06:39:15.3162031Z * [new branch] gh/swolchok/801/head -> origin/gh/swolchok/801/head 2025-09-07T06:39:15.3162105Z * [new branch] gh/swolchok/801/orig -> origin/gh/swolchok/801/orig 2025-09-07T06:39:15.3162180Z * [new branch] gh/swolchok/802/base -> origin/gh/swolchok/802/base 2025-09-07T06:39:15.3162253Z * [new branch] gh/swolchok/802/head -> origin/gh/swolchok/802/head 2025-09-07T06:39:15.3162327Z * [new branch] gh/swolchok/802/orig -> origin/gh/swolchok/802/orig 2025-09-07T06:39:15.3162402Z * [new branch] gh/swolchok/803/base -> origin/gh/swolchok/803/base 2025-09-07T06:39:15.3162479Z * [new branch] gh/swolchok/803/head -> origin/gh/swolchok/803/head 2025-09-07T06:39:15.3162553Z * [new branch] gh/swolchok/803/orig -> origin/gh/swolchok/803/orig 2025-09-07T06:39:15.3163803Z * [new branch] gh/swolchok/804/base -> origin/gh/swolchok/804/base 2025-09-07T06:39:15.3163884Z * [new branch] gh/swolchok/804/head -> origin/gh/swolchok/804/head 2025-09-07T06:39:15.3163958Z * [new branch] gh/swolchok/804/orig -> origin/gh/swolchok/804/orig 2025-09-07T06:39:15.3164033Z * [new branch] gh/swolchok/805/base -> origin/gh/swolchok/805/base 2025-09-07T06:39:15.3164107Z * [new branch] gh/swolchok/805/head -> origin/gh/swolchok/805/head 2025-09-07T06:39:15.3164181Z * [new branch] gh/swolchok/805/orig -> origin/gh/swolchok/805/orig 2025-09-07T06:39:15.3164255Z * [new branch] gh/swolchok/806/base -> origin/gh/swolchok/806/base 2025-09-07T06:39:15.3164400Z * [new branch] gh/swolchok/806/head -> origin/gh/swolchok/806/head 2025-09-07T06:39:15.3164474Z * [new branch] gh/swolchok/806/orig -> origin/gh/swolchok/806/orig 2025-09-07T06:39:15.3164548Z * [new branch] gh/swolchok/807/base -> origin/gh/swolchok/807/base 2025-09-07T06:39:15.3164624Z * [new branch] gh/swolchok/807/head -> origin/gh/swolchok/807/head 2025-09-07T06:39:15.3164697Z * [new branch] gh/swolchok/807/orig -> origin/gh/swolchok/807/orig 2025-09-07T06:39:15.3164771Z * [new branch] gh/swolchok/808/base -> origin/gh/swolchok/808/base 2025-09-07T06:39:15.3164845Z * [new branch] gh/swolchok/808/head -> origin/gh/swolchok/808/head 2025-09-07T06:39:15.3164918Z * [new branch] gh/swolchok/808/orig -> origin/gh/swolchok/808/orig 2025-09-07T06:39:15.3164993Z * [new branch] gh/swolchok/809/base -> origin/gh/swolchok/809/base 2025-09-07T06:39:15.3165068Z * [new branch] gh/swolchok/809/head -> origin/gh/swolchok/809/head 2025-09-07T06:39:15.3165142Z * [new branch] gh/swolchok/809/orig -> origin/gh/swolchok/809/orig 2025-09-07T06:39:15.3165217Z * [new branch] gh/swolchok/810/base -> origin/gh/swolchok/810/base 2025-09-07T06:39:15.3165292Z * [new branch] gh/swolchok/810/head -> origin/gh/swolchok/810/head 2025-09-07T06:39:15.3165365Z * [new branch] gh/swolchok/810/orig -> origin/gh/swolchok/810/orig 2025-09-07T06:39:15.3165439Z * [new branch] gh/swolchok/811/base -> origin/gh/swolchok/811/base 2025-09-07T06:39:15.3165513Z * [new branch] gh/swolchok/811/head -> origin/gh/swolchok/811/head 2025-09-07T06:39:15.3165587Z * [new branch] gh/swolchok/811/orig -> origin/gh/swolchok/811/orig 2025-09-07T06:39:15.3166625Z * [new branch] gh/swolchok/812/base -> origin/gh/swolchok/812/base 2025-09-07T06:39:15.3166703Z * [new branch] gh/swolchok/812/head -> origin/gh/swolchok/812/head 2025-09-07T06:39:15.3166779Z * [new branch] gh/swolchok/812/orig -> origin/gh/swolchok/812/orig 2025-09-07T06:39:15.3166853Z * [new branch] gh/swolchok/813/base -> origin/gh/swolchok/813/base 2025-09-07T06:39:15.3166927Z * [new branch] gh/swolchok/813/head -> origin/gh/swolchok/813/head 2025-09-07T06:39:15.3167000Z * [new branch] gh/swolchok/813/orig -> origin/gh/swolchok/813/orig 2025-09-07T06:39:15.3167074Z * [new branch] gh/swolchok/814/base -> origin/gh/swolchok/814/base 2025-09-07T06:39:15.3167148Z * [new branch] gh/swolchok/814/head -> origin/gh/swolchok/814/head 2025-09-07T06:39:15.3167222Z * [new branch] gh/swolchok/814/orig -> origin/gh/swolchok/814/orig 2025-09-07T06:39:15.3167300Z * [new branch] gh/swolchok/815/base -> origin/gh/swolchok/815/base 2025-09-07T06:39:15.3167374Z * [new branch] gh/swolchok/815/head -> origin/gh/swolchok/815/head 2025-09-07T06:39:15.3167488Z * [new branch] gh/swolchok/815/orig -> origin/gh/swolchok/815/orig 2025-09-07T06:39:15.3167562Z * [new branch] gh/swolchok/816/base -> origin/gh/swolchok/816/base 2025-09-07T06:39:15.3167637Z * [new branch] gh/swolchok/816/head -> origin/gh/swolchok/816/head 2025-09-07T06:39:15.3167710Z * [new branch] gh/swolchok/816/orig -> origin/gh/swolchok/816/orig 2025-09-07T06:39:15.3167784Z * [new branch] gh/swolchok/817/base -> origin/gh/swolchok/817/base 2025-09-07T06:39:15.3167857Z * [new branch] gh/swolchok/817/head -> origin/gh/swolchok/817/head 2025-09-07T06:39:15.3167932Z * [new branch] gh/swolchok/817/orig -> origin/gh/swolchok/817/orig 2025-09-07T06:39:15.3168048Z * [new branch] gh/swolchok/818/base -> origin/gh/swolchok/818/base 2025-09-07T06:39:15.3168121Z * [new branch] gh/swolchok/818/head -> origin/gh/swolchok/818/head 2025-09-07T06:39:15.3168198Z * [new branch] gh/swolchok/818/orig -> origin/gh/swolchok/818/orig 2025-09-07T06:39:15.3168354Z * [new branch] gh/swolchok/819/base -> origin/gh/swolchok/819/base 2025-09-07T06:39:15.3168429Z * [new branch] gh/swolchok/819/head -> origin/gh/swolchok/819/head 2025-09-07T06:39:15.3168503Z * [new branch] gh/swolchok/819/orig -> origin/gh/swolchok/819/orig 2025-09-07T06:39:15.3169540Z * [new branch] gh/swolchok/820/base -> origin/gh/swolchok/820/base 2025-09-07T06:39:15.3169617Z * [new branch] gh/swolchok/820/head -> origin/gh/swolchok/820/head 2025-09-07T06:39:15.3169698Z * [new branch] gh/swolchok/820/orig -> origin/gh/swolchok/820/orig 2025-09-07T06:39:15.3169771Z * [new branch] gh/swolchok/821/base -> origin/gh/swolchok/821/base 2025-09-07T06:39:15.3169845Z * [new branch] gh/swolchok/821/head -> origin/gh/swolchok/821/head 2025-09-07T06:39:15.3169923Z * [new branch] gh/swolchok/821/orig -> origin/gh/swolchok/821/orig 2025-09-07T06:39:15.3169997Z * [new branch] gh/swolchok/822/base -> origin/gh/swolchok/822/base 2025-09-07T06:39:15.3170071Z * [new branch] gh/swolchok/822/head -> origin/gh/swolchok/822/head 2025-09-07T06:39:15.3170145Z * [new branch] gh/swolchok/822/orig -> origin/gh/swolchok/822/orig 2025-09-07T06:39:15.3170219Z * [new branch] gh/swolchok/823/base -> origin/gh/swolchok/823/base 2025-09-07T06:39:15.3170293Z * [new branch] gh/swolchok/823/head -> origin/gh/swolchok/823/head 2025-09-07T06:39:15.3170370Z * [new branch] gh/swolchok/823/orig -> origin/gh/swolchok/823/orig 2025-09-07T06:39:15.3170444Z * [new branch] gh/swolchok/824/base -> origin/gh/swolchok/824/base 2025-09-07T06:39:15.3170519Z * [new branch] gh/swolchok/824/head -> origin/gh/swolchok/824/head 2025-09-07T06:39:15.3170594Z * [new branch] gh/swolchok/824/orig -> origin/gh/swolchok/824/orig 2025-09-07T06:39:15.3170668Z * [new branch] gh/swolchok/825/base -> origin/gh/swolchok/825/base 2025-09-07T06:39:15.3170741Z * [new branch] gh/swolchok/825/head -> origin/gh/swolchok/825/head 2025-09-07T06:39:15.3170816Z * [new branch] gh/swolchok/825/orig -> origin/gh/swolchok/825/orig 2025-09-07T06:39:15.3170889Z * [new branch] gh/swolchok/826/base -> origin/gh/swolchok/826/base 2025-09-07T06:39:15.3170963Z * [new branch] gh/swolchok/826/head -> origin/gh/swolchok/826/head 2025-09-07T06:39:15.3171040Z * [new branch] gh/swolchok/826/orig -> origin/gh/swolchok/826/orig 2025-09-07T06:39:15.3171115Z * [new branch] gh/swolchok/827/base -> origin/gh/swolchok/827/base 2025-09-07T06:39:15.3171227Z * [new branch] gh/swolchok/827/head -> origin/gh/swolchok/827/head 2025-09-07T06:39:15.3171302Z * [new branch] gh/swolchok/827/orig -> origin/gh/swolchok/827/orig 2025-09-07T06:39:15.3172330Z * [new branch] gh/swolchok/828/base -> origin/gh/swolchok/828/base 2025-09-07T06:39:15.3172408Z * [new branch] gh/swolchok/828/head -> origin/gh/swolchok/828/head 2025-09-07T06:39:15.3172484Z * [new branch] gh/swolchok/828/orig -> origin/gh/swolchok/828/orig 2025-09-07T06:39:15.3172557Z * [new branch] gh/swolchok/829/base -> origin/gh/swolchok/829/base 2025-09-07T06:39:15.3172631Z * [new branch] gh/swolchok/829/head -> origin/gh/swolchok/829/head 2025-09-07T06:39:15.3172740Z * [new branch] gh/swolchok/829/orig -> origin/gh/swolchok/829/orig 2025-09-07T06:39:15.3172815Z * [new branch] gh/swolchok/830/base -> origin/gh/swolchok/830/base 2025-09-07T06:39:15.3172890Z * [new branch] gh/swolchok/830/head -> origin/gh/swolchok/830/head 2025-09-07T06:39:15.3172964Z * [new branch] gh/swolchok/830/orig -> origin/gh/swolchok/830/orig 2025-09-07T06:39:15.3173039Z * [new branch] gh/swolchok/831/base -> origin/gh/swolchok/831/base 2025-09-07T06:39:15.3173178Z * [new branch] gh/swolchok/831/head -> origin/gh/swolchok/831/head 2025-09-07T06:39:15.3173256Z * [new branch] gh/swolchok/831/orig -> origin/gh/swolchok/831/orig 2025-09-07T06:39:15.3173330Z * [new branch] gh/swolchok/832/base -> origin/gh/swolchok/832/base 2025-09-07T06:39:15.3173407Z * [new branch] gh/swolchok/832/head -> origin/gh/swolchok/832/head 2025-09-07T06:39:15.3173480Z * [new branch] gh/swolchok/832/orig -> origin/gh/swolchok/832/orig 2025-09-07T06:39:15.3173560Z * [new branch] gh/syed-ahmed/3/base -> origin/gh/syed-ahmed/3/base 2025-09-07T06:39:15.3173634Z * [new branch] gh/syed-ahmed/3/head -> origin/gh/syed-ahmed/3/head 2025-09-07T06:39:15.3173707Z * [new branch] gh/syed-ahmed/3/orig -> origin/gh/syed-ahmed/3/orig 2025-09-07T06:39:15.3173780Z * [new branch] gh/syed-ahmed/4/base -> origin/gh/syed-ahmed/4/base 2025-09-07T06:39:15.3173853Z * [new branch] gh/syed-ahmed/4/head -> origin/gh/syed-ahmed/4/head 2025-09-07T06:39:15.3173925Z * [new branch] gh/syed-ahmed/4/orig -> origin/gh/syed-ahmed/4/orig 2025-09-07T06:39:15.3173999Z * [new branch] gh/syed-ahmed/5/base -> origin/gh/syed-ahmed/5/base 2025-09-07T06:39:15.3174074Z * [new branch] gh/syed-ahmed/5/head -> origin/gh/syed-ahmed/5/head 2025-09-07T06:39:15.3174146Z * [new branch] gh/syed-ahmed/5/orig -> origin/gh/syed-ahmed/5/orig 2025-09-07T06:39:15.3175190Z * [new branch] gh/teja-rao/4/base -> origin/gh/teja-rao/4/base 2025-09-07T06:39:15.3175266Z * [new branch] gh/teja-rao/4/head -> origin/gh/teja-rao/4/head 2025-09-07T06:39:15.3175338Z * [new branch] gh/teja-rao/4/orig -> origin/gh/teja-rao/4/orig 2025-09-07T06:39:15.3175412Z * [new branch] gh/tianyu-l/2/base -> origin/gh/tianyu-l/2/base 2025-09-07T06:39:15.3175483Z * [new branch] gh/tianyu-l/2/head -> origin/gh/tianyu-l/2/head 2025-09-07T06:39:15.3175554Z * [new branch] gh/tianyu-l/2/orig -> origin/gh/tianyu-l/2/orig 2025-09-07T06:39:15.3175625Z * [new branch] gh/tianyu-l/3/base -> origin/gh/tianyu-l/3/base 2025-09-07T06:39:15.3175701Z * [new branch] gh/tianyu-l/3/head -> origin/gh/tianyu-l/3/head 2025-09-07T06:39:15.3175771Z * [new branch] gh/tianyu-l/3/orig -> origin/gh/tianyu-l/3/orig 2025-09-07T06:39:15.3175910Z * [new branch] gh/tianyu-l/4/base -> origin/gh/tianyu-l/4/base 2025-09-07T06:39:15.3175982Z * [new branch] gh/tianyu-l/4/head -> origin/gh/tianyu-l/4/head 2025-09-07T06:39:15.3176053Z * [new branch] gh/tianyu-l/4/orig -> origin/gh/tianyu-l/4/orig 2025-09-07T06:39:15.3176143Z * [new branch] gh/tugsbayasgalan/1/base -> origin/gh/tugsbayasgalan/1/base 2025-09-07T06:39:15.3176231Z * [new branch] gh/tugsbayasgalan/1/head -> origin/gh/tugsbayasgalan/1/head 2025-09-07T06:39:15.3176316Z * [new branch] gh/tugsbayasgalan/1/orig -> origin/gh/tugsbayasgalan/1/orig 2025-09-07T06:39:15.3176406Z * [new branch] gh/tugsbayasgalan/10/base -> origin/gh/tugsbayasgalan/10/base 2025-09-07T06:39:15.3176551Z * [new branch] gh/tugsbayasgalan/10/head -> origin/gh/tugsbayasgalan/10/head 2025-09-07T06:39:15.3176637Z * [new branch] gh/tugsbayasgalan/10/orig -> origin/gh/tugsbayasgalan/10/orig 2025-09-07T06:39:15.3176724Z * [new branch] gh/tugsbayasgalan/11/base -> origin/gh/tugsbayasgalan/11/base 2025-09-07T06:39:15.3176809Z * [new branch] gh/tugsbayasgalan/11/head -> origin/gh/tugsbayasgalan/11/head 2025-09-07T06:39:15.3176893Z * [new branch] gh/tugsbayasgalan/11/orig -> origin/gh/tugsbayasgalan/11/orig 2025-09-07T06:39:15.3176977Z * [new branch] gh/tugsbayasgalan/12/base -> origin/gh/tugsbayasgalan/12/base 2025-09-07T06:39:15.3177062Z * [new branch] gh/tugsbayasgalan/12/head -> origin/gh/tugsbayasgalan/12/head 2025-09-07T06:39:15.3177146Z * [new branch] gh/tugsbayasgalan/12/orig -> origin/gh/tugsbayasgalan/12/orig 2025-09-07T06:39:15.3177230Z * [new branch] gh/tugsbayasgalan/13/base -> origin/gh/tugsbayasgalan/13/base 2025-09-07T06:39:15.3178289Z * [new branch] gh/tugsbayasgalan/13/head -> origin/gh/tugsbayasgalan/13/head 2025-09-07T06:39:15.3178378Z * [new branch] gh/tugsbayasgalan/13/orig -> origin/gh/tugsbayasgalan/13/orig 2025-09-07T06:39:15.3178463Z * [new branch] gh/tugsbayasgalan/14/base -> origin/gh/tugsbayasgalan/14/base 2025-09-07T06:39:15.3178548Z * [new branch] gh/tugsbayasgalan/14/head -> origin/gh/tugsbayasgalan/14/head 2025-09-07T06:39:15.3178632Z * [new branch] gh/tugsbayasgalan/14/orig -> origin/gh/tugsbayasgalan/14/orig 2025-09-07T06:39:15.3178716Z * [new branch] gh/tugsbayasgalan/15/base -> origin/gh/tugsbayasgalan/15/base 2025-09-07T06:39:15.3178801Z * [new branch] gh/tugsbayasgalan/15/head -> origin/gh/tugsbayasgalan/15/head 2025-09-07T06:39:15.3178889Z * [new branch] gh/tugsbayasgalan/15/orig -> origin/gh/tugsbayasgalan/15/orig 2025-09-07T06:39:15.3178975Z * [new branch] gh/tugsbayasgalan/2/base -> origin/gh/tugsbayasgalan/2/base 2025-09-07T06:39:15.3179060Z * [new branch] gh/tugsbayasgalan/2/head -> origin/gh/tugsbayasgalan/2/head 2025-09-07T06:39:15.3179146Z * [new branch] gh/tugsbayasgalan/2/orig -> origin/gh/tugsbayasgalan/2/orig 2025-09-07T06:39:15.3179229Z * [new branch] gh/tugsbayasgalan/3/base -> origin/gh/tugsbayasgalan/3/base 2025-09-07T06:39:15.3179313Z * [new branch] gh/tugsbayasgalan/3/head -> origin/gh/tugsbayasgalan/3/head 2025-09-07T06:39:15.3179395Z * [new branch] gh/tugsbayasgalan/3/orig -> origin/gh/tugsbayasgalan/3/orig 2025-09-07T06:39:15.3179478Z * [new branch] gh/tugsbayasgalan/4/base -> origin/gh/tugsbayasgalan/4/base 2025-09-07T06:39:15.3179561Z * [new branch] gh/tugsbayasgalan/4/head -> origin/gh/tugsbayasgalan/4/head 2025-09-07T06:39:15.3179644Z * [new branch] gh/tugsbayasgalan/4/orig -> origin/gh/tugsbayasgalan/4/orig 2025-09-07T06:39:15.3179726Z * [new branch] gh/tugsbayasgalan/5/base -> origin/gh/tugsbayasgalan/5/base 2025-09-07T06:39:15.3179847Z * [new branch] gh/tugsbayasgalan/5/head -> origin/gh/tugsbayasgalan/5/head 2025-09-07T06:39:15.3179930Z * [new branch] gh/tugsbayasgalan/5/orig -> origin/gh/tugsbayasgalan/5/orig 2025-09-07T06:39:15.3180013Z * [new branch] gh/tugsbayasgalan/6/base -> origin/gh/tugsbayasgalan/6/base 2025-09-07T06:39:15.3180095Z * [new branch] gh/tugsbayasgalan/6/head -> origin/gh/tugsbayasgalan/6/head 2025-09-07T06:39:15.3180178Z * [new branch] gh/tugsbayasgalan/6/orig -> origin/gh/tugsbayasgalan/6/orig 2025-09-07T06:39:15.3180261Z * [new branch] gh/tugsbayasgalan/7/base -> origin/gh/tugsbayasgalan/7/base 2025-09-07T06:39:15.3181330Z * [new branch] gh/tugsbayasgalan/7/head -> origin/gh/tugsbayasgalan/7/head 2025-09-07T06:39:15.3181416Z * [new branch] gh/tugsbayasgalan/7/orig -> origin/gh/tugsbayasgalan/7/orig 2025-09-07T06:39:15.3181499Z * [new branch] gh/tugsbayasgalan/8/base -> origin/gh/tugsbayasgalan/8/base 2025-09-07T06:39:15.3181586Z * [new branch] gh/tugsbayasgalan/8/head -> origin/gh/tugsbayasgalan/8/head 2025-09-07T06:39:15.3181671Z * [new branch] gh/tugsbayasgalan/8/orig -> origin/gh/tugsbayasgalan/8/orig 2025-09-07T06:39:15.3181753Z * [new branch] gh/tugsbayasgalan/9/base -> origin/gh/tugsbayasgalan/9/base 2025-09-07T06:39:15.3181836Z * [new branch] gh/tugsbayasgalan/9/head -> origin/gh/tugsbayasgalan/9/head 2025-09-07T06:39:15.3181919Z * [new branch] gh/tugsbayasgalan/9/orig -> origin/gh/tugsbayasgalan/9/orig 2025-09-07T06:39:15.3181989Z * [new branch] gh/v0i0/1/base -> origin/gh/v0i0/1/base 2025-09-07T06:39:15.3182062Z * [new branch] gh/v0i0/1/head -> origin/gh/v0i0/1/head 2025-09-07T06:39:15.3182130Z * [new branch] gh/v0i0/1/orig -> origin/gh/v0i0/1/orig 2025-09-07T06:39:15.3182197Z * [new branch] gh/v0i0/4/base -> origin/gh/v0i0/4/base 2025-09-07T06:39:15.3182262Z * [new branch] gh/v0i0/4/head -> origin/gh/v0i0/4/head 2025-09-07T06:39:15.3182328Z * [new branch] gh/v0i0/4/orig -> origin/gh/v0i0/4/orig 2025-09-07T06:39:15.3182392Z * [new branch] gh/v0i0/6/base -> origin/gh/v0i0/6/base 2025-09-07T06:39:15.3182457Z * [new branch] gh/v0i0/6/head -> origin/gh/v0i0/6/head 2025-09-07T06:39:15.3182523Z * [new branch] gh/v0i0/6/orig -> origin/gh/v0i0/6/orig 2025-09-07T06:39:15.3182588Z * [new branch] gh/v0i0/7/base -> origin/gh/v0i0/7/base 2025-09-07T06:39:15.3182658Z * [new branch] gh/v0i0/7/head -> origin/gh/v0i0/7/head 2025-09-07T06:39:15.3182724Z * [new branch] gh/v0i0/7/orig -> origin/gh/v0i0/7/orig 2025-09-07T06:39:15.3182789Z * [new branch] gh/v0i0/8/base -> origin/gh/v0i0/8/base 2025-09-07T06:39:15.3182856Z * [new branch] gh/v0i0/8/head -> origin/gh/v0i0/8/head 2025-09-07T06:39:15.3182922Z * [new branch] gh/v0i0/8/orig -> origin/gh/v0i0/8/orig 2025-09-07T06:39:15.3182987Z * [new branch] gh/v0i0/9/base -> origin/gh/v0i0/9/base 2025-09-07T06:39:15.3184076Z * [new branch] gh/v0i0/9/head -> origin/gh/v0i0/9/head 2025-09-07T06:39:15.3184148Z * [new branch] gh/v0i0/9/orig -> origin/gh/v0i0/9/orig 2025-09-07T06:39:15.3184219Z * [new branch] gh/vkuzo/1/next -> origin/gh/vkuzo/1/next 2025-09-07T06:39:15.3184293Z * [new branch] gh/vkuzo/2/next -> origin/gh/vkuzo/2/next 2025-09-07T06:39:15.3184362Z * [new branch] gh/vkuzo/3/next -> origin/gh/vkuzo/3/next 2025-09-07T06:39:15.3184430Z * [new branch] gh/vkuzo/4/base -> origin/gh/vkuzo/4/base 2025-09-07T06:39:15.3184560Z * [new branch] gh/vkuzo/4/head -> origin/gh/vkuzo/4/head 2025-09-07T06:39:15.3184627Z * [new branch] gh/vkuzo/4/orig -> origin/gh/vkuzo/4/orig 2025-09-07T06:39:15.3184695Z * [new branch] gh/vkuzo/5/base -> origin/gh/vkuzo/5/base 2025-09-07T06:39:15.3184762Z * [new branch] gh/vkuzo/5/head -> origin/gh/vkuzo/5/head 2025-09-07T06:39:15.3184830Z * [new branch] gh/vkuzo/5/orig -> origin/gh/vkuzo/5/orig 2025-09-07T06:39:15.3184898Z * [new branch] gh/vkuzo/6/base -> origin/gh/vkuzo/6/base 2025-09-07T06:39:15.3185028Z * [new branch] gh/vkuzo/6/head -> origin/gh/vkuzo/6/head 2025-09-07T06:39:15.3185095Z * [new branch] gh/vkuzo/6/orig -> origin/gh/vkuzo/6/orig 2025-09-07T06:39:15.3185163Z * [new branch] gh/vkuzo/7/base -> origin/gh/vkuzo/7/base 2025-09-07T06:39:15.3185231Z * [new branch] gh/vkuzo/7/head -> origin/gh/vkuzo/7/head 2025-09-07T06:39:15.3185298Z * [new branch] gh/vkuzo/7/orig -> origin/gh/vkuzo/7/orig 2025-09-07T06:39:15.3185379Z * [new branch] gh/wconstab/419/base -> origin/gh/wconstab/419/base 2025-09-07T06:39:15.3185457Z * [new branch] gh/wconstab/419/head -> origin/gh/wconstab/419/head 2025-09-07T06:39:15.3185533Z * [new branch] gh/wconstab/419/orig -> origin/gh/wconstab/419/orig 2025-09-07T06:39:15.3185609Z * [new branch] gh/wconstab/424/base -> origin/gh/wconstab/424/base 2025-09-07T06:39:15.3185685Z * [new branch] gh/wconstab/424/head -> origin/gh/wconstab/424/head 2025-09-07T06:39:15.3185759Z * [new branch] gh/wconstab/424/orig -> origin/gh/wconstab/424/orig 2025-09-07T06:39:15.3185834Z * [new branch] gh/wconstab/435/base -> origin/gh/wconstab/435/base 2025-09-07T06:39:15.3186866Z * [new branch] gh/wconstab/435/head -> origin/gh/wconstab/435/head 2025-09-07T06:39:15.3186942Z * [new branch] gh/wconstab/435/orig -> origin/gh/wconstab/435/orig 2025-09-07T06:39:15.3187018Z * [new branch] gh/wconstab/438/base -> origin/gh/wconstab/438/base 2025-09-07T06:39:15.3187092Z * [new branch] gh/wconstab/438/head -> origin/gh/wconstab/438/head 2025-09-07T06:39:15.3187166Z * [new branch] gh/wconstab/438/orig -> origin/gh/wconstab/438/orig 2025-09-07T06:39:15.3187240Z * [new branch] gh/wconstab/440/base -> origin/gh/wconstab/440/base 2025-09-07T06:39:15.3187320Z * [new branch] gh/wconstab/440/head -> origin/gh/wconstab/440/head 2025-09-07T06:39:15.3187392Z * [new branch] gh/wconstab/440/orig -> origin/gh/wconstab/440/orig 2025-09-07T06:39:15.3187469Z * [new branch] gh/wconstab/441/base -> origin/gh/wconstab/441/base 2025-09-07T06:39:15.3187542Z * [new branch] gh/wconstab/441/head -> origin/gh/wconstab/441/head 2025-09-07T06:39:15.3187615Z * [new branch] gh/wconstab/441/orig -> origin/gh/wconstab/441/orig 2025-09-07T06:39:15.3187689Z * [new branch] gh/wconstab/442/base -> origin/gh/wconstab/442/base 2025-09-07T06:39:15.3187764Z * [new branch] gh/wconstab/442/head -> origin/gh/wconstab/442/head 2025-09-07T06:39:15.3187838Z * [new branch] gh/wconstab/442/orig -> origin/gh/wconstab/442/orig 2025-09-07T06:39:15.3187912Z * [new branch] gh/wconstab/443/base -> origin/gh/wconstab/443/base 2025-09-07T06:39:15.3187988Z * [new branch] gh/wconstab/443/head -> origin/gh/wconstab/443/head 2025-09-07T06:39:15.3188061Z * [new branch] gh/wconstab/443/orig -> origin/gh/wconstab/443/orig 2025-09-07T06:39:15.3188172Z * [new branch] gh/wconstab/444/base -> origin/gh/wconstab/444/base 2025-09-07T06:39:15.3188247Z * [new branch] gh/wconstab/444/head -> origin/gh/wconstab/444/head 2025-09-07T06:39:15.3188321Z * [new branch] gh/wconstab/444/orig -> origin/gh/wconstab/444/orig 2025-09-07T06:39:15.3188394Z * [new branch] gh/wconstab/445/base -> origin/gh/wconstab/445/base 2025-09-07T06:39:15.3188471Z * [new branch] gh/wconstab/445/head -> origin/gh/wconstab/445/head 2025-09-07T06:39:15.3188547Z * [new branch] gh/wconstab/445/orig -> origin/gh/wconstab/445/orig 2025-09-07T06:39:15.3188620Z * [new branch] gh/wconstab/446/base -> origin/gh/wconstab/446/base 2025-09-07T06:39:15.3189685Z * [new branch] gh/wconstab/446/head -> origin/gh/wconstab/446/head 2025-09-07T06:39:15.3189761Z * [new branch] gh/wconstab/446/orig -> origin/gh/wconstab/446/orig 2025-09-07T06:39:15.3189837Z * [new branch] gh/wconstab/447/base -> origin/gh/wconstab/447/base 2025-09-07T06:39:15.3189912Z * [new branch] gh/wconstab/447/head -> origin/gh/wconstab/447/head 2025-09-07T06:39:15.3189986Z * [new branch] gh/wconstab/447/orig -> origin/gh/wconstab/447/orig 2025-09-07T06:39:15.3190062Z * [new branch] gh/weifengpy/27/base -> origin/gh/weifengpy/27/base 2025-09-07T06:39:15.3190138Z * [new branch] gh/weifengpy/27/head -> origin/gh/weifengpy/27/head 2025-09-07T06:39:15.3190212Z * [new branch] gh/weifengpy/27/orig -> origin/gh/weifengpy/27/orig 2025-09-07T06:39:15.3190291Z * [new branch] gh/weifengpy/30/base -> origin/gh/weifengpy/30/base 2025-09-07T06:39:15.3190367Z * [new branch] gh/weifengpy/30/head -> origin/gh/weifengpy/30/head 2025-09-07T06:39:15.3190441Z * [new branch] gh/weifengpy/30/orig -> origin/gh/weifengpy/30/orig 2025-09-07T06:39:15.3190528Z * [new branch] gh/williamwen42/196/base -> origin/gh/williamwen42/196/base 2025-09-07T06:39:15.3190612Z * [new branch] gh/williamwen42/196/head -> origin/gh/williamwen42/196/head 2025-09-07T06:39:15.3190694Z * [new branch] gh/williamwen42/196/orig -> origin/gh/williamwen42/196/orig 2025-09-07T06:39:15.3190775Z * [new branch] gh/williamwen42/250/base -> origin/gh/williamwen42/250/base 2025-09-07T06:39:15.3190857Z * [new branch] gh/williamwen42/250/head -> origin/gh/williamwen42/250/head 2025-09-07T06:39:15.3190937Z * [new branch] gh/williamwen42/250/orig -> origin/gh/williamwen42/250/orig 2025-09-07T06:39:15.3191019Z * [new branch] gh/williamwen42/258/base -> origin/gh/williamwen42/258/base 2025-09-07T06:39:15.3191100Z * [new branch] gh/williamwen42/258/head -> origin/gh/williamwen42/258/head 2025-09-07T06:39:15.3191182Z * [new branch] gh/williamwen42/258/orig -> origin/gh/williamwen42/258/orig 2025-09-07T06:39:15.3191262Z * [new branch] gh/williamwen42/266/base -> origin/gh/williamwen42/266/base 2025-09-07T06:39:15.3191342Z * [new branch] gh/williamwen42/266/head -> origin/gh/williamwen42/266/head 2025-09-07T06:39:15.3191423Z * [new branch] gh/williamwen42/266/orig -> origin/gh/williamwen42/266/orig 2025-09-07T06:39:15.3191504Z * [new branch] gh/williamwen42/267/base -> origin/gh/williamwen42/267/base 2025-09-07T06:39:15.3191585Z * [new branch] gh/williamwen42/267/head -> origin/gh/williamwen42/267/head 2025-09-07T06:39:15.3192642Z * [new branch] gh/williamwen42/267/orig -> origin/gh/williamwen42/267/orig 2025-09-07T06:39:15.3192723Z * [new branch] gh/williamwen42/270/base -> origin/gh/williamwen42/270/base 2025-09-07T06:39:15.3192803Z * [new branch] gh/williamwen42/270/head -> origin/gh/williamwen42/270/head 2025-09-07T06:39:15.3192919Z * [new branch] gh/williamwen42/270/orig -> origin/gh/williamwen42/270/orig 2025-09-07T06:39:15.3193002Z * [new branch] gh/williamwen42/271/base -> origin/gh/williamwen42/271/base 2025-09-07T06:39:15.3193156Z * [new branch] gh/williamwen42/271/head -> origin/gh/williamwen42/271/head 2025-09-07T06:39:15.3193240Z * [new branch] gh/williamwen42/271/orig -> origin/gh/williamwen42/271/orig 2025-09-07T06:39:15.3193321Z * [new branch] gh/williamwen42/272/base -> origin/gh/williamwen42/272/base 2025-09-07T06:39:15.3193401Z * [new branch] gh/williamwen42/272/head -> origin/gh/williamwen42/272/head 2025-09-07T06:39:15.3193545Z * [new branch] gh/williamwen42/272/orig -> origin/gh/williamwen42/272/orig 2025-09-07T06:39:15.3193626Z * [new branch] gh/williamwen42/274/base -> origin/gh/williamwen42/274/base 2025-09-07T06:39:15.3193707Z * [new branch] gh/williamwen42/274/head -> origin/gh/williamwen42/274/head 2025-09-07T06:39:15.3193788Z * [new branch] gh/williamwen42/274/orig -> origin/gh/williamwen42/274/orig 2025-09-07T06:39:15.3193867Z * [new branch] gh/williamwen42/275/base -> origin/gh/williamwen42/275/base 2025-09-07T06:39:15.3193948Z * [new branch] gh/williamwen42/275/head -> origin/gh/williamwen42/275/head 2025-09-07T06:39:15.3194030Z * [new branch] gh/williamwen42/276/base -> origin/gh/williamwen42/276/base 2025-09-07T06:39:15.3194110Z * [new branch] gh/williamwen42/276/head -> origin/gh/williamwen42/276/head 2025-09-07T06:39:15.3194192Z * [new branch] gh/williamwen42/276/orig -> origin/gh/williamwen42/276/orig 2025-09-07T06:39:15.3194273Z * [new branch] gh/williamwen42/277/base -> origin/gh/williamwen42/277/base 2025-09-07T06:39:15.3194354Z * [new branch] gh/williamwen42/277/head -> origin/gh/williamwen42/277/head 2025-09-07T06:39:15.3194435Z * [new branch] gh/williamwen42/277/orig -> origin/gh/williamwen42/277/orig 2025-09-07T06:39:15.3194517Z * [new branch] gh/williamwen42/278/base -> origin/gh/williamwen42/278/base 2025-09-07T06:39:15.3194597Z * [new branch] gh/williamwen42/278/head -> origin/gh/williamwen42/278/head 2025-09-07T06:39:15.3194678Z * [new branch] gh/williamwen42/278/orig -> origin/gh/williamwen42/278/orig 2025-09-07T06:39:15.3195726Z * [new branch] gh/williamwen42/279/base -> origin/gh/williamwen42/279/base 2025-09-07T06:39:15.3195810Z * [new branch] gh/williamwen42/279/head -> origin/gh/williamwen42/279/head 2025-09-07T06:39:15.3195896Z * [new branch] gh/williamwen42/279/orig -> origin/gh/williamwen42/279/orig 2025-09-07T06:39:15.3195977Z * [new branch] gh/williamwen42/280/base -> origin/gh/williamwen42/280/base 2025-09-07T06:39:15.3196059Z * [new branch] gh/williamwen42/280/head -> origin/gh/williamwen42/280/head 2025-09-07T06:39:15.3196140Z * [new branch] gh/williamwen42/280/orig -> origin/gh/williamwen42/280/orig 2025-09-07T06:39:15.3196221Z * [new branch] gh/williamwen42/281/base -> origin/gh/williamwen42/281/base 2025-09-07T06:39:15.3196302Z * [new branch] gh/williamwen42/281/head -> origin/gh/williamwen42/281/head 2025-09-07T06:39:15.3196384Z * [new branch] gh/williamwen42/281/orig -> origin/gh/williamwen42/281/orig 2025-09-07T06:39:15.3196465Z * [new branch] gh/williamwen42/282/base -> origin/gh/williamwen42/282/base 2025-09-07T06:39:15.3196550Z * [new branch] gh/williamwen42/282/head -> origin/gh/williamwen42/282/head 2025-09-07T06:39:15.3196630Z * [new branch] gh/williamwen42/282/orig -> origin/gh/williamwen42/282/orig 2025-09-07T06:39:15.3196710Z * [new branch] gh/williamwen42/283/base -> origin/gh/williamwen42/283/base 2025-09-07T06:39:15.3196855Z * [new branch] gh/williamwen42/283/head -> origin/gh/williamwen42/283/head 2025-09-07T06:39:15.3196936Z * [new branch] gh/williamwen42/283/orig -> origin/gh/williamwen42/283/orig 2025-09-07T06:39:15.3197016Z * [new branch] gh/williamwen42/284/base -> origin/gh/williamwen42/284/base 2025-09-07T06:39:15.3197097Z * [new branch] gh/williamwen42/284/head -> origin/gh/williamwen42/284/head 2025-09-07T06:39:15.3197177Z * [new branch] gh/williamwen42/284/orig -> origin/gh/williamwen42/284/orig 2025-09-07T06:39:15.3197258Z * [new branch] gh/williamwen42/285/base -> origin/gh/williamwen42/285/base 2025-09-07T06:39:15.3197377Z * [new branch] gh/williamwen42/285/head -> origin/gh/williamwen42/285/head 2025-09-07T06:39:15.3197458Z * [new branch] gh/williamwen42/285/orig -> origin/gh/williamwen42/285/orig 2025-09-07T06:39:15.3197540Z * [new branch] gh/williamwen42/286/base -> origin/gh/williamwen42/286/base 2025-09-07T06:39:15.3197621Z * [new branch] gh/williamwen42/286/head -> origin/gh/williamwen42/286/head 2025-09-07T06:39:15.3197701Z * [new branch] gh/williamwen42/286/orig -> origin/gh/williamwen42/286/orig 2025-09-07T06:39:15.3198735Z * [new branch] gh/williamwen42/287/base -> origin/gh/williamwen42/287/base 2025-09-07T06:39:15.3198821Z * [new branch] gh/williamwen42/287/head -> origin/gh/williamwen42/287/head 2025-09-07T06:39:15.3198902Z * [new branch] gh/williamwen42/287/orig -> origin/gh/williamwen42/287/orig 2025-09-07T06:39:15.3198989Z * [new branch] gh/williamwen42/288/base -> origin/gh/williamwen42/288/base 2025-09-07T06:39:15.3199071Z * [new branch] gh/williamwen42/288/head -> origin/gh/williamwen42/288/head 2025-09-07T06:39:15.3199153Z * [new branch] gh/williamwen42/288/orig -> origin/gh/williamwen42/288/orig 2025-09-07T06:39:15.3199233Z * [new branch] gh/williamwen42/289/base -> origin/gh/williamwen42/289/base 2025-09-07T06:39:15.3199314Z * [new branch] gh/williamwen42/289/head -> origin/gh/williamwen42/289/head 2025-09-07T06:39:15.3199394Z * [new branch] gh/williamwen42/289/orig -> origin/gh/williamwen42/289/orig 2025-09-07T06:39:15.3199464Z * [new branch] gh/wychi/1/base -> origin/gh/wychi/1/base 2025-09-07T06:39:15.3199534Z * [new branch] gh/wychi/1/head -> origin/gh/wychi/1/head 2025-09-07T06:39:15.3199602Z * [new branch] gh/wychi/1/orig -> origin/gh/wychi/1/orig 2025-09-07T06:39:15.3199679Z * [new branch] gh/xmfan/169/base -> origin/gh/xmfan/169/base 2025-09-07T06:39:15.3199752Z * [new branch] gh/xmfan/169/head -> origin/gh/xmfan/169/head 2025-09-07T06:39:15.3199824Z * [new branch] gh/xmfan/170/base -> origin/gh/xmfan/170/base 2025-09-07T06:39:15.3199893Z * [new branch] gh/xmfan/170/head -> origin/gh/xmfan/170/head 2025-09-07T06:39:15.3199967Z * [new branch] gh/xmfan/18/base -> origin/gh/xmfan/18/base 2025-09-07T06:39:15.3200038Z * [new branch] gh/xmfan/18/head -> origin/gh/xmfan/18/head 2025-09-07T06:39:15.3200108Z * [new branch] gh/xmfan/229/base -> origin/gh/xmfan/229/base 2025-09-07T06:39:15.3200178Z * [new branch] gh/xmfan/229/head -> origin/gh/xmfan/229/head 2025-09-07T06:39:15.3200248Z * [new branch] gh/xmfan/229/orig -> origin/gh/xmfan/229/orig 2025-09-07T06:39:15.3200319Z * [new branch] gh/xmfan/237/base -> origin/gh/xmfan/237/base 2025-09-07T06:39:15.3200388Z * [new branch] gh/xmfan/237/head -> origin/gh/xmfan/237/head 2025-09-07T06:39:15.3200504Z * [new branch] gh/xmfan/237/orig -> origin/gh/xmfan/237/orig 2025-09-07T06:39:15.3201588Z * [new branch] gh/xmfan/244/base -> origin/gh/xmfan/244/base 2025-09-07T06:39:15.3201681Z * [new branch] gh/xmfan/244/head -> origin/gh/xmfan/244/head 2025-09-07T06:39:15.3201751Z * [new branch] gh/xmfan/244/orig -> origin/gh/xmfan/244/orig 2025-09-07T06:39:15.3201820Z * [new branch] gh/xmfan/246/base -> origin/gh/xmfan/246/base 2025-09-07T06:39:15.3201889Z * [new branch] gh/xmfan/246/head -> origin/gh/xmfan/246/head 2025-09-07T06:39:15.3201959Z * [new branch] gh/xmfan/246/orig -> origin/gh/xmfan/246/orig 2025-09-07T06:39:15.3202073Z * [new branch] gh/xmfan/253/base -> origin/gh/xmfan/253/base 2025-09-07T06:39:15.3202143Z * [new branch] gh/xmfan/253/head -> origin/gh/xmfan/253/head 2025-09-07T06:39:15.3202215Z * [new branch] gh/xmfan/253/orig -> origin/gh/xmfan/253/orig 2025-09-07T06:39:15.3202284Z * [new branch] gh/xmfan/254/base -> origin/gh/xmfan/254/base 2025-09-07T06:39:15.3202353Z * [new branch] gh/xmfan/254/head -> origin/gh/xmfan/254/head 2025-09-07T06:39:15.3202423Z * [new branch] gh/xmfan/254/orig -> origin/gh/xmfan/254/orig 2025-09-07T06:39:15.3202493Z * [new branch] gh/xmfan/260/base -> origin/gh/xmfan/260/base 2025-09-07T06:39:15.3202562Z * [new branch] gh/xmfan/260/head -> origin/gh/xmfan/260/head 2025-09-07T06:39:15.3202632Z * [new branch] gh/xmfan/260/orig -> origin/gh/xmfan/260/orig 2025-09-07T06:39:15.3202704Z * [new branch] gh/xmfan/262/base -> origin/gh/xmfan/262/base 2025-09-07T06:39:15.3202774Z * [new branch] gh/xmfan/262/head -> origin/gh/xmfan/262/head 2025-09-07T06:39:15.3202845Z * [new branch] gh/xmfan/262/orig -> origin/gh/xmfan/262/orig 2025-09-07T06:39:15.3202914Z * [new branch] gh/xmfan/263/base -> origin/gh/xmfan/263/base 2025-09-07T06:39:15.3202983Z * [new branch] gh/xmfan/263/head -> origin/gh/xmfan/263/head 2025-09-07T06:39:15.3203052Z * [new branch] gh/xmfan/263/orig -> origin/gh/xmfan/263/orig 2025-09-07T06:39:15.3203205Z * [new branch] gh/xmfan/264/base -> origin/gh/xmfan/264/base 2025-09-07T06:39:15.3203277Z * [new branch] gh/xmfan/264/head -> origin/gh/xmfan/264/head 2025-09-07T06:39:15.3203346Z * [new branch] gh/xmfan/264/orig -> origin/gh/xmfan/264/orig 2025-09-07T06:39:15.3204387Z * [new branch] gh/xmfan/274/base -> origin/gh/xmfan/274/base 2025-09-07T06:39:15.3204461Z * [new branch] gh/xmfan/274/head -> origin/gh/xmfan/274/head 2025-09-07T06:39:15.3204531Z * [new branch] gh/xmfan/274/orig -> origin/gh/xmfan/274/orig 2025-09-07T06:39:15.3204602Z * [new branch] gh/xmfan/276/base -> origin/gh/xmfan/276/base 2025-09-07T06:39:15.3204671Z * [new branch] gh/xmfan/276/head -> origin/gh/xmfan/276/head 2025-09-07T06:39:15.3204740Z * [new branch] gh/xmfan/276/orig -> origin/gh/xmfan/276/orig 2025-09-07T06:39:15.3204810Z * [new branch] gh/xmfan/277/base -> origin/gh/xmfan/277/base 2025-09-07T06:39:15.3204879Z * [new branch] gh/xmfan/277/head -> origin/gh/xmfan/277/head 2025-09-07T06:39:15.3204948Z * [new branch] gh/xmfan/277/orig -> origin/gh/xmfan/277/orig 2025-09-07T06:39:15.3205024Z * [new branch] gh/xmfan/278/base -> origin/gh/xmfan/278/base 2025-09-07T06:39:15.3205093Z * [new branch] gh/xmfan/278/head -> origin/gh/xmfan/278/head 2025-09-07T06:39:15.3205232Z * [new branch] gh/xmfan/278/orig -> origin/gh/xmfan/278/orig 2025-09-07T06:39:15.3205302Z * [new branch] gh/xmfan/279/base -> origin/gh/xmfan/279/base 2025-09-07T06:39:15.3205371Z * [new branch] gh/xmfan/279/head -> origin/gh/xmfan/279/head 2025-09-07T06:39:15.3205440Z * [new branch] gh/xmfan/279/orig -> origin/gh/xmfan/279/orig 2025-09-07T06:39:15.3205510Z * [new branch] gh/xmfan/280/base -> origin/gh/xmfan/280/base 2025-09-07T06:39:15.3205579Z * [new branch] gh/xmfan/280/head -> origin/gh/xmfan/280/head 2025-09-07T06:39:15.3205649Z * [new branch] gh/xmfan/280/orig -> origin/gh/xmfan/280/orig 2025-09-07T06:39:15.3205782Z * [new branch] gh/xmfan/281/base -> origin/gh/xmfan/281/base 2025-09-07T06:39:15.3205851Z * [new branch] gh/xmfan/281/head -> origin/gh/xmfan/281/head 2025-09-07T06:39:15.3205923Z * [new branch] gh/xmfan/281/orig -> origin/gh/xmfan/281/orig 2025-09-07T06:39:15.3205993Z * [new branch] gh/xmfan/282/base -> origin/gh/xmfan/282/base 2025-09-07T06:39:15.3206062Z * [new branch] gh/xmfan/282/head -> origin/gh/xmfan/282/head 2025-09-07T06:39:15.3206131Z * [new branch] gh/xmfan/283/base -> origin/gh/xmfan/283/base 2025-09-07T06:39:15.3207166Z * [new branch] gh/xmfan/283/head -> origin/gh/xmfan/283/head 2025-09-07T06:39:15.3207239Z * [new branch] gh/xmfan/283/orig -> origin/gh/xmfan/283/orig 2025-09-07T06:39:15.3207322Z * [new branch] gh/xuanzhang816/14/base -> origin/gh/xuanzhang816/14/base 2025-09-07T06:39:15.3207409Z * [new branch] gh/xuanzhang816/14/head -> origin/gh/xuanzhang816/14/head 2025-09-07T06:39:15.3207489Z * [new branch] gh/xuanzhang816/14/orig -> origin/gh/xuanzhang816/14/orig 2025-09-07T06:39:15.3207570Z * [new branch] gh/xuanzhang816/19/base -> origin/gh/xuanzhang816/19/base 2025-09-07T06:39:15.3207649Z * [new branch] gh/xuanzhang816/19/head -> origin/gh/xuanzhang816/19/head 2025-09-07T06:39:15.3207729Z * [new branch] gh/xuanzhang816/19/orig -> origin/gh/xuanzhang816/19/orig 2025-09-07T06:39:15.3207808Z * [new branch] gh/xuanzhang816/22/base -> origin/gh/xuanzhang816/22/base 2025-09-07T06:39:15.3207885Z * [new branch] gh/xuanzhang816/22/head -> origin/gh/xuanzhang816/22/head 2025-09-07T06:39:15.3207965Z * [new branch] gh/xuanzhang816/22/orig -> origin/gh/xuanzhang816/22/orig 2025-09-07T06:39:15.3208046Z * [new branch] gh/xuanzhang816/23/base -> origin/gh/xuanzhang816/23/base 2025-09-07T06:39:15.3208125Z * [new branch] gh/xuanzhang816/23/head -> origin/gh/xuanzhang816/23/head 2025-09-07T06:39:15.3208203Z * [new branch] gh/xuanzhang816/23/orig -> origin/gh/xuanzhang816/23/orig 2025-09-07T06:39:15.3208350Z * [new branch] gh/xuanzhang816/24/base -> origin/gh/xuanzhang816/24/base 2025-09-07T06:39:15.3208428Z * [new branch] gh/xuanzhang816/24/head -> origin/gh/xuanzhang816/24/head 2025-09-07T06:39:15.3208507Z * [new branch] gh/xuanzhang816/24/orig -> origin/gh/xuanzhang816/24/orig 2025-09-07T06:39:15.3208586Z * [new branch] gh/xuanzhang816/25/base -> origin/gh/xuanzhang816/25/base 2025-09-07T06:39:15.3208664Z * [new branch] gh/xuanzhang816/25/head -> origin/gh/xuanzhang816/25/head 2025-09-07T06:39:15.3208742Z * [new branch] gh/xuanzhang816/25/orig -> origin/gh/xuanzhang816/25/orig 2025-09-07T06:39:15.3208822Z * [new branch] gh/xuanzhang816/26/base -> origin/gh/xuanzhang816/26/base 2025-09-07T06:39:15.3208900Z * [new branch] gh/xuanzhang816/26/head -> origin/gh/xuanzhang816/26/head 2025-09-07T06:39:15.3209018Z * [new branch] gh/xuanzhang816/26/orig -> origin/gh/xuanzhang816/26/orig 2025-09-07T06:39:15.3209097Z * [new branch] gh/yanbing-j/11/base -> origin/gh/yanbing-j/11/base 2025-09-07T06:39:15.3209172Z * [new branch] gh/yanbing-j/11/head -> origin/gh/yanbing-j/11/head 2025-09-07T06:39:15.3210218Z * [new branch] gh/yanbing-j/11/orig -> origin/gh/yanbing-j/11/orig 2025-09-07T06:39:15.3210294Z * [new branch] gh/yanbing-j/12/base -> origin/gh/yanbing-j/12/base 2025-09-07T06:39:15.3210368Z * [new branch] gh/yanbing-j/12/head -> origin/gh/yanbing-j/12/head 2025-09-07T06:39:15.3210480Z * [new branch] gh/yanbing-j/12/orig -> origin/gh/yanbing-j/12/orig 2025-09-07T06:39:15.3210552Z * [new branch] gh/yanbing-j/13/base -> origin/gh/yanbing-j/13/base 2025-09-07T06:39:15.3210624Z * [new branch] gh/yanbing-j/13/head -> origin/gh/yanbing-j/13/head 2025-09-07T06:39:15.3210703Z * [new branch] gh/yanbing-j/13/orig -> origin/gh/yanbing-j/13/orig 2025-09-07T06:39:15.3210775Z * [new branch] gh/yanbing-j/14/base -> origin/gh/yanbing-j/14/base 2025-09-07T06:39:15.3210847Z * [new branch] gh/yanbing-j/14/head -> origin/gh/yanbing-j/14/head 2025-09-07T06:39:15.3210921Z * [new branch] gh/yanbing-j/14/orig -> origin/gh/yanbing-j/14/orig 2025-09-07T06:39:15.3210993Z * [new branch] gh/yanbing-j/15/base -> origin/gh/yanbing-j/15/base 2025-09-07T06:39:15.3211065Z * [new branch] gh/yanbing-j/15/head -> origin/gh/yanbing-j/15/head 2025-09-07T06:39:15.3211140Z * [new branch] gh/yanbing-j/15/orig -> origin/gh/yanbing-j/15/orig 2025-09-07T06:39:15.3211213Z * [new branch] gh/yanbing-j/18/base -> origin/gh/yanbing-j/18/base 2025-09-07T06:39:15.3211285Z * [new branch] gh/yanbing-j/18/head -> origin/gh/yanbing-j/18/head 2025-09-07T06:39:15.3211359Z * [new branch] gh/yanbing-j/18/orig -> origin/gh/yanbing-j/18/orig 2025-09-07T06:39:15.3211432Z * [new branch] gh/yanbing-j/19/base -> origin/gh/yanbing-j/19/base 2025-09-07T06:39:15.3211504Z * [new branch] gh/yanbing-j/19/head -> origin/gh/yanbing-j/19/head 2025-09-07T06:39:15.3211577Z * [new branch] gh/yanbing-j/19/orig -> origin/gh/yanbing-j/19/orig 2025-09-07T06:39:15.3211650Z * [new branch] gh/yanbing-j/20/base -> origin/gh/yanbing-j/20/base 2025-09-07T06:39:15.3211723Z * [new branch] gh/yanbing-j/20/head -> origin/gh/yanbing-j/20/head 2025-09-07T06:39:15.3211800Z * [new branch] gh/yanbing-j/20/orig -> origin/gh/yanbing-j/20/orig 2025-09-07T06:39:15.3211874Z * [new branch] gh/yanbing-j/21/base -> origin/gh/yanbing-j/21/base 2025-09-07T06:39:15.3211948Z * [new branch] gh/yanbing-j/21/head -> origin/gh/yanbing-j/21/head 2025-09-07T06:39:15.3212970Z * [new branch] gh/yanbing-j/22/base -> origin/gh/yanbing-j/22/base 2025-09-07T06:39:15.3213046Z * [new branch] gh/yanbing-j/22/head -> origin/gh/yanbing-j/22/head 2025-09-07T06:39:15.3213179Z * [new branch] gh/yanbing-j/22/orig -> origin/gh/yanbing-j/22/orig 2025-09-07T06:39:15.3213254Z * [new branch] gh/yanbing-j/23/base -> origin/gh/yanbing-j/23/base 2025-09-07T06:39:15.3213327Z * [new branch] gh/yanbing-j/23/head -> origin/gh/yanbing-j/23/head 2025-09-07T06:39:15.3213399Z * [new branch] gh/yanbing-j/23/orig -> origin/gh/yanbing-j/23/orig 2025-09-07T06:39:15.3213477Z * [new branch] gh/yanbing-j/24/base -> origin/gh/yanbing-j/24/base 2025-09-07T06:39:15.3213550Z * [new branch] gh/yanbing-j/24/head -> origin/gh/yanbing-j/24/head 2025-09-07T06:39:15.3213683Z * [new branch] gh/yanbing-j/24/orig -> origin/gh/yanbing-j/24/orig 2025-09-07T06:39:15.3213756Z * [new branch] gh/yanbing-j/25/base -> origin/gh/yanbing-j/25/base 2025-09-07T06:39:15.3213829Z * [new branch] gh/yanbing-j/25/head -> origin/gh/yanbing-j/25/head 2025-09-07T06:39:15.3213901Z * [new branch] gh/yanbing-j/25/orig -> origin/gh/yanbing-j/25/orig 2025-09-07T06:39:15.3213973Z * [new branch] gh/yanbing-j/26/base -> origin/gh/yanbing-j/26/base 2025-09-07T06:39:15.3214045Z * [new branch] gh/yanbing-j/26/head -> origin/gh/yanbing-j/26/head 2025-09-07T06:39:15.3214117Z * [new branch] gh/yanbing-j/26/orig -> origin/gh/yanbing-j/26/orig 2025-09-07T06:39:15.3214245Z * [new branch] gh/yanbing-j/36/base -> origin/gh/yanbing-j/36/base 2025-09-07T06:39:15.3214318Z * [new branch] gh/yanbing-j/36/head -> origin/gh/yanbing-j/36/head 2025-09-07T06:39:15.3214392Z * [new branch] gh/yanbing-j/36/orig -> origin/gh/yanbing-j/36/orig 2025-09-07T06:39:15.3214464Z * [new branch] gh/yanbing-j/37/base -> origin/gh/yanbing-j/37/base 2025-09-07T06:39:15.3214536Z * [new branch] gh/yanbing-j/37/head -> origin/gh/yanbing-j/37/head 2025-09-07T06:39:15.3214609Z * [new branch] gh/yanbing-j/37/orig -> origin/gh/yanbing-j/37/orig 2025-09-07T06:39:15.3214683Z * [new branch] gh/yangw-dev/12/base -> origin/gh/yangw-dev/12/base 2025-09-07T06:39:15.3214755Z * [new branch] gh/yangw-dev/12/head -> origin/gh/yangw-dev/12/head 2025-09-07T06:39:15.3214832Z * [new branch] gh/yangw-dev/12/orig -> origin/gh/yangw-dev/12/orig 2025-09-07T06:39:15.3215877Z * [new branch] gh/yangw-dev/13/base -> origin/gh/yangw-dev/13/base 2025-09-07T06:39:15.3215955Z * [new branch] gh/yangw-dev/13/head -> origin/gh/yangw-dev/13/head 2025-09-07T06:39:15.3216031Z * [new branch] gh/yangw-dev/13/orig -> origin/gh/yangw-dev/13/orig 2025-09-07T06:39:15.3216103Z * [new branch] gh/yangw-dev/14/base -> origin/gh/yangw-dev/14/base 2025-09-07T06:39:15.3216175Z * [new branch] gh/yangw-dev/14/head -> origin/gh/yangw-dev/14/head 2025-09-07T06:39:15.3216248Z * [new branch] gh/yangw-dev/14/orig -> origin/gh/yangw-dev/14/orig 2025-09-07T06:39:15.3216320Z * [new branch] gh/yangw-dev/15/base -> origin/gh/yangw-dev/15/base 2025-09-07T06:39:15.3216392Z * [new branch] gh/yangw-dev/15/head -> origin/gh/yangw-dev/15/head 2025-09-07T06:39:15.3216470Z * [new branch] gh/yangw-dev/15/orig -> origin/gh/yangw-dev/15/orig 2025-09-07T06:39:15.3216541Z * [new branch] gh/yangw-dev/16/base -> origin/gh/yangw-dev/16/base 2025-09-07T06:39:15.3216615Z * [new branch] gh/yangw-dev/16/head -> origin/gh/yangw-dev/16/head 2025-09-07T06:39:15.3216688Z * [new branch] gh/yangw-dev/16/orig -> origin/gh/yangw-dev/16/orig 2025-09-07T06:39:15.3216760Z * [new branch] gh/yangw-dev/17/base -> origin/gh/yangw-dev/17/base 2025-09-07T06:39:15.3216831Z * [new branch] gh/yangw-dev/17/head -> origin/gh/yangw-dev/17/head 2025-09-07T06:39:15.3216905Z * [new branch] gh/yangw-dev/17/orig -> origin/gh/yangw-dev/17/orig 2025-09-07T06:39:15.3216977Z * [new branch] gh/yangw-dev/18/base -> origin/gh/yangw-dev/18/base 2025-09-07T06:39:15.3217049Z * [new branch] gh/yangw-dev/18/head -> origin/gh/yangw-dev/18/head 2025-09-07T06:39:15.3217124Z * [new branch] gh/yangw-dev/18/orig -> origin/gh/yangw-dev/18/orig 2025-09-07T06:39:15.3217196Z * [new branch] gh/yangw-dev/19/base -> origin/gh/yangw-dev/19/base 2025-09-07T06:39:15.3217312Z * [new branch] gh/yangw-dev/19/head -> origin/gh/yangw-dev/19/head 2025-09-07T06:39:15.3217385Z * [new branch] gh/yangw-dev/19/orig -> origin/gh/yangw-dev/19/orig 2025-09-07T06:39:15.3217457Z * [new branch] gh/yangw-dev/20/base -> origin/gh/yangw-dev/20/base 2025-09-07T06:39:15.3217529Z * [new branch] gh/yangw-dev/20/head -> origin/gh/yangw-dev/20/head 2025-09-07T06:39:15.3217601Z * [new branch] gh/yangw-dev/20/orig -> origin/gh/yangw-dev/20/orig 2025-09-07T06:39:15.3218616Z * [new branch] gh/yangw-dev/21/base -> origin/gh/yangw-dev/21/base 2025-09-07T06:39:15.3218691Z * [new branch] gh/yangw-dev/21/head -> origin/gh/yangw-dev/21/head 2025-09-07T06:39:15.3218806Z * [new branch] gh/yangw-dev/21/orig -> origin/gh/yangw-dev/21/orig 2025-09-07T06:39:15.3218879Z * [new branch] gh/yangw-dev/22/base -> origin/gh/yangw-dev/22/base 2025-09-07T06:39:15.3218953Z * [new branch] gh/yangw-dev/22/head -> origin/gh/yangw-dev/22/head 2025-09-07T06:39:15.3219025Z * [new branch] gh/yangw-dev/22/orig -> origin/gh/yangw-dev/22/orig 2025-09-07T06:39:15.3219097Z * [new branch] gh/yangw-dev/23/base -> origin/gh/yangw-dev/23/base 2025-09-07T06:39:15.3219169Z * [new branch] gh/yangw-dev/23/head -> origin/gh/yangw-dev/23/head 2025-09-07T06:39:15.3219242Z * [new branch] gh/yangw-dev/23/orig -> origin/gh/yangw-dev/23/orig 2025-09-07T06:39:15.3219315Z * [new branch] gh/yangw-dev/24/base -> origin/gh/yangw-dev/24/base 2025-09-07T06:39:15.3219391Z * [new branch] gh/yangw-dev/24/head -> origin/gh/yangw-dev/24/head 2025-09-07T06:39:15.3219463Z * [new branch] gh/yangw-dev/24/orig -> origin/gh/yangw-dev/24/orig 2025-09-07T06:39:15.3219537Z * [new branch] gh/yangw-dev/25/base -> origin/gh/yangw-dev/25/base 2025-09-07T06:39:15.3219611Z * [new branch] gh/yangw-dev/25/head -> origin/gh/yangw-dev/25/head 2025-09-07T06:39:15.3219683Z * [new branch] gh/yangw-dev/25/orig -> origin/gh/yangw-dev/25/orig 2025-09-07T06:39:15.3219756Z * [new branch] gh/yangw-dev/26/base -> origin/gh/yangw-dev/26/base 2025-09-07T06:39:15.3219829Z * [new branch] gh/yangw-dev/26/head -> origin/gh/yangw-dev/26/head 2025-09-07T06:39:15.3219901Z * [new branch] gh/yangw-dev/26/orig -> origin/gh/yangw-dev/26/orig 2025-09-07T06:39:15.3219974Z * [new branch] gh/yangw-dev/27/base -> origin/gh/yangw-dev/27/base 2025-09-07T06:39:15.3220049Z * [new branch] gh/yangw-dev/27/head -> origin/gh/yangw-dev/27/head 2025-09-07T06:39:15.3220121Z * [new branch] gh/yangw-dev/27/orig -> origin/gh/yangw-dev/27/orig 2025-09-07T06:39:15.3220198Z * [new branch] gh/ydwu4/233/base -> origin/gh/ydwu4/233/base 2025-09-07T06:39:15.3220269Z * [new branch] gh/ydwu4/233/head -> origin/gh/ydwu4/233/head 2025-09-07T06:39:15.3220339Z * [new branch] gh/ydwu4/233/orig -> origin/gh/ydwu4/233/orig 2025-09-07T06:39:15.3221565Z * [new branch] gh/ydwu4/246/base -> origin/gh/ydwu4/246/base 2025-09-07T06:39:15.3221684Z * [new branch] gh/ydwu4/246/head -> origin/gh/ydwu4/246/head 2025-09-07T06:39:15.3221753Z * [new branch] gh/ydwu4/246/orig -> origin/gh/ydwu4/246/orig 2025-09-07T06:39:15.3221823Z * [new branch] gh/ydwu4/253/base -> origin/gh/ydwu4/253/base 2025-09-07T06:39:15.3221898Z * [new branch] gh/ydwu4/253/head -> origin/gh/ydwu4/253/head 2025-09-07T06:39:15.3221966Z * [new branch] gh/ydwu4/253/orig -> origin/gh/ydwu4/253/orig 2025-09-07T06:39:15.3222077Z * [new branch] gh/ydwu4/255/base -> origin/gh/ydwu4/255/base 2025-09-07T06:39:15.3222147Z * [new branch] gh/ydwu4/255/head -> origin/gh/ydwu4/255/head 2025-09-07T06:39:15.3222216Z * [new branch] gh/ydwu4/255/orig -> origin/gh/ydwu4/255/orig 2025-09-07T06:39:15.3222287Z * [new branch] gh/ydwu4/259/base -> origin/gh/ydwu4/259/base 2025-09-07T06:39:15.3222356Z * [new branch] gh/ydwu4/259/head -> origin/gh/ydwu4/259/head 2025-09-07T06:39:15.3222425Z * [new branch] gh/ydwu4/259/orig -> origin/gh/ydwu4/259/orig 2025-09-07T06:39:15.3222494Z * [new branch] gh/ydwu4/262/base -> origin/gh/ydwu4/262/base 2025-09-07T06:39:15.3222606Z * [new branch] gh/ydwu4/262/head -> origin/gh/ydwu4/262/head 2025-09-07T06:39:15.3222675Z * [new branch] gh/ydwu4/262/orig -> origin/gh/ydwu4/262/orig 2025-09-07T06:39:15.3222745Z * [new branch] gh/ydwu4/263/base -> origin/gh/ydwu4/263/base 2025-09-07T06:39:15.3222814Z * [new branch] gh/ydwu4/263/head -> origin/gh/ydwu4/263/head 2025-09-07T06:39:15.3222884Z * [new branch] gh/ydwu4/263/orig -> origin/gh/ydwu4/263/orig 2025-09-07T06:39:15.3222952Z * [new branch] gh/ydwu4/269/base -> origin/gh/ydwu4/269/base 2025-09-07T06:39:15.3223022Z * [new branch] gh/ydwu4/269/head -> origin/gh/ydwu4/269/head 2025-09-07T06:39:15.3223164Z * [new branch] gh/ydwu4/269/orig -> origin/gh/ydwu4/269/orig 2025-09-07T06:39:15.3223236Z * [new branch] gh/ydwu4/270/base -> origin/gh/ydwu4/270/base 2025-09-07T06:39:15.3223308Z * [new branch] gh/ydwu4/270/head -> origin/gh/ydwu4/270/head 2025-09-07T06:39:15.3223378Z * [new branch] gh/ydwu4/270/orig -> origin/gh/ydwu4/270/orig 2025-09-07T06:39:15.3223447Z * [new branch] gh/ydwu4/272/base -> origin/gh/ydwu4/272/base 2025-09-07T06:39:15.3224480Z * [new branch] gh/ydwu4/272/head -> origin/gh/ydwu4/272/head 2025-09-07T06:39:15.3224551Z * [new branch] gh/ydwu4/272/orig -> origin/gh/ydwu4/272/orig 2025-09-07T06:39:15.3224620Z * [new branch] gh/ydwu4/275/base -> origin/gh/ydwu4/275/base 2025-09-07T06:39:15.3224689Z * [new branch] gh/ydwu4/275/head -> origin/gh/ydwu4/275/head 2025-09-07T06:39:15.3224758Z * [new branch] gh/ydwu4/275/orig -> origin/gh/ydwu4/275/orig 2025-09-07T06:39:15.3224827Z * [new branch] gh/ydwu4/276/base -> origin/gh/ydwu4/276/base 2025-09-07T06:39:15.3224902Z * [new branch] gh/ydwu4/276/head -> origin/gh/ydwu4/276/head 2025-09-07T06:39:15.3224971Z * [new branch] gh/ydwu4/276/orig -> origin/gh/ydwu4/276/orig 2025-09-07T06:39:15.3225041Z * [new branch] gh/ydwu4/279/base -> origin/gh/ydwu4/279/base 2025-09-07T06:39:15.3225111Z * [new branch] gh/ydwu4/279/head -> origin/gh/ydwu4/279/head 2025-09-07T06:39:15.3225180Z * [new branch] gh/ydwu4/279/orig -> origin/gh/ydwu4/279/orig 2025-09-07T06:39:15.3225248Z * [new branch] gh/ydwu4/283/base -> origin/gh/ydwu4/283/base 2025-09-07T06:39:15.3225317Z * [new branch] gh/ydwu4/283/head -> origin/gh/ydwu4/283/head 2025-09-07T06:39:15.3225386Z * [new branch] gh/ydwu4/283/orig -> origin/gh/ydwu4/283/orig 2025-09-07T06:39:15.3225456Z * [new branch] gh/ydwu4/289/base -> origin/gh/ydwu4/289/base 2025-09-07T06:39:15.3225528Z * [new branch] gh/ydwu4/289/head -> origin/gh/ydwu4/289/head 2025-09-07T06:39:15.3225598Z * [new branch] gh/ydwu4/289/orig -> origin/gh/ydwu4/289/orig 2025-09-07T06:39:15.3225726Z * [new branch] gh/ydwu4/290/base -> origin/gh/ydwu4/290/base 2025-09-07T06:39:15.3225796Z * [new branch] gh/ydwu4/290/head -> origin/gh/ydwu4/290/head 2025-09-07T06:39:15.3225865Z * [new branch] gh/ydwu4/290/orig -> origin/gh/ydwu4/290/orig 2025-09-07T06:39:15.3225934Z * [new branch] gh/ydwu4/291/base -> origin/gh/ydwu4/291/base 2025-09-07T06:39:15.3226003Z * [new branch] gh/ydwu4/291/head -> origin/gh/ydwu4/291/head 2025-09-07T06:39:15.3226072Z * [new branch] gh/ydwu4/291/orig -> origin/gh/ydwu4/291/orig 2025-09-07T06:39:15.3226141Z * [new branch] gh/ydwu4/292/base -> origin/gh/ydwu4/292/base 2025-09-07T06:39:15.3227217Z * [new branch] gh/ydwu4/292/head -> origin/gh/ydwu4/292/head 2025-09-07T06:39:15.3227290Z * [new branch] gh/ydwu4/292/orig -> origin/gh/ydwu4/292/orig 2025-09-07T06:39:15.3227360Z * [new branch] gh/ydwu4/293/base -> origin/gh/ydwu4/293/base 2025-09-07T06:39:15.3227429Z * [new branch] gh/ydwu4/293/head -> origin/gh/ydwu4/293/head 2025-09-07T06:39:15.3227498Z * [new branch] gh/ydwu4/293/orig -> origin/gh/ydwu4/293/orig 2025-09-07T06:39:15.3227567Z * [new branch] gh/ydwu4/294/base -> origin/gh/ydwu4/294/base 2025-09-07T06:39:15.3227636Z * [new branch] gh/ydwu4/294/head -> origin/gh/ydwu4/294/head 2025-09-07T06:39:15.3227705Z * [new branch] gh/ydwu4/294/orig -> origin/gh/ydwu4/294/orig 2025-09-07T06:39:15.3227773Z * [new branch] gh/ydwu4/295/base -> origin/gh/ydwu4/295/base 2025-09-07T06:39:15.3227844Z * [new branch] gh/ydwu4/295/head -> origin/gh/ydwu4/295/head 2025-09-07T06:39:15.3227914Z * [new branch] gh/ydwu4/295/orig -> origin/gh/ydwu4/295/orig 2025-09-07T06:39:15.3227984Z * [new branch] gh/ydwu4/296/base -> origin/gh/ydwu4/296/base 2025-09-07T06:39:15.3228052Z * [new branch] gh/ydwu4/296/head -> origin/gh/ydwu4/296/head 2025-09-07T06:39:15.3228120Z * [new branch] gh/ydwu4/296/orig -> origin/gh/ydwu4/296/orig 2025-09-07T06:39:15.3228190Z * [new branch] gh/ydwu4/300/base -> origin/gh/ydwu4/300/base 2025-09-07T06:39:15.3228258Z * [new branch] gh/ydwu4/300/head -> origin/gh/ydwu4/300/head 2025-09-07T06:39:15.3228327Z * [new branch] gh/ydwu4/300/orig -> origin/gh/ydwu4/300/orig 2025-09-07T06:39:15.3228397Z * [new branch] gh/ydwu4/301/base -> origin/gh/ydwu4/301/base 2025-09-07T06:39:15.3228467Z * [new branch] gh/ydwu4/301/head -> origin/gh/ydwu4/301/head 2025-09-07T06:39:15.3228535Z * [new branch] gh/ydwu4/301/orig -> origin/gh/ydwu4/301/orig 2025-09-07T06:39:15.3228606Z * [new branch] gh/ydwu4/302/base -> origin/gh/ydwu4/302/base 2025-09-07T06:39:15.3228675Z * [new branch] gh/ydwu4/302/head -> origin/gh/ydwu4/302/head 2025-09-07T06:39:15.3228743Z * [new branch] gh/ydwu4/302/orig -> origin/gh/ydwu4/302/orig 2025-09-07T06:39:15.3228813Z * [new branch] gh/ydwu4/303/base -> origin/gh/ydwu4/303/base 2025-09-07T06:39:15.3229817Z * [new branch] gh/ydwu4/303/head -> origin/gh/ydwu4/303/head 2025-09-07T06:39:15.3229889Z * [new branch] gh/ydwu4/303/orig -> origin/gh/ydwu4/303/orig 2025-09-07T06:39:15.3229958Z * [new branch] gh/ydwu4/304/base -> origin/gh/ydwu4/304/base 2025-09-07T06:39:15.3230030Z * [new branch] gh/ydwu4/304/head -> origin/gh/ydwu4/304/head 2025-09-07T06:39:15.3230098Z * [new branch] gh/ydwu4/304/orig -> origin/gh/ydwu4/304/orig 2025-09-07T06:39:15.3230209Z * [new branch] gh/ydwu4/305/base -> origin/gh/ydwu4/305/base 2025-09-07T06:39:15.3230278Z * [new branch] gh/ydwu4/305/head -> origin/gh/ydwu4/305/head 2025-09-07T06:39:15.3230347Z * [new branch] gh/ydwu4/305/orig -> origin/gh/ydwu4/305/orig 2025-09-07T06:39:15.3230417Z * [new branch] gh/ydwu4/306/base -> origin/gh/ydwu4/306/base 2025-09-07T06:39:15.3230486Z * [new branch] gh/ydwu4/306/head -> origin/gh/ydwu4/306/head 2025-09-07T06:39:15.3230554Z * [new branch] gh/ydwu4/306/orig -> origin/gh/ydwu4/306/orig 2025-09-07T06:39:15.3230624Z * [new branch] gh/ydwu4/307/base -> origin/gh/ydwu4/307/base 2025-09-07T06:39:15.3230732Z * [new branch] gh/ydwu4/307/head -> origin/gh/ydwu4/307/head 2025-09-07T06:39:15.3230801Z * [new branch] gh/ydwu4/307/orig -> origin/gh/ydwu4/307/orig 2025-09-07T06:39:15.3230872Z * [new branch] gh/ydwu4/308/base -> origin/gh/ydwu4/308/base 2025-09-07T06:39:15.3230941Z * [new branch] gh/ydwu4/308/head -> origin/gh/ydwu4/308/head 2025-09-07T06:39:15.3231009Z * [new branch] gh/ydwu4/308/orig -> origin/gh/ydwu4/308/orig 2025-09-07T06:39:15.3231078Z * [new branch] gh/ydwu4/309/base -> origin/gh/ydwu4/309/base 2025-09-07T06:39:15.3231148Z * [new branch] gh/ydwu4/309/head -> origin/gh/ydwu4/309/head 2025-09-07T06:39:15.3231217Z * [new branch] gh/ydwu4/309/orig -> origin/gh/ydwu4/309/orig 2025-09-07T06:39:15.3231286Z * [new branch] gh/ydwu4/310/base -> origin/gh/ydwu4/310/base 2025-09-07T06:39:15.3231357Z * [new branch] gh/ydwu4/310/head -> origin/gh/ydwu4/310/head 2025-09-07T06:39:15.3231426Z * [new branch] gh/ydwu4/310/orig -> origin/gh/ydwu4/310/orig 2025-09-07T06:39:15.3231497Z * [new branch] gh/ydwu4/311/base -> origin/gh/ydwu4/311/base 2025-09-07T06:39:15.3232520Z * [new branch] gh/ydwu4/311/head -> origin/gh/ydwu4/311/head 2025-09-07T06:39:15.3232592Z * [new branch] gh/ydwu4/311/orig -> origin/gh/ydwu4/311/orig 2025-09-07T06:39:15.3232661Z * [new branch] gh/ydwu4/312/base -> origin/gh/ydwu4/312/base 2025-09-07T06:39:15.3232730Z * [new branch] gh/ydwu4/312/head -> origin/gh/ydwu4/312/head 2025-09-07T06:39:15.3232799Z * [new branch] gh/ydwu4/312/orig -> origin/gh/ydwu4/312/orig 2025-09-07T06:39:15.3232868Z * [new branch] gh/ydwu4/313/base -> origin/gh/ydwu4/313/base 2025-09-07T06:39:15.3232944Z * [new branch] gh/ydwu4/313/head -> origin/gh/ydwu4/313/head 2025-09-07T06:39:15.3233013Z * [new branch] gh/ydwu4/313/orig -> origin/gh/ydwu4/313/orig 2025-09-07T06:39:15.3233157Z * [new branch] gh/ydwu4/314/base -> origin/gh/ydwu4/314/base 2025-09-07T06:39:15.3233229Z * [new branch] gh/ydwu4/314/head -> origin/gh/ydwu4/314/head 2025-09-07T06:39:15.3233298Z * [new branch] gh/ydwu4/314/orig -> origin/gh/ydwu4/314/orig 2025-09-07T06:39:15.3233367Z * [new branch] gh/ydwu4/315/base -> origin/gh/ydwu4/315/base 2025-09-07T06:39:15.3233437Z * [new branch] gh/ydwu4/315/head -> origin/gh/ydwu4/315/head 2025-09-07T06:39:15.3233506Z * [new branch] gh/ydwu4/315/orig -> origin/gh/ydwu4/315/orig 2025-09-07T06:39:15.3233575Z * [new branch] gh/ydwu4/316/base -> origin/gh/ydwu4/316/base 2025-09-07T06:39:15.3233647Z * [new branch] gh/ydwu4/316/head -> origin/gh/ydwu4/316/head 2025-09-07T06:39:15.3233716Z * [new branch] gh/ydwu4/316/orig -> origin/gh/ydwu4/316/orig 2025-09-07T06:39:15.3233843Z * [new branch] gh/ydwu4/317/base -> origin/gh/ydwu4/317/base 2025-09-07T06:39:15.3233913Z * [new branch] gh/ydwu4/317/head -> origin/gh/ydwu4/317/head 2025-09-07T06:39:15.3233984Z * [new branch] gh/ydwu4/317/orig -> origin/gh/ydwu4/317/orig 2025-09-07T06:39:15.3234052Z * [new branch] gh/ydwu4/318/base -> origin/gh/ydwu4/318/base 2025-09-07T06:39:15.3234122Z * [new branch] gh/ydwu4/318/head -> origin/gh/ydwu4/318/head 2025-09-07T06:39:15.3234192Z * [new branch] gh/ydwu4/318/orig -> origin/gh/ydwu4/318/orig 2025-09-07T06:39:15.3234261Z * [new branch] gh/ydwu4/319/base -> origin/gh/ydwu4/319/base 2025-09-07T06:39:15.3234385Z * [new branch] gh/ydwu4/319/head -> origin/gh/ydwu4/319/head 2025-09-07T06:39:15.3235430Z * [new branch] gh/ydwu4/319/orig -> origin/gh/ydwu4/319/orig 2025-09-07T06:39:15.3235502Z * [new branch] gh/ydwu4/320/base -> origin/gh/ydwu4/320/base 2025-09-07T06:39:15.3235571Z * [new branch] gh/ydwu4/320/head -> origin/gh/ydwu4/320/head 2025-09-07T06:39:15.3235641Z * [new branch] gh/ydwu4/320/orig -> origin/gh/ydwu4/320/orig 2025-09-07T06:39:15.3235710Z * [new branch] gh/ydwu4/321/base -> origin/gh/ydwu4/321/base 2025-09-07T06:39:15.3235780Z * [new branch] gh/ydwu4/321/head -> origin/gh/ydwu4/321/head 2025-09-07T06:39:15.3235850Z * [new branch] gh/ydwu4/321/orig -> origin/gh/ydwu4/321/orig 2025-09-07T06:39:15.3235919Z * [new branch] gh/ydwu4/322/base -> origin/gh/ydwu4/322/base 2025-09-07T06:39:15.3235994Z * [new branch] gh/ydwu4/322/head -> origin/gh/ydwu4/322/head 2025-09-07T06:39:15.3236064Z * [new branch] gh/ydwu4/322/orig -> origin/gh/ydwu4/322/orig 2025-09-07T06:39:15.3236135Z * [new branch] gh/ydwu4/323/base -> origin/gh/ydwu4/323/base 2025-09-07T06:39:15.3236204Z * [new branch] gh/ydwu4/323/head -> origin/gh/ydwu4/323/head 2025-09-07T06:39:15.3236275Z * [new branch] gh/ydwu4/323/orig -> origin/gh/ydwu4/323/orig 2025-09-07T06:39:15.3236343Z * [new branch] gh/ydwu4/324/base -> origin/gh/ydwu4/324/base 2025-09-07T06:39:15.3236413Z * [new branch] gh/ydwu4/324/head -> origin/gh/ydwu4/324/head 2025-09-07T06:39:15.3236483Z * [new branch] gh/ydwu4/324/orig -> origin/gh/ydwu4/324/orig 2025-09-07T06:39:15.3236552Z * [new branch] gh/yf225/133/base -> origin/gh/yf225/133/base 2025-09-07T06:39:15.3236622Z * [new branch] gh/yf225/133/head -> origin/gh/yf225/133/head 2025-09-07T06:39:15.3236690Z * [new branch] gh/yf225/171/base -> origin/gh/yf225/171/base 2025-09-07T06:39:15.3236760Z * [new branch] gh/yf225/171/head -> origin/gh/yf225/171/head 2025-09-07T06:39:15.3236829Z * [new branch] gh/yf225/171/orig -> origin/gh/yf225/171/orig 2025-09-07T06:39:15.3236897Z * [new branch] gh/yf225/172/base -> origin/gh/yf225/172/base 2025-09-07T06:39:15.3236966Z * [new branch] gh/yf225/172/head -> origin/gh/yf225/172/head 2025-09-07T06:39:15.3237034Z * [new branch] gh/yf225/172/orig -> origin/gh/yf225/172/orig 2025-09-07T06:39:15.3238048Z * [new branch] gh/yf225/93/base -> origin/gh/yf225/93/base 2025-09-07T06:39:15.3238121Z * [new branch] gh/yf225/93/head -> origin/gh/yf225/93/head 2025-09-07T06:39:15.3238202Z * [new branch] gh/yifuwang/152/base -> origin/gh/yifuwang/152/base 2025-09-07T06:39:15.3238277Z * [new branch] gh/yifuwang/152/head -> origin/gh/yifuwang/152/head 2025-09-07T06:39:15.3238391Z * [new branch] gh/yifuwang/152/orig -> origin/gh/yifuwang/152/orig 2025-09-07T06:39:15.3238466Z * [new branch] gh/yifuwang/195/base -> origin/gh/yifuwang/195/base 2025-09-07T06:39:15.3238541Z * [new branch] gh/yifuwang/195/head -> origin/gh/yifuwang/195/head 2025-09-07T06:39:15.3238616Z * [new branch] gh/yifuwang/195/orig -> origin/gh/yifuwang/195/orig 2025-09-07T06:39:15.3238693Z * [new branch] gh/yiming0416/1/base -> origin/gh/yiming0416/1/base 2025-09-07T06:39:15.3238767Z * [new branch] gh/yiming0416/1/head -> origin/gh/yiming0416/1/head 2025-09-07T06:39:15.3238876Z * [new branch] gh/yiming0416/2/base -> origin/gh/yiming0416/2/base 2025-09-07T06:39:15.3238950Z * [new branch] gh/yiming0416/2/head -> origin/gh/yiming0416/2/head 2025-09-07T06:39:15.3239026Z * [new branch] gh/ysiraichi/79/base -> origin/gh/ysiraichi/79/base 2025-09-07T06:39:15.3239103Z * [new branch] gh/ysiraichi/79/head -> origin/gh/ysiraichi/79/head 2025-09-07T06:39:15.3239177Z * [new branch] gh/ysiraichi/79/orig -> origin/gh/ysiraichi/79/orig 2025-09-07T06:39:15.3239251Z * [new branch] gh/ysiraichi/88/base -> origin/gh/ysiraichi/88/base 2025-09-07T06:39:15.3239327Z * [new branch] gh/ysiraichi/88/head -> origin/gh/ysiraichi/88/head 2025-09-07T06:39:15.3239401Z * [new branch] gh/ysiraichi/88/orig -> origin/gh/ysiraichi/88/orig 2025-09-07T06:39:15.3239474Z * [new branch] gh/zhxchen17/25/base -> origin/gh/zhxchen17/25/base 2025-09-07T06:39:15.3239551Z * [new branch] gh/zhxchen17/25/head -> origin/gh/zhxchen17/25/head 2025-09-07T06:39:15.3239625Z * [new branch] gh/zhxchen17/25/orig -> origin/gh/zhxchen17/25/orig 2025-09-07T06:39:15.3239700Z * [new branch] gh/zhxchen17/31/base -> origin/gh/zhxchen17/31/base 2025-09-07T06:39:15.3239776Z * [new branch] gh/zhxchen17/31/head -> origin/gh/zhxchen17/31/head 2025-09-07T06:39:15.3239850Z * [new branch] gh/zhxchen17/31/orig -> origin/gh/zhxchen17/31/orig 2025-09-07T06:39:15.3240878Z * [new branch] gh/zhxchen17/34/base -> origin/gh/zhxchen17/34/base 2025-09-07T06:39:15.3240956Z * [new branch] gh/zhxchen17/34/head -> origin/gh/zhxchen17/34/head 2025-09-07T06:39:15.3241031Z * [new branch] gh/zhxchen17/35/base -> origin/gh/zhxchen17/35/base 2025-09-07T06:39:15.3241104Z * [new branch] gh/zhxchen17/35/head -> origin/gh/zhxchen17/35/head 2025-09-07T06:39:15.3241183Z * [new branch] gh/zhxchen17/37/base -> origin/gh/zhxchen17/37/base 2025-09-07T06:39:15.3241257Z * [new branch] gh/zhxchen17/37/head -> origin/gh/zhxchen17/37/head 2025-09-07T06:39:15.3241331Z * [new branch] gh/zhxchen17/37/orig -> origin/gh/zhxchen17/37/orig 2025-09-07T06:39:15.3241405Z * [new branch] gh/zhxchen17/38/base -> origin/gh/zhxchen17/38/base 2025-09-07T06:39:15.3241480Z * [new branch] gh/zhxchen17/38/head -> origin/gh/zhxchen17/38/head 2025-09-07T06:39:15.3241554Z * [new branch] gh/zhxchen17/38/orig -> origin/gh/zhxchen17/38/orig 2025-09-07T06:39:15.3241627Z * [new branch] gh/zhxchen17/39/base -> origin/gh/zhxchen17/39/base 2025-09-07T06:39:15.3241701Z * [new branch] gh/zhxchen17/39/head -> origin/gh/zhxchen17/39/head 2025-09-07T06:39:15.3241775Z * [new branch] gh/zhxchen17/39/orig -> origin/gh/zhxchen17/39/orig 2025-09-07T06:39:15.3241850Z * [new branch] gh/zhxchen17/40/base -> origin/gh/zhxchen17/40/base 2025-09-07T06:39:15.3241925Z * [new branch] gh/zhxchen17/40/head -> origin/gh/zhxchen17/40/head 2025-09-07T06:39:15.3242034Z * [new branch] gh/zhxchen17/40/orig -> origin/gh/zhxchen17/40/orig 2025-09-07T06:39:15.3242108Z * [new branch] gh/zhxchen17/41/base -> origin/gh/zhxchen17/41/base 2025-09-07T06:39:15.3242183Z * [new branch] gh/zhxchen17/41/head -> origin/gh/zhxchen17/41/head 2025-09-07T06:39:15.3242257Z * [new branch] gh/zhxchen17/41/orig -> origin/gh/zhxchen17/41/orig 2025-09-07T06:39:15.3242331Z * [new branch] gh/zhxchen17/42/base -> origin/gh/zhxchen17/42/base 2025-09-07T06:39:15.3242405Z * [new branch] gh/zhxchen17/42/head -> origin/gh/zhxchen17/42/head 2025-09-07T06:39:15.3242528Z * [new branch] gh/zhxchen17/42/orig -> origin/gh/zhxchen17/42/orig 2025-09-07T06:39:15.3242602Z * [new branch] gh/zhxchen17/43/base -> origin/gh/zhxchen17/43/base 2025-09-07T06:39:15.3242677Z * [new branch] gh/zhxchen17/43/head -> origin/gh/zhxchen17/43/head 2025-09-07T06:39:15.3243777Z * [new branch] gh/zhxchen17/43/orig -> origin/gh/zhxchen17/43/orig 2025-09-07T06:39:15.3243857Z * [new branch] gh/zhxchen17/44/base -> origin/gh/zhxchen17/44/base 2025-09-07T06:39:15.3243932Z * [new branch] gh/zhxchen17/44/head -> origin/gh/zhxchen17/44/head 2025-09-07T06:39:15.3244006Z * [new branch] gh/zhxchen17/44/orig -> origin/gh/zhxchen17/44/orig 2025-09-07T06:39:15.3244080Z * [new branch] gh/zhxchen17/45/base -> origin/gh/zhxchen17/45/base 2025-09-07T06:39:15.3244155Z * [new branch] gh/zhxchen17/45/head -> origin/gh/zhxchen17/45/head 2025-09-07T06:39:15.3244234Z * [new branch] gh/zhxchen17/45/orig -> origin/gh/zhxchen17/45/orig 2025-09-07T06:39:15.3244305Z * [new branch] gh/zklaus/10/base -> origin/gh/zklaus/10/base 2025-09-07T06:39:15.3244377Z * [new branch] gh/zklaus/10/head -> origin/gh/zklaus/10/head 2025-09-07T06:39:15.3244448Z * [new branch] gh/zklaus/10/orig -> origin/gh/zklaus/10/orig 2025-09-07T06:39:15.3244519Z * [new branch] gh/zklaus/11/base -> origin/gh/zklaus/11/base 2025-09-07T06:39:15.3244589Z * [new branch] gh/zklaus/11/head -> origin/gh/zklaus/11/head 2025-09-07T06:39:15.3244658Z * [new branch] gh/zklaus/11/orig -> origin/gh/zklaus/11/orig 2025-09-07T06:39:15.3244728Z * [new branch] gh/zklaus/12/base -> origin/gh/zklaus/12/base 2025-09-07T06:39:15.3244797Z * [new branch] gh/zklaus/12/head -> origin/gh/zklaus/12/head 2025-09-07T06:39:15.3244870Z * [new branch] gh/zklaus/12/orig -> origin/gh/zklaus/12/orig 2025-09-07T06:39:15.3244939Z * [new branch] gh/zklaus/14/base -> origin/gh/zklaus/14/base 2025-09-07T06:39:15.3245009Z * [new branch] gh/zklaus/14/head -> origin/gh/zklaus/14/head 2025-09-07T06:39:15.3245081Z * [new branch] gh/zklaus/14/orig -> origin/gh/zklaus/14/orig 2025-09-07T06:39:15.3245151Z * [new branch] gh/zklaus/15/base -> origin/gh/zklaus/15/base 2025-09-07T06:39:15.3245221Z * [new branch] gh/zklaus/15/head -> origin/gh/zklaus/15/head 2025-09-07T06:39:15.3245292Z * [new branch] gh/zklaus/15/orig -> origin/gh/zklaus/15/orig 2025-09-07T06:39:15.3245361Z * [new branch] gh/zklaus/16/base -> origin/gh/zklaus/16/base 2025-09-07T06:39:15.3245431Z * [new branch] gh/zklaus/16/head -> origin/gh/zklaus/16/head 2025-09-07T06:39:15.3246444Z * [new branch] gh/zklaus/16/orig -> origin/gh/zklaus/16/orig 2025-09-07T06:39:15.3246518Z * [new branch] gh/zklaus/17/base -> origin/gh/zklaus/17/base 2025-09-07T06:39:15.3246588Z * [new branch] gh/zklaus/17/head -> origin/gh/zklaus/17/head 2025-09-07T06:39:15.3246727Z * [new branch] gh/zklaus/17/orig -> origin/gh/zklaus/17/orig 2025-09-07T06:39:15.3246798Z * [new branch] gh/zklaus/18/base -> origin/gh/zklaus/18/base 2025-09-07T06:39:15.3246868Z * [new branch] gh/zklaus/18/head -> origin/gh/zklaus/18/head 2025-09-07T06:39:15.3246938Z * [new branch] gh/zklaus/18/orig -> origin/gh/zklaus/18/orig 2025-09-07T06:39:15.3247007Z * [new branch] gh/zklaus/19/base -> origin/gh/zklaus/19/base 2025-09-07T06:39:15.3247076Z * [new branch] gh/zklaus/19/head -> origin/gh/zklaus/19/head 2025-09-07T06:39:15.3247207Z * [new branch] gh/zklaus/19/orig -> origin/gh/zklaus/19/orig 2025-09-07T06:39:15.3247277Z * [new branch] gh/zklaus/20/base -> origin/gh/zklaus/20/base 2025-09-07T06:39:15.3247349Z * [new branch] gh/zklaus/20/head -> origin/gh/zklaus/20/head 2025-09-07T06:39:15.3247421Z * [new branch] gh/zklaus/20/orig -> origin/gh/zklaus/20/orig 2025-09-07T06:39:15.3247494Z * [new branch] gh/zklaus/7/base -> origin/gh/zklaus/7/base 2025-09-07T06:39:15.3247565Z * [new branch] gh/zklaus/7/head -> origin/gh/zklaus/7/head 2025-09-07T06:39:15.3247634Z * [new branch] gh/zklaus/7/orig -> origin/gh/zklaus/7/orig 2025-09-07T06:39:15.3247704Z * [new branch] gh/zklaus/9/base -> origin/gh/zklaus/9/base 2025-09-07T06:39:15.3247773Z * [new branch] gh/zklaus/9/head -> origin/gh/zklaus/9/head 2025-09-07T06:39:15.3247843Z * [new branch] gh/zklaus/9/orig -> origin/gh/zklaus/9/orig 2025-09-07T06:39:15.3247921Z * [new branch] gh/zou3519/1175/base -> origin/gh/zou3519/1175/base 2025-09-07T06:39:15.3247996Z * [new branch] gh/zou3519/1175/head -> origin/gh/zou3519/1175/head 2025-09-07T06:39:15.3248071Z * [new branch] gh/zou3519/1175/orig -> origin/gh/zou3519/1175/orig 2025-09-07T06:39:15.3248146Z * [new branch] gh/zou3519/1177/base -> origin/gh/zou3519/1177/base 2025-09-07T06:39:15.3248219Z * [new branch] gh/zou3519/1177/head -> origin/gh/zou3519/1177/head 2025-09-07T06:39:15.3248354Z * [new branch] gh/zou3519/1177/orig -> origin/gh/zou3519/1177/orig 2025-09-07T06:39:15.3249393Z * [new branch] gh/zou3519/1191/base -> origin/gh/zou3519/1191/base 2025-09-07T06:39:15.3249466Z * [new branch] gh/zou3519/1191/head -> origin/gh/zou3519/1191/head 2025-09-07T06:39:15.3249543Z * [new branch] gh/zou3519/1191/orig -> origin/gh/zou3519/1191/orig 2025-09-07T06:39:15.3249617Z * [new branch] gh/zou3519/1192/base -> origin/gh/zou3519/1192/base 2025-09-07T06:39:15.3249691Z * [new branch] gh/zou3519/1192/head -> origin/gh/zou3519/1192/head 2025-09-07T06:39:15.3249763Z * [new branch] gh/zou3519/1192/orig -> origin/gh/zou3519/1192/orig 2025-09-07T06:39:15.3249836Z * [new branch] gh/zou3519/1193/base -> origin/gh/zou3519/1193/base 2025-09-07T06:39:15.3249909Z * [new branch] gh/zou3519/1193/head -> origin/gh/zou3519/1193/head 2025-09-07T06:39:15.3249981Z * [new branch] gh/zou3519/1193/orig -> origin/gh/zou3519/1193/orig 2025-09-07T06:39:15.3250054Z * [new branch] gh/zou3519/1194/base -> origin/gh/zou3519/1194/base 2025-09-07T06:39:15.3250126Z * [new branch] gh/zou3519/1194/head -> origin/gh/zou3519/1194/head 2025-09-07T06:39:15.3250199Z * [new branch] gh/zou3519/1194/orig -> origin/gh/zou3519/1194/orig 2025-09-07T06:39:15.3250272Z * [new branch] gh/zou3519/1195/base -> origin/gh/zou3519/1195/base 2025-09-07T06:39:15.3250386Z * [new branch] gh/zou3519/1195/head -> origin/gh/zou3519/1195/head 2025-09-07T06:39:15.3250459Z * [new branch] gh/zou3519/1195/orig -> origin/gh/zou3519/1195/orig 2025-09-07T06:39:15.3250532Z * [new branch] gh/zou3519/1196/base -> origin/gh/zou3519/1196/base 2025-09-07T06:39:15.3250604Z * [new branch] gh/zou3519/1196/head -> origin/gh/zou3519/1196/head 2025-09-07T06:39:15.3250676Z * [new branch] gh/zou3519/1196/orig -> origin/gh/zou3519/1196/orig 2025-09-07T06:39:15.3250748Z * [new branch] gh/zou3519/1197/base -> origin/gh/zou3519/1197/base 2025-09-07T06:39:15.3250859Z * [new branch] gh/zou3519/1197/head -> origin/gh/zou3519/1197/head 2025-09-07T06:39:15.3250930Z * [new branch] gh/zou3519/1197/orig -> origin/gh/zou3519/1197/orig 2025-09-07T06:39:15.3251002Z * [new branch] gh/zpcore/1/base -> origin/gh/zpcore/1/base 2025-09-07T06:39:15.3251076Z * [new branch] gh/zpcore/1/head -> origin/gh/zpcore/1/head 2025-09-07T06:39:15.3251148Z * [new branch] gh/zpcore/10/base -> origin/gh/zpcore/10/base 2025-09-07T06:39:15.3252195Z * [new branch] gh/zpcore/10/head -> origin/gh/zpcore/10/head 2025-09-07T06:39:15.3252269Z * [new branch] gh/zpcore/10/orig -> origin/gh/zpcore/10/orig 2025-09-07T06:39:15.3252339Z * [new branch] gh/zpcore/11/base -> origin/gh/zpcore/11/base 2025-09-07T06:39:15.3252409Z * [new branch] gh/zpcore/11/head -> origin/gh/zpcore/11/head 2025-09-07T06:39:15.3252484Z * [new branch] gh/zpcore/11/orig -> origin/gh/zpcore/11/orig 2025-09-07T06:39:15.3252554Z * [new branch] gh/zpcore/12/base -> origin/gh/zpcore/12/base 2025-09-07T06:39:15.3252625Z * [new branch] gh/zpcore/12/head -> origin/gh/zpcore/12/head 2025-09-07T06:39:15.3252698Z * [new branch] gh/zpcore/12/orig -> origin/gh/zpcore/12/orig 2025-09-07T06:39:15.3252769Z * [new branch] gh/zpcore/13/base -> origin/gh/zpcore/13/base 2025-09-07T06:39:15.3252839Z * [new branch] gh/zpcore/13/head -> origin/gh/zpcore/13/head 2025-09-07T06:39:15.3252909Z * [new branch] gh/zpcore/13/orig -> origin/gh/zpcore/13/orig 2025-09-07T06:39:15.3252979Z * [new branch] gh/zpcore/14/base -> origin/gh/zpcore/14/base 2025-09-07T06:39:15.3253049Z * [new branch] gh/zpcore/14/head -> origin/gh/zpcore/14/head 2025-09-07T06:39:15.3253221Z * [new branch] gh/zpcore/2/base -> origin/gh/zpcore/2/base 2025-09-07T06:39:15.3253293Z * [new branch] gh/zpcore/2/head -> origin/gh/zpcore/2/head 2025-09-07T06:39:15.3253363Z * [new branch] gh/zpcore/3/base -> origin/gh/zpcore/3/base 2025-09-07T06:39:15.3253436Z * [new branch] gh/zpcore/3/head -> origin/gh/zpcore/3/head 2025-09-07T06:39:15.3253506Z * [new branch] gh/zpcore/4/base -> origin/gh/zpcore/4/base 2025-09-07T06:39:15.3253574Z * [new branch] gh/zpcore/4/head -> origin/gh/zpcore/4/head 2025-09-07T06:39:15.3253644Z * [new branch] gh/zpcore/5/base -> origin/gh/zpcore/5/base 2025-09-07T06:39:15.3253712Z * [new branch] gh/zpcore/5/head -> origin/gh/zpcore/5/head 2025-09-07T06:39:15.3253781Z * [new branch] gh/zpcore/6/base -> origin/gh/zpcore/6/base 2025-09-07T06:39:15.3253851Z * [new branch] gh/zpcore/6/head -> origin/gh/zpcore/6/head 2025-09-07T06:39:15.3253921Z * [new branch] gh/zpcore/7/base -> origin/gh/zpcore/7/base 2025-09-07T06:39:15.3254961Z * [new branch] gh/zpcore/7/head -> origin/gh/zpcore/7/head 2025-09-07T06:39:15.3255102Z * [new branch] gh/zpcore/8/base -> origin/gh/zpcore/8/base 2025-09-07T06:39:15.3255172Z * [new branch] gh/zpcore/8/head -> origin/gh/zpcore/8/head 2025-09-07T06:39:15.3255243Z * [new branch] google-main -> origin/google-main 2025-09-07T06:39:15.3255335Z * [new branch] guangyey/external_stream -> origin/guangyey/external_stream 2025-09-07T06:39:15.3255415Z * [new branch] guangyey/host_alloc -> origin/guangyey/host_alloc 2025-09-07T06:39:15.3255489Z * [new branch] guangyey/reimport -> origin/guangyey/reimport 2025-09-07T06:39:15.3255625Z * [new branch] guangyey/test_2025 -> origin/guangyey/test_2025 2025-09-07T06:39:15.3255768Z * [new branch] guilhermeleobas/cherry-pick-55d87d9dfd9 -> origin/guilhermeleobas/cherry-pick-55d87d9dfd9 2025-09-07T06:39:15.3255860Z * [new branch] haozhe/bf16-dynamic-shape -> origin/haozhe/bf16-dynamic-shape 2025-09-07T06:39:15.3255926Z * [new branch] hc_baseline -> origin/hc_baseline 2025-09-07T06:39:15.3255992Z * [new branch] hf_update -> origin/hf_update 2025-09-07T06:39:15.3256062Z * [new branch] hhh_decomp_mul -> origin/hhh_decomp_mul 2025-09-07T06:39:15.3256126Z * [new branch] hhh_rand -> origin/hhh_rand 2025-09-07T06:39:15.3256196Z * [new branch] hoy/mmsplitk -> origin/hoy/mmsplitk 2025-09-07T06:39:15.3256273Z * [new branch] hoy/triton-PR3973 -> origin/hoy/triton-PR3973 2025-09-07T06:39:15.3256384Z * [new branch] hoy/triton-coalescing-baseline -> origin/hoy/triton-coalescing-baseline 2025-09-07T06:39:15.3256477Z * [new branch] hoy/triton-coalescing-new -> origin/hoy/triton-coalescing-new 2025-09-07T06:39:15.3256569Z * [new branch] hoy/triton-coalescing-vec -> origin/hoy/triton-coalescing-vec 2025-09-07T06:39:15.3256646Z * [new branch] inductordecompfix -> origin/inductordecompfix 2025-09-07T06:39:15.3256711Z * [new branch] inline -> origin/inline 2025-09-07T06:39:15.3256775Z * [new branch] inlining -> origin/inlining 2025-09-07T06:39:15.3256849Z * [new branch] inlining-ezyang -> origin/inlining-ezyang 2025-09-07T06:39:15.3256938Z * [new branch] install-torchao-0.13.0 -> origin/install-torchao-0.13.0 2025-09-07T06:39:15.3257975Z * [new branch] int8_sdpa -> origin/int8_sdpa 2025-09-07T06:39:15.3258058Z * [new branch] invoke-subgraph -> origin/invoke-subgraph 2025-09-07T06:39:15.3258126Z * [new branch] issue#58739 -> origin/issue#58739 2025-09-07T06:39:15.3258252Z * [new branch] jcaip/test-cusparselt-version-0.6.2 -> origin/jcaip/test-cusparselt-version-0.6.2 2025-09-07T06:39:15.3258358Z * [new branch] jcaip/update-cusparselt-0.6.2 -> origin/jcaip/update-cusparselt-0.6.2 2025-09-07T06:39:15.3258473Z * [new branch] jeanschmidt/disable_rocm_build_tests -> origin/jeanschmidt/disable_rocm_build_tests 2025-09-07T06:39:15.3258563Z * [new branch] jithunnair-amd-patch-1 -> origin/jithunnair-amd-patch-1 2025-09-07T06:39:15.3258650Z * [new branch] jithunnair-amd-patch-2 -> origin/jithunnair-amd-patch-2 2025-09-07T06:39:15.3258741Z * [new branch] justinchu/attention-tests -> origin/justinchu/attention-tests 2025-09-07T06:39:15.3258823Z * [new branch] justinchu/native-qdq -> origin/justinchu/native-qdq 2025-09-07T06:39:15.3258901Z * [new branch] justinchu/ort-122 -> origin/justinchu/ort-122 2025-09-07T06:39:15.3258988Z * [new branch] justinchuby/dynamo-true -> origin/justinchuby/dynamo-true 2025-09-07T06:39:15.3259104Z * [new branch] kainan666/xlf_debug -> origin/kainan666/xlf_debug 2025-09-07T06:39:15.3259170Z * [new branch] kainan_test -> origin/kainan_test 2025-09-07T06:39:15.3259240Z * [new branch] learnablebias -> origin/learnablebias 2025-09-07T06:39:15.3259347Z * [new branch] leslie/test_group_gemm_epilogues -> origin/leslie/test_group_gemm_epilogues 2025-09-07T06:39:15.3259451Z * [new branch] lessw2020/fix_cutlass_cache_error -> origin/lessw2020/fix_cutlass_cache_error 2025-09-07T06:39:15.3259534Z * [new branch] liaoxuan/shm_all_reduce -> origin/liaoxuan/shm_all_reduce 2025-09-07T06:39:15.3259667Z * [new branch] liaoxuan/test_fa_disable_softmax -> origin/liaoxuan/test_fa_disable_softmax 2025-09-07T06:39:15.3259750Z * [new branch] liaoxuan/test_int8_sdpa -> origin/liaoxuan/test_int8_sdpa 2025-09-07T06:39:15.3259826Z * [new branch] lintbuilddocker -> origin/lintbuilddocker 2025-09-07T06:39:15.3259897Z * [new branch] llama4-stable -> origin/llama4-stable 2025-09-07T06:39:15.3259962Z * [new branch] logdetfix -> origin/logdetfix 2025-09-07T06:39:15.3260033Z * [new branch] lts/release/1.8 -> origin/lts/release/1.8 2025-09-07T06:39:15.3261082Z * [new branch] lucaskabela/#94773 -> origin/lucaskabela/#94773 2025-09-07T06:39:15.3261171Z * [new branch] lucaskabela/flop_counter -> origin/lucaskabela/flop_counter 2025-09-07T06:39:15.3261268Z * [new branch] lucaskabela/func_under_decomp -> origin/lucaskabela/func_under_decomp 2025-09-07T06:39:15.3261377Z * [new branch] lucaskabela/functional_in_dynamo -> origin/lucaskabela/functional_in_dynamo 2025-09-07T06:39:15.3261503Z * [new branch] lucaskabela/install_params_as_graph_attr -> origin/lucaskabela/install_params_as_graph_attr 2025-09-07T06:39:15.3261590Z * [new branch] lucaskabela/issue_120648 -> origin/lucaskabela/issue_120648 2025-09-07T06:39:15.3261689Z * [new branch] lucaskabela/misc_typing_dynamo -> origin/lucaskabela/misc_typing_dynamo 2025-09-07T06:39:15.3261802Z * [new branch] lucaskabela/parameters_as_graph_attr -> origin/lucaskabela/parameters_as_graph_attr 2025-09-07T06:39:15.3261932Z * [new branch] lucaskabela/remove_aot_dispatcher_metadata -> origin/lucaskabela/remove_aot_dispatcher_metadata 2025-09-07T06:39:15.3262016Z * [new branch] lucaskabela/rnn_decomp -> origin/lucaskabela/rnn_decomp 2025-09-07T06:39:15.3262110Z * [new branch] lucaskabela/typing_backends -> origin/lucaskabela/typing_backends 2025-09-07T06:39:15.3262222Z * [new branch] lucaskabela/typing_symbolic_convert -> origin/lucaskabela/typing_symbolic_convert 2025-09-07T06:39:15.3262341Z * [new branch] lucaskabela/typing_utils_improvements -> origin/lucaskabela/typing_utils_improvements 2025-09-07T06:39:15.3262405Z * [new branch] main -> origin/main 2025-09-07T06:39:15.3262527Z * [new branch] main-enable-b200-distributed-tests -> origin/main-enable-b200-distributed-tests 2025-09-07T06:39:15.3262601Z * [new branch] malfet-patch-1 -> origin/malfet-patch-1 2025-09-07T06:39:15.3262675Z * [new branch] malfet-patch-12 -> origin/malfet-patch-12 2025-09-07T06:39:15.3262747Z * [new branch] malfet-patch-14 -> origin/malfet-patch-14 2025-09-07T06:39:15.3262819Z * [new branch] malfet-patch-6 -> origin/malfet-patch-6 2025-09-07T06:39:15.3262890Z * [new branch] malfet-patch-8 -> origin/malfet-patch-8 2025-09-07T06:39:15.3263059Z * [new branch] malfet/be-move-more-settings-to-checkout-pytorch -> origin/malfet/be-move-more-settings-to-checkout-pytorch 2025-09-07T06:39:15.3263310Z * [new branch] malfet/delete-upsteam-cuda -> origin/malfet/delete-upsteam-cuda 2025-09-07T06:39:15.3263407Z * [new branch] malfet/mps-implement-col2im -> origin/malfet/mps-implement-col2im 2025-09-07T06:39:15.3263517Z * [new branch] manuel/test-ops-common-allow-mps -> origin/manuel/test-ops-common-allow-mps 2025-09-07T06:39:15.3264579Z * [new branch] metascroy-patch-1 -> origin/metascroy-patch-1 2025-09-07T06:39:15.3264661Z * [new branch] mlazos/S429861-debug -> origin/mlazos/S429861-debug 2025-09-07T06:39:15.3264727Z * [new branch] mlazos/aa -> origin/mlazos/aa 2025-09-07T06:39:15.3264871Z * [new branch] mlazos/arg-renames -> origin/mlazos/arg-renames 2025-09-07T06:39:15.3264962Z * [new branch] mlazos/backup-test-branch -> origin/mlazos/backup-test-branch 2025-09-07T06:39:15.3265048Z * [new branch] mlazos/bad-cudagraphs -> origin/mlazos/bad-cudagraphs 2025-09-07T06:39:15.3265122Z * [new branch] mlazos/baseline -> origin/mlazos/baseline 2025-09-07T06:39:15.3265224Z * [new branch] mlazos/baseline-graph-breaks -> origin/mlazos/baseline-graph-breaks 2025-09-07T06:39:15.3265300Z * [new branch] mlazos/beta-tensor -> origin/mlazos/beta-tensor 2025-09-07T06:39:15.3265374Z * [new branch] mlazos/better-msg -> origin/mlazos/better-msg 2025-09-07T06:39:15.3265445Z * [new branch] mlazos/buffers -> origin/mlazos/buffers 2025-09-07T06:39:15.3265515Z * [new branch] mlazos/buffers2 -> origin/mlazos/buffers2 2025-09-07T06:39:15.3265589Z * [new branch] mlazos/buffers3 -> origin/mlazos/buffers3 2025-09-07T06:39:15.3265656Z * [new branch] mlazos/ck2 -> origin/mlazos/ck2 2025-09-07T06:39:15.3265737Z * [new branch] mlazos/combokernels -> origin/mlazos/combokernels 2025-09-07T06:39:15.3265813Z * [new branch] mlazos/ctx-cleanup -> origin/mlazos/ctx-cleanup 2025-09-07T06:39:15.3265893Z * [new branch] mlazos/cuda-cmd-log -> origin/mlazos/cuda-cmd-log 2025-09-07T06:39:15.3265978Z * [new branch] mlazos/cudagraph-tests -> origin/mlazos/cudagraph-tests 2025-09-07T06:39:15.3266081Z * [new branch] mlazos/cudagraphs-measurement -> origin/mlazos/cudagraphs-measurement 2025-09-07T06:39:15.3266161Z * [new branch] mlazos/cutlass-test -> origin/mlazos/cutlass-test 2025-09-07T06:39:15.3266249Z * [new branch] mlazos/cutlass-topo-bug -> origin/mlazos/cutlass-topo-bug 2025-09-07T06:39:15.3266326Z * [new branch] mlazos/data-gather -> origin/mlazos/data-gather 2025-09-07T06:39:15.3266403Z * [new branch] mlazos/data-ptrs2 -> origin/mlazos/data-ptrs2 2025-09-07T06:39:15.3266478Z * [new branch] mlazos/data-ptrs3 -> origin/mlazos/data-ptrs3 2025-09-07T06:39:15.3266563Z * [new branch] mlazos/dataclass-proxy -> origin/mlazos/dataclass-proxy 2025-09-07T06:39:15.3267595Z * [new branch] mlazos/dc-attrs -> origin/mlazos/dc-attrs 2025-09-07T06:39:15.3267670Z * [new branch] mlazos/dc-helion -> origin/mlazos/dc-helion 2025-09-07T06:39:15.3267741Z * [new branch] mlazos/dict-fix -> origin/mlazos/dict-fix 2025-09-07T06:39:15.3267828Z * [new branch] mlazos/disable-closures -> origin/mlazos/disable-closures 2025-09-07T06:39:15.3267901Z * [new branch] mlazos/disable-tf -> origin/mlazos/disable-tf 2025-09-07T06:39:15.3267978Z * [new branch] mlazos/dupe-fix -> origin/mlazos/dupe-fix 2025-09-07T06:39:15.3268051Z * [new branch] mlazos/dyn-batch -> origin/mlazos/dyn-batch 2025-09-07T06:39:15.3268155Z * [new branch] mlazos/evt -> origin/mlazos/evt 2025-09-07T06:39:15.3268230Z * [new branch] mlazos/exp_disable -> origin/mlazos/exp_disable 2025-09-07T06:39:15.3268317Z * [new branch] mlazos/extract-examples -> origin/mlazos/extract-examples 2025-09-07T06:39:15.3268390Z * [new branch] mlazos/foreach-op -> origin/mlazos/foreach-op 2025-09-07T06:39:15.3268456Z * [new branch] mlazos/fp8 -> origin/mlazos/fp8 2025-09-07T06:39:15.3268526Z * [new branch] mlazos/fp8-bias -> origin/mlazos/fp8-bias 2025-09-07T06:39:15.3268609Z * [new branch] mlazos/fp8-bias-fusion -> origin/mlazos/fp8-bias-fusion 2025-09-07T06:39:15.3268726Z * [new branch] mlazos/fp8-fixes -> origin/mlazos/fp8-fixes 2025-09-07T06:39:15.3268796Z * [new branch] mlazos/freezing -> origin/mlazos/freezing 2025-09-07T06:39:15.3268868Z * [new branch] mlazos/h-comp -> origin/mlazos/h-comp 2025-09-07T06:39:15.3268937Z * [new branch] mlazos/h-comp2 -> origin/mlazos/h-comp2 2025-09-07T06:39:15.3269009Z * [new branch] mlazos/hash-hop -> origin/mlazos/hash-hop 2025-09-07T06:39:15.3269075Z * [new branch] mlazos/hc -> origin/mlazos/hc 2025-09-07T06:39:15.3269147Z * [new branch] mlazos/hc-cycles -> origin/mlazos/hc-cycles 2025-09-07T06:39:15.3269216Z * [new branch] mlazos/hc-fixes -> origin/mlazos/hc-fixes 2025-09-07T06:39:15.3269287Z * [new branch] mlazos/hc-fixes3 -> origin/mlazos/hc-fixes3 2025-09-07T06:39:15.3269361Z * [new branch] mlazos/hc-fixes4 -> origin/mlazos/hc-fixes4 2025-09-07T06:39:15.3270386Z * [new branch] mlazos/hc-hf -> origin/mlazos/hc-hf 2025-09-07T06:39:15.3270460Z * [new branch] mlazos/hc-mut -> origin/mlazos/hc-mut 2025-09-07T06:39:15.3270526Z * [new branch] mlazos/hc10 -> origin/mlazos/hc10 2025-09-07T06:39:15.3270590Z * [new branch] mlazos/hc11 -> origin/mlazos/hc11 2025-09-07T06:39:15.3270654Z * [new branch] mlazos/hc12 -> origin/mlazos/hc12 2025-09-07T06:39:15.3270718Z * [new branch] mlazos/hc13 -> origin/mlazos/hc13 2025-09-07T06:39:15.3270780Z * [new branch] mlazos/hc14 -> origin/mlazos/hc14 2025-09-07T06:39:15.3270843Z * [new branch] mlazos/hc15 -> origin/mlazos/hc15 2025-09-07T06:39:15.3270913Z * [new branch] mlazos/hc2 -> origin/mlazos/hc2 2025-09-07T06:39:15.3270977Z * [new branch] mlazos/hc4 -> origin/mlazos/hc4 2025-09-07T06:39:15.3271041Z * [new branch] mlazos/hc5 -> origin/mlazos/hc5 2025-09-07T06:39:15.3271105Z * [new branch] mlazos/hc6 -> origin/mlazos/hc6 2025-09-07T06:39:15.3271168Z * [new branch] mlazos/hc7 -> origin/mlazos/hc7 2025-09-07T06:39:15.3271230Z * [new branch] mlazos/hc8 -> origin/mlazos/hc8 2025-09-07T06:39:15.3271295Z * [new branch] mlazos/hc9 -> origin/mlazos/hc9 2025-09-07T06:39:15.3271371Z * [new branch] mlazos/hc_baseline2 -> origin/mlazos/hc_baseline2 2025-09-07T06:39:15.3271457Z * [new branch] mlazos/init-per-param -> origin/mlazos/init-per-param 2025-09-07T06:39:15.3271539Z * [new branch] mlazos/init_per_param -> origin/mlazos/init_per_param 2025-09-07T06:39:15.3271616Z * [new branch] mlazos/less-guards -> origin/mlazos/less-guards 2025-09-07T06:39:15.3271702Z * [new branch] mlazos/lr-composibility -> origin/mlazos/lr-composibility 2025-09-07T06:39:15.3271814Z * [new branch] mlazos/main -> origin/mlazos/main 2025-09-07T06:39:15.3271909Z * [new branch] mlazos/main-test-enablement -> origin/mlazos/main-test-enablement 2025-09-07T06:39:15.3271976Z * [new branch] mlazos/main2 -> origin/mlazos/main2 2025-09-07T06:39:15.3272066Z * [new branch] mlazos/mark-static-update -> origin/mlazos/mark-static-update 2025-09-07T06:39:15.3273171Z * [new branch] mlazos/mcg -> origin/mlazos/mcg 2025-09-07T06:39:15.3273241Z * [new branch] mlazos/mcg2 -> origin/mlazos/mcg2 2025-09-07T06:39:15.3273318Z * [new branch] mlazos/meta-guards -> origin/mlazos/meta-guards 2025-09-07T06:39:15.3273457Z * [new branch] mlazos/mlazos/ck2 -> origin/mlazos/mlazos/ck2 2025-09-07T06:39:15.3273562Z * [new branch] mlazos/mlazos/foreach-map-adam -> origin/mlazos/mlazos/foreach-map-adam 2025-09-07T06:39:15.3273662Z * [new branch] mlazos/mlazos/tf-mode-backup -> origin/mlazos/mlazos/tf-mode-backup 2025-09-07T06:39:15.3273732Z * [new branch] mlazos/mod-fix -> origin/mlazos/mod-fix 2025-09-07T06:39:15.3273803Z * [new branch] mlazos/mode-fix -> origin/mlazos/mode-fix 2025-09-07T06:39:15.3273877Z * [new branch] mlazos/more-tests -> origin/mlazos/more-tests 2025-09-07T06:39:15.3273946Z * [new branch] mlazos/no-cpp -> origin/mlazos/no-cpp 2025-09-07T06:39:15.3274048Z * [new branch] mlazos/no-init-group-handling -> origin/mlazos/no-init-group-handling 2025-09-07T06:39:15.3274123Z * [new branch] mlazos/offsets -> origin/mlazos/offsets 2025-09-07T06:39:15.3274206Z * [new branch] mlazos/opt-bench-exp2 -> origin/mlazos/opt-bench-exp2 2025-09-07T06:39:15.3274277Z * [new branch] mlazos/opt-incr -> origin/mlazos/opt-incr 2025-09-07T06:39:15.3274356Z * [new branch] mlazos/proxy-ctors -> origin/mlazos/proxy-ctors 2025-09-07T06:39:15.3274428Z * [new branch] mlazos/quant-fix -> origin/mlazos/quant-fix 2025-09-07T06:39:15.3274502Z * [new branch] mlazos/resnet-fix -> origin/mlazos/resnet-fix 2025-09-07T06:39:15.3274582Z * [new branch] mlazos/revert-inline -> origin/mlazos/revert-inline 2025-09-07T06:39:15.3274660Z * [new branch] mlazos/rm-buf-names -> origin/mlazos/rm-buf-names 2025-09-07T06:39:15.3274730Z * [new branch] mlazos/rm-code -> origin/mlazos/rm-code 2025-09-07T06:39:15.3274806Z * [new branch] mlazos/rm-spam -> origin/mlazos/rm-spam 2025-09-07T06:39:15.3274872Z * [new branch] mlazos/rtp -> origin/mlazos/rtp 2025-09-07T06:39:15.3274953Z * [new branch] mlazos/static-idx-dbg -> origin/mlazos/static-idx-dbg 2025-09-07T06:39:15.3275043Z * [new branch] mlazos/static-inputs-log -> origin/mlazos/static-inputs-log 2025-09-07T06:39:15.3276098Z * [new branch] mlazos/sub-param-fix -> origin/mlazos/sub-param-fix 2025-09-07T06:39:15.3276171Z * [new branch] mlazos/td-fix2 -> origin/mlazos/td-fix2 2025-09-07T06:39:15.3276253Z * [new branch] mlazos/tensor-hasattr2 -> origin/mlazos/tensor-hasattr2 2025-09-07T06:39:15.3276320Z * [new branch] mlazos/test -> origin/mlazos/test 2025-09-07T06:39:15.3276388Z * [new branch] mlazos/tf-mode -> origin/mlazos/tf-mode 2025-09-07T06:39:15.3276475Z * [new branch] mlazos/tf-mode-backup2 -> origin/mlazos/tf-mode-backup2 2025-09-07T06:39:15.3276556Z * [new branch] mlazos/tf-mode-reland -> origin/mlazos/tf-mode-reland 2025-09-07T06:39:15.3276693Z * [new branch] mlazos/tf-mode-reland2 -> origin/mlazos/tf-mode-reland2 2025-09-07T06:39:15.3276774Z * [new branch] mlazos/tf-mode-reland3 -> origin/mlazos/tf-mode-reland3 2025-09-07T06:39:15.3276847Z * [new branch] mlazos/topo-fix -> origin/mlazos/topo-fix 2025-09-07T06:39:15.3276927Z * [new branch] mlazos/triton-no-epi -> origin/mlazos/triton-no-epi 2025-09-07T06:39:15.3277002Z * [new branch] mlazos/tune-proto -> origin/mlazos/tune-proto 2025-09-07T06:39:15.3277078Z * [new branch] mlazos/tuple-fixes -> origin/mlazos/tuple-fixes 2025-09-07T06:39:15.3277157Z * [new branch] mlazos/tuple-fixes2 -> origin/mlazos/tuple-fixes2 2025-09-07T06:39:15.3277274Z * [new branch] mlazos/tuple-handling -> origin/mlazos/tuple-handling 2025-09-07T06:39:15.3277351Z * [new branch] mlazos/user-streams -> origin/mlazos/user-streams 2025-09-07T06:39:15.3277425Z * [new branch] mlazos/vary-beta -> origin/mlazos/vary-beta 2025-09-07T06:39:15.3277501Z * [new branch] mlazos/vary-beta2 -> origin/mlazos/vary-beta2 2025-09-07T06:39:15.3277576Z * [new branch] mlazos/weird-perf1 -> origin/mlazos/weird-perf1 2025-09-07T06:39:15.3277652Z * [new branch] mm_out_dtype_compile -> origin/mm_out_dtype_compile 2025-09-07T06:39:15.3277725Z * [new branch] modify-setupvllm -> origin/modify-setupvllm 2025-09-07T06:39:15.3277792Z * [new branch] module-shim -> origin/module-shim 2025-09-07T06:39:15.3277876Z * [new branch] move-theme-out-docker -> origin/move-theme-out-docker 2025-09-07T06:39:15.3277947Z * [new branch] msaroufim/be1 -> origin/msaroufim/be1 2025-09-07T06:39:15.3278983Z * [new branch] msaroufim/cn_path -> origin/msaroufim/cn_path 2025-09-07T06:39:15.3279083Z * [new branch] msaroufim/dtensorfusedadam -> origin/msaroufim/dtensorfusedadam 2025-09-07T06:39:15.3279157Z * [new branch] msaroufim/reduce -> origin/msaroufim/reduce 2025-09-07T06:39:15.3279229Z * [new branch] mtia/basic-cmake -> origin/mtia/basic-cmake 2025-09-07T06:39:15.3279294Z * [new branch] muon_dev -> origin/muon_dev 2025-09-07T06:39:15.3279358Z * [new branch] muon_dev_1 -> origin/muon_dev_1 2025-09-07T06:39:15.3279436Z * [new branch] nativert_num_outputs -> origin/nativert_num_outputs 2025-09-07T06:39:15.3279515Z * [new branch] nativert_numoutputs -> origin/nativert_numoutputs 2025-09-07T06:39:15.3279604Z * [new branch] new-modifiy-setupvllm -> origin/new-modifiy-setupvllm 2025-09-07T06:39:15.3279673Z * [new branch] new-setupvllm -> origin/new-setupvllm 2025-09-07T06:39:15.3279746Z * [new branch] new_zeros_dtype -> origin/new_zeros_dtype 2025-09-07T06:39:15.3279815Z * [new branch] newtest-base -> origin/newtest-base 2025-09-07T06:39:15.3279887Z * [new branch] ngimel/cat_perf1 -> origin/ngimel/cat_perf1 2025-09-07T06:39:15.3279960Z * [new branch] ngimel/einsum_fix -> origin/ngimel/einsum_fix 2025-09-07T06:39:15.3280045Z * [new branch] ngimel/error_index_list -> origin/ngimel/error_index_list 2025-09-07T06:39:15.3280121Z * [new branch] ngimel/fabric_check -> origin/ngimel/fabric_check 2025-09-07T06:39:15.3280193Z * [new branch] ngimel/fabric_fix -> origin/ngimel/fabric_fix 2025-09-07T06:39:15.3280285Z * [new branch] ngimel/fix_driver_init_error -> origin/ngimel/fix_driver_init_error 2025-09-07T06:39:15.3280373Z * [new branch] ngimel/fix_nccl_segment_seg -> origin/ngimel/fix_nccl_segment_seg 2025-09-07T06:39:15.3280488Z * [new branch] ngimel/gg_new -> origin/ngimel/gg_new 2025-09-07T06:39:15.3280560Z * [new branch] ngimel/modeguard -> origin/ngimel/modeguard 2025-09-07T06:39:15.3280639Z * [new branch] ngimel/multicast_fix -> origin/ngimel/multicast_fix 2025-09-07T06:39:15.3280723Z * [new branch] ngimel/rocm_handle_type -> origin/ngimel/rocm_handle_type 2025-09-07T06:39:15.3280806Z * [new branch] ngimel/symm_handle_fabric -> origin/ngimel/symm_handle_fabric 2025-09-07T06:39:15.3280886Z * [new branch] ngimel/unbind_multimem -> origin/ngimel/unbind_multimem 2025-09-07T06:39:15.3281912Z * [new branch] nightly -> origin/nightly 2025-09-07T06:39:15.3282039Z * [new branch] nmacchioni-patch-10 -> origin/nmacchioni-patch-10 2025-09-07T06:39:15.3282121Z * [new branch] nmacchioni-patch-7 -> origin/nmacchioni-patch-7 2025-09-07T06:39:15.3282203Z * [new branch] nmacchioni-patch-8 -> origin/nmacchioni-patch-8 2025-09-07T06:39:15.3282281Z * [new branch] nmacchioni-patch-9 -> origin/nmacchioni-patch-9 2025-09-07T06:39:15.3282360Z * [new branch] nullplay/fuse_matmul -> origin/nullplay/fuse_matmul 2025-09-07T06:39:15.3282437Z * [new branch] nullplay_fuse_matmul -> origin/nullplay_fuse_matmul 2025-09-07T06:39:15.3282502Z * [new branch] one-off -> origin/one-off 2025-09-07T06:39:15.3282575Z * [new branch] orig/release/1.10 -> origin/orig/release/1.10 2025-09-07T06:39:15.3282648Z * [new branch] orig/release/1.11 -> origin/orig/release/1.11 2025-09-07T06:39:15.3282725Z * [new branch] orig/release/1.12 -> origin/orig/release/1.12 2025-09-07T06:39:15.3282795Z * [new branch] orig/release/1.13 -> origin/orig/release/1.13 2025-09-07T06:39:15.3282868Z * [new branch] orig/release/1.6 -> origin/orig/release/1.6 2025-09-07T06:39:15.3282940Z * [new branch] orig/release/1.7 -> origin/orig/release/1.7 2025-09-07T06:39:15.3283009Z * [new branch] orig/release/1.8 -> origin/orig/release/1.8 2025-09-07T06:39:15.3283160Z * [new branch] orig/release/1.9 -> origin/orig/release/1.9 2025-09-07T06:39:15.3283232Z * [new branch] orig/release/2.0 -> origin/orig/release/2.0 2025-09-07T06:39:15.3283301Z * [new branch] orig/release/2.1 -> origin/orig/release/2.1 2025-09-07T06:39:15.3283370Z * [new branch] orig/release/2.2 -> origin/orig/release/2.2 2025-09-07T06:39:15.3283444Z * [new branch] orig/release/2.3 -> origin/orig/release/2.3 2025-09-07T06:39:15.3283512Z * [new branch] orig/release/2.4 -> origin/orig/release/2.4 2025-09-07T06:39:15.3283583Z * [new branch] orig/release/2.5 -> origin/orig/release/2.5 2025-09-07T06:39:15.3283652Z * [new branch] orig/release/2.6 -> origin/orig/release/2.6 2025-09-07T06:39:15.3283720Z * [new branch] orig/release/2.7 -> origin/orig/release/2.7 2025-09-07T06:39:15.3284748Z * [new branch] orig/release/2.8 -> origin/orig/release/2.8 2025-09-07T06:39:15.3284823Z * [new branch] oulgen/fx_graph -> origin/oulgen/fx_graph 2025-09-07T06:39:15.3284894Z * [new branch] padded-tensor -> origin/padded-tensor 2025-09-07T06:39:15.3284958Z * [new branch] pca2 -> origin/pca2 2025-09-07T06:39:15.3285040Z * [new branch] pianpwk-patch-1 -> origin/pianpwk-patch-1 2025-09-07T06:39:15.3285156Z * [new branch] pianpwk/backed_size_oblivious_export -> origin/pianpwk/backed_size_oblivious_export 2025-09-07T06:39:15.3285333Z * [new branch] pianpwk/invalidate_fake_memo -> origin/pianpwk/invalidate_fake_memo 2025-09-07T06:39:15.3285414Z * [new branch] pianpwk/max_1_strides -> origin/pianpwk/max_1_strides 2025-09-07T06:39:15.3285499Z * [new branch] pianpwk/maybe_guard_rel -> origin/pianpwk/maybe_guard_rel 2025-09-07T06:39:15.3285579Z * [new branch] pianpwk/nonzero_memo -> origin/pianpwk/nonzero_memo 2025-09-07T06:39:15.3285696Z * [new branch] pianpwk/oblivious_reshape_view_better -> origin/pianpwk/oblivious_reshape_view_better 2025-09-07T06:39:15.3285799Z * [new branch] pianpwk/oblivious_slice_forward -> origin/pianpwk/oblivious_slice_forward 2025-09-07T06:39:15.3285940Z * [new branch] pianpwk/oblivious_where -> origin/pianpwk/oblivious_where 2025-09-07T06:39:15.3286028Z * [new branch] pianpwk/param_static_pgo -> origin/pianpwk/param_static_pgo 2025-09-07T06:39:15.3286116Z * [new branch] pianpwk/pre_forward_hook -> origin/pianpwk/pre_forward_hook 2025-09-07T06:39:15.3286216Z * [new branch] pianpwk/remove_guard_fail_break -> origin/pianpwk/remove_guard_fail_break 2025-09-07T06:39:15.3286306Z * [new branch] pianpwk/slice_fresh_symbols -> origin/pianpwk/slice_fresh_symbols 2025-09-07T06:39:15.3286391Z * [new branch] pianpwk/sym_tokens_draft -> origin/pianpwk/sym_tokens_draft 2025-09-07T06:39:15.3286506Z * [new branch] pianpwk/test_pointwise_guard_or_false -> origin/pianpwk/test_pointwise_guard_or_false 2025-09-07T06:39:15.3286598Z * [new branch] pianpwk/test_slice_fake_impl -> origin/pianpwk/test_slice_fake_impl 2025-09-07T06:39:15.3286701Z * [new branch] pianpwk/totally_draft_sym_wrap -> origin/pianpwk/totally_draft_sym_wrap 2025-09-07T06:39:15.3286800Z * [new branch] pianpwk/unbacked_channels_last -> origin/pianpwk/unbacked_channels_last 2025-09-07T06:39:15.3286895Z * [new branch] pianpwk/unbacked_safe_conv1d -> origin/pianpwk/unbacked_safe_conv1d 2025-09-07T06:39:15.3286988Z * [new branch] pianpwk/unbacked_sdpa_flash -> origin/pianpwk/unbacked_sdpa_flash 2025-09-07T06:39:15.3288038Z * [new branch] pianpwk/unbacked_should_swap -> origin/pianpwk/unbacked_should_swap 2025-09-07T06:39:15.3288139Z * [new branch] pianpwk/unbacked_should_swap_2 -> origin/pianpwk/unbacked_should_swap_2 2025-09-07T06:39:15.3288240Z * [new branch] pianpwk/unbacked_slice_binding -> origin/pianpwk/unbacked_slice_binding 2025-09-07T06:39:15.3288498Z * [new branch] pianpwk/unbacked_slice_forward -> origin/pianpwk/unbacked_slice_forward 2025-09-07T06:39:15.3288585Z * [new branch] pianpwk/user_symints -> origin/pianpwk/user_symints 2025-09-07T06:39:15.3288668Z * [new branch] pianpwk/wan21_reshape -> origin/pianpwk/wan21_reshape 2025-09-07T06:39:15.3288763Z * [new branch] pianpwk/whitelist_optimizer -> origin/pianpwk/whitelist_optimizer 2025-09-07T06:39:15.3288832Z * [new branch] pin-torchao -> origin/pin-torchao 2025-09-07T06:39:15.3288918Z * [new branch] piz/fall_back_missing_0716 -> origin/piz/fall_back_missing_0716 2025-09-07T06:39:15.3289002Z * [new branch] piz/improve_scatter_0808 -> origin/piz/improve_scatter_0808 2025-09-07T06:39:15.3289073Z * [new branch] pool-separate -> origin/pool-separate 2025-09-07T06:39:15.3289140Z * [new branch] pr-156087 -> origin/pr-156087 2025-09-07T06:39:15.3289204Z * [new branch] pr/131860 -> origin/pr/131860 2025-09-07T06:39:15.3289279Z * [new branch] predispatch_to -> origin/predispatch_to 2025-09-07T06:39:15.3289351Z * [new branch] pt-opt-cuda3 -> origin/pt-opt-cuda3 2025-09-07T06:39:15.3289420Z * [new branch] pyobjectslot -> origin/pyobjectslot 2025-09-07T06:39:15.3289548Z * [new branch] python_compiled_autograd -> origin/python_compiled_autograd 2025-09-07T06:39:15.3289633Z * [new branch] qchip/export-D54134695 -> origin/qchip/export-D54134695 2025-09-07T06:39:15.3289699Z * [new branch] quint-bits -> origin/quint-bits 2025-09-07T06:39:15.3289766Z * [new branch] release/1.10 -> origin/release/1.10 2025-09-07T06:39:15.3289832Z * [new branch] release/1.11 -> origin/release/1.11 2025-09-07T06:39:15.3289897Z * [new branch] release/1.12 -> origin/release/1.12 2025-09-07T06:39:15.3290000Z * [new branch] release/1.13 -> origin/release/1.13 2025-09-07T06:39:15.3290067Z * [new branch] release/1.4 -> origin/release/1.4 2025-09-07T06:39:15.3291135Z * [new branch] release/1.4.1 -> origin/release/1.4.1 2025-09-07T06:39:15.3291207Z * [new branch] release/1.5 -> origin/release/1.5 2025-09-07T06:39:15.3291272Z * [new branch] release/1.6 -> origin/release/1.6 2025-09-07T06:39:15.3291336Z * [new branch] release/1.7 -> origin/release/1.7 2025-09-07T06:39:15.3291400Z * [new branch] release/1.8 -> origin/release/1.8 2025-09-07T06:39:15.3291463Z * [new branch] release/1.9 -> origin/release/1.9 2025-09-07T06:39:15.3291527Z * [new branch] release/2.0 -> origin/release/2.0 2025-09-07T06:39:15.3291590Z * [new branch] release/2.1 -> origin/release/2.1 2025-09-07T06:39:15.3291659Z * [new branch] release/2.2 -> origin/release/2.2 2025-09-07T06:39:15.3291722Z * [new branch] release/2.3 -> origin/release/2.3 2025-09-07T06:39:15.3291787Z * [new branch] release/2.4 -> origin/release/2.4 2025-09-07T06:39:15.3291851Z * [new branch] release/2.5 -> origin/release/2.5 2025-09-07T06:39:15.3291915Z * [new branch] release/2.6 -> origin/release/2.6 2025-09-07T06:39:15.3291978Z * [new branch] release/2.7 -> origin/release/2.7 2025-09-07T06:39:15.3292040Z * [new branch] release/2.8 -> origin/release/2.8 2025-09-07T06:39:15.3292108Z * [new branch] release_notes -> origin/release_notes 2025-09-07T06:39:15.3292198Z * [new branch] remove-actionable-label -> origin/remove-actionable-label 2025-09-07T06:39:15.3292267Z * [new branch] remove-ao -> origin/remove-ao 2025-09-07T06:39:15.3292360Z * [new branch] removedeprecatedvllmtest -> origin/removedeprecatedvllmtest 2025-09-07T06:39:15.3292486Z * [new branch] replace-pytorch-labs-20250812-195836 -> origin/replace-pytorch-labs-20250812-195836 2025-09-07T06:39:15.3292608Z * [new branch] replace-pytorch-labs-20250812-200248 -> origin/replace-pytorch-labs-20250812-200248 2025-09-07T06:39:15.3292727Z * [new branch] replace-pytorch-labs-20250812-200324 -> origin/replace-pytorch-labs-20250812-200324 2025-09-07T06:39:15.3292844Z * [new branch] replace-pytorch-labs-20250812-204020 -> origin/replace-pytorch-labs-20250812-204020 2025-09-07T06:39:15.3292961Z * [new branch] replace-pytorch-labs-20250812-204125 -> origin/replace-pytorch-labs-20250812-204125 2025-09-07T06:39:15.3294104Z * [new branch] replace-pytorch-labs-20250812-205624 -> origin/replace-pytorch-labs-20250812-205624 2025-09-07T06:39:15.3294247Z * [new branch] revert-131069-gh/krzysztofjordan/1/head -> origin/revert-131069-gh/krzysztofjordan/1/head 2025-09-07T06:39:15.3294421Z * [new branch] revert-131469-gh/andrewor14/51/head -> origin/revert-131469-gh/andrewor14/51/head 2025-09-07T06:39:15.3294527Z * [new branch] revert-156870-gh/skarjala/3/head -> origin/revert-156870-gh/skarjala/3/head 2025-09-07T06:39:15.3294702Z * [new branch] revert-157914-cherry-pick-157503-by-pytorch_bot_bot_ -> origin/revert-157914-cherry-pick-157503-by-pytorch_bot_bot_ 2025-09-07T06:39:15.3294776Z * [new branch] rocm-monitoring -> origin/rocm-monitoring 2025-09-07T06:39:15.3294854Z * [new branch] ruisi/relax_memory -> origin/ruisi/relax_memory 2025-09-07T06:39:15.3294963Z * [new branch] run-torchbench-smoke-test-h100 -> origin/run-torchbench-smoke-test-h100 2025-09-07T06:39:15.3295176Z * [new branch] ryanguo99/cleanup-dynamo-expected-failures -> origin/ryanguo99/cleanup-dynamo-expected-failures 2025-09-07T06:39:15.3295269Z * [new branch] ryanguo99/fix-closure-var -> origin/ryanguo99/fix-closure-var 2025-09-07T06:39:15.3295352Z * [new branch] rzou/faketensor_bench -> origin/rzou/faketensor_bench 2025-09-07T06:39:15.3295417Z * [new branch] rzou/njt -> origin/rzou/njt 2025-09-07T06:39:15.3295482Z * [new branch] rzou/pca -> origin/rzou/pca 2025-09-07T06:39:15.3295552Z * [new branch] rzou/realprop -> origin/rzou/realprop 2025-09-07T06:39:15.3295628Z * [new branch] rzou/setup_context -> origin/rzou/setup_context 2025-09-07T06:39:15.3295755Z * [new branch] sanchitintel/refactor_aten_int8_woq_gemm -> origin/sanchitintel/refactor_aten_int8_woq_gemm 2025-09-07T06:39:15.3295921Z * [new branch] sanchitintel/weird_thing_with_test_cpu_select_algorithm -> origin/sanchitintel/weird_thing_with_test_cpu_select_algorithm 2025-09-07T06:39:15.3296018Z * [new branch] sapling-pr-archive-SS-JIA -> origin/sapling-pr-archive-SS-JIA 2025-09-07T06:39:15.3296083Z * [new branch] save -> origin/save 2025-09-07T06:39:15.3296150Z * [new branch] sdym/2.5.1 -> origin/sdym/2.5.1 2025-09-07T06:39:15.3296231Z * [new branch] seemethere-patch-1 -> origin/seemethere-patch-1 2025-09-07T06:39:15.3296297Z * [new branch] setupvllm -> origin/setupvllm 2025-09-07T06:39:15.3296371Z * [new branch] share_and_pin_fork -> origin/share_and_pin_fork 2025-09-07T06:39:15.3296451Z * [new branch] shengf/fx-xform-perf -> origin/shengf/fx-xform-perf 2025-09-07T06:39:15.3296532Z * [new branch] shikaili_fp8_allgather -> origin/shikaili_fp8_allgather 2025-09-07T06:39:15.3297593Z * [new branch] shoumikhin-patch-1 -> origin/shoumikhin-patch-1 2025-09-07T06:39:15.3297675Z * [new branch] shoumikhin-patch-12 -> origin/shoumikhin-patch-12 2025-09-07T06:39:15.3297767Z * [new branch] simplify-fq-per-channel -> origin/simplify-fq-per-channel 2025-09-07T06:39:15.3297846Z * [new branch] solve-accuracy-fix -> origin/solve-accuracy-fix 2025-09-07T06:39:15.3297930Z * [new branch] soulitzer/stash-tls-ac -> origin/soulitzer/stash-tls-ac 2025-09-07T06:39:15.3298005Z * [new branch] sqzhang/flight4 -> origin/sqzhang/flight4 2025-09-07T06:39:15.3298088Z * [new branch] sqzhang/flight4plus -> origin/sqzhang/flight4plus 2025-09-07T06:39:15.3298176Z * [new branch] sraikund/record_funct_test -> origin/sraikund/record_funct_test 2025-09-07T06:39:15.3298248Z * [new branch] sraikund16/test -> origin/sraikund16/test 2025-09-07T06:39:15.3298343Z * [new branch] stablize-compilation-time -> origin/stablize-compilation-time 2025-09-07T06:39:15.3298427Z * [new branch] standalone-templates -> origin/standalone-templates 2025-09-07T06:39:15.3298557Z * [new branch] standalone_package_weights -> origin/standalone_package_weights 2025-09-07T06:39:15.3298635Z * [new branch] starterTaskUpdate -> origin/starterTaskUpdate 2025-09-07T06:39:15.3298703Z * [new branch] subgraph_fuse -> origin/subgraph_fuse 2025-09-07T06:39:15.3298793Z * [new branch] support-uv-in-collect_env -> origin/support-uv-in-collect_env 2025-09-07T06:39:15.3298858Z * [new branch] sve-poc -> origin/sve-poc 2025-09-07T06:39:15.3298931Z * [new branch] svekars-patch-1 -> origin/svekars-patch-1 2025-09-07T06:39:15.3298997Z * [new branch] switch-bn -> origin/switch-bn 2025-09-07T06:39:15.3299119Z * [new branch] sympy-bottleneck-repro -> origin/sympy-bottleneck-repro 2025-09-07T06:39:15.3299204Z * [new branch] tenpercent/ck_rocm_ci_v3 -> origin/tenpercent/ck_rocm_ci_v3 2025-09-07T06:39:15.3299286Z * [new branch] tensordict_integration -> origin/tensordict_integration 2025-09-07T06:39:15.3299350Z * [new branch] test-7054 -> origin/test-7054 2025-09-07T06:39:15.3299435Z * [new branch] test-move-conda-builds -> origin/test-move-conda-builds 2025-09-07T06:39:15.3299538Z * [new branch] test-myst-markdown-docstring -> origin/test-myst-markdown-docstring 2025-09-07T06:39:15.3300561Z * [new branch] test-old -> origin/test-old 2025-09-07T06:39:15.3300669Z * [new branch] test-vec-migration-internally -> origin/test-vec-migration-internally 2025-09-07T06:39:15.3300737Z * [new branch] test/bmm_heur -> origin/test/bmm_heur 2025-09-07T06:39:15.3300810Z * [new branch] test/inductor -> origin/test/inductor 2025-09-07T06:39:15.3300900Z * [new branch] tianren/flex_paged_attn_fix -> origin/tianren/flex_paged_attn_fix 2025-09-07T06:39:15.3301005Z * [new branch] tianren/flex_paged_attn_fix_temp -> origin/tianren/flex_paged_attn_fix_temp 2025-09-07T06:39:15.3301073Z * [new branch] tianren/test -> origin/tianren/test 2025-09-07T06:39:15.3301152Z * [new branch] tidy_performance_cyy -> origin/tidy_performance_cyy 2025-09-07T06:39:15.3301221Z * [new branch] torchtitan_ep -> origin/torchtitan_ep 2025-09-07T06:39:15.3301305Z * [new branch] trace_fsdp_torchtune_lora -> origin/trace_fsdp_torchtune_lora 2025-09-07T06:39:15.3301389Z * [new branch] traceable_fsdp_unit_tests -> origin/traceable_fsdp_unit_tests 2025-09-07T06:39:15.3301463Z * [new branch] tree_loop_vec_base -> origin/tree_loop_vec_base 2025-09-07T06:39:15.3301528Z * [new branch] tree_vec_base -> origin/tree_vec_base 2025-09-07T06:39:15.3301598Z * [new branch] triton-update -> origin/triton-update 2025-09-07T06:39:15.3301665Z * [new branch] triton_kernel -> origin/triton_kernel 2025-09-07T06:39:15.3301739Z * [new branch] triton_kernel_perf -> origin/triton_kernel_perf 2025-09-07T06:39:15.3301804Z * [new branch] tt_pkg_1908 -> origin/tt_pkg_1908 2025-09-07T06:39:15.3301906Z * [new branch] tweak-transformer-dependabot -> origin/tweak-transformer-dependabot 2025-09-07T06:39:15.3301970Z * [new branch] type_dec -> origin/type_dec 2025-09-07T06:39:15.3302064Z * [new branch] udate-sphinx-dependancies -> origin/udate-sphinx-dependancies 2025-09-07T06:39:15.3302203Z * [new branch] update-audio-commit-hash/16818882925-1712-1 -> origin/update-audio-commit-hash/16818882925-1712-1 2025-09-07T06:39:15.3302337Z * [new branch] update-audio-commit-hash/16895560422-1720-1 -> origin/update-audio-commit-hash/16895560422-1720-1 2025-09-07T06:39:15.3302515Z * [new branch] update-audio-commit-hash/16924174496-1738-1 -> origin/update-audio-commit-hash/16924174496-1738-1 2025-09-07T06:39:15.3302646Z * [new branch] update-audio-commit-hash/17002010821-1749-1 -> origin/update-audio-commit-hash/17002010821-1749-1 2025-09-07T06:39:15.3303811Z * [new branch] update-audio-commit-hash/17056004427-1766-1 -> origin/update-audio-commit-hash/17056004427-1766-1 2025-09-07T06:39:15.3303946Z * [new branch] update-audio-commit-hash/17085054029-1767-1 -> origin/update-audio-commit-hash/17085054029-1767-1 2025-09-07T06:39:15.3304076Z * [new branch] update-audio-commit-hash/17142507405-1771-1 -> origin/update-audio-commit-hash/17142507405-1771-1 2025-09-07T06:39:15.3304270Z * [new branch] update-audio-commit-hash/17168762740-1773-1 -> origin/update-audio-commit-hash/17168762740-1773-1 2025-09-07T06:39:15.3304402Z * [new branch] update-audio-commit-hash/17311174639-1780-1 -> origin/update-audio-commit-hash/17311174639-1780-1 2025-09-07T06:39:15.3304532Z * [new branch] update-audio-commit-hash/17336898740-1781-1 -> origin/update-audio-commit-hash/17336898740-1781-1 2025-09-07T06:39:15.3304661Z * [new branch] update-audio-commit-hash/17389727684-1786-1 -> origin/update-audio-commit-hash/17389727684-1786-1 2025-09-07T06:39:15.3304792Z * [new branch] update-audio-commit-hash/17449538142-1790-1 -> origin/update-audio-commit-hash/17449538142-1790-1 2025-09-07T06:39:15.3304921Z * [new branch] update-audio-commit-hash/17507351808-1794-1 -> origin/update-audio-commit-hash/17507351808-1794-1 2025-09-07T06:39:15.3305020Z * [new branch] update-dynamic-shapes-doc -> origin/update-dynamic-shapes-doc 2025-09-07T06:39:15.3305175Z * [new branch] update-executorch-commit-hash/15694981040-1626-1 -> origin/update-executorch-commit-hash/15694981040-1626-1 2025-09-07T06:39:15.3305312Z * [new branch] update-triton-commit-hash/13663274526-1487-2 -> origin/update-triton-commit-hash/13663274526-1487-2 2025-09-07T06:39:15.3305448Z * [new branch] update-vision-commit-hash/15336342773-1607-1 -> origin/update-vision-commit-hash/15336342773-1607-1 2025-09-07T06:39:15.3305577Z * [new branch] update-vllm-commit-hash/16737365217-1704-1 -> origin/update-vllm-commit-hash/16737365217-1704-1 2025-09-07T06:39:15.3305704Z * [new branch] update-vllm-commit-hash/16843157111-1713-1 -> origin/update-vllm-commit-hash/16843157111-1713-1 2025-09-07T06:39:15.3305830Z * [new branch] update-vllm-commit-hash/16855312394-1714-1 -> origin/update-vllm-commit-hash/16855312394-1714-1 2025-09-07T06:39:15.3305957Z * [new branch] update-vllm-commit-hash/16924174496-1738-1 -> origin/update-vllm-commit-hash/16924174496-1738-1 2025-09-07T06:39:15.3306082Z * [new branch] update-vllm-commit-hash/16952608705-1745-1 -> origin/update-vllm-commit-hash/16952608705-1745-1 2025-09-07T06:39:15.3306208Z * [new branch] update-vllm-commit-hash/16979836546-1748-1 -> origin/update-vllm-commit-hash/16979836546-1748-1 2025-09-07T06:39:15.3306334Z * [new branch] update-vllm-commit-hash/17014576881-1756-1 -> origin/update-vllm-commit-hash/17014576881-1756-1 2025-09-07T06:39:15.3306458Z * [new branch] update-vllm-commit-hash/17027830869-1761-1 -> origin/update-vllm-commit-hash/17027830869-1761-1 2025-09-07T06:39:15.3306584Z * [new branch] update-vllm-commit-hash/17056004427-1766-1 -> origin/update-vllm-commit-hash/17056004427-1766-1 2025-09-07T06:39:15.3306710Z * [new branch] update-vllm-commit-hash/17085054029-1767-1 -> origin/update-vllm-commit-hash/17085054029-1767-1 2025-09-07T06:39:15.3306840Z * [new branch] update-vllm-commit-hash/17113610216-1768-1 -> origin/update-vllm-commit-hash/17113610216-1768-1 2025-09-07T06:39:15.3307994Z * [new branch] update-vllm-commit-hash/17142507405-1771-1 -> origin/update-vllm-commit-hash/17142507405-1771-1 2025-09-07T06:39:15.3308122Z * [new branch] update-vllm-commit-hash/17181878974-1774-1 -> origin/update-vllm-commit-hash/17181878974-1774-1 2025-09-07T06:39:15.3308247Z * [new branch] update-vllm-commit-hash/17311174639-1780-1 -> origin/update-vllm-commit-hash/17311174639-1780-1 2025-09-07T06:39:15.3308372Z * [new branch] update-vllm-commit-hash/17336898740-1781-1 -> origin/update-vllm-commit-hash/17336898740-1781-1 2025-09-07T06:39:15.3308496Z * [new branch] update-vllm-commit-hash/17364352302-1785-1 -> origin/update-vllm-commit-hash/17364352302-1785-1 2025-09-07T06:39:15.3308655Z * [new branch] update-vllm-commit-hash/17389727684-1786-1 -> origin/update-vllm-commit-hash/17389727684-1786-1 2025-09-07T06:39:15.3308781Z * [new branch] update-vllm-commit-hash/17449538142-1790-1 -> origin/update-vllm-commit-hash/17449538142-1790-1 2025-09-07T06:39:15.3308907Z * [new branch] update-vllm-commit-hash/17480069797-1791-1 -> origin/update-vllm-commit-hash/17480069797-1791-1 2025-09-07T06:39:15.3309031Z * [new branch] update-vllm-commit-hash/17507351808-1794-1 -> origin/update-vllm-commit-hash/17507351808-1794-1 2025-09-07T06:39:15.3309156Z * [new branch] update-xla-commit-hash/16873912760-198-1 -> origin/update-xla-commit-hash/16873912760-198-1 2025-09-07T06:39:15.3309277Z * [new branch] update-xla-commit-hash/17034266655-199-1 -> origin/update-xla-commit-hash/17034266655-199-1 2025-09-07T06:39:15.3309397Z * [new branch] update-xla-commit-hash/17202464405-200-1 -> origin/update-xla-commit-hash/17202464405-200-1 2025-09-07T06:39:15.3309524Z * [new branch] update_docs_torch_multinomial_issue#125388 -> origin/update_docs_torch_multinomial_issue#125388 2025-09-07T06:39:15.3309607Z * [new branch] update_executorch_pin -> origin/update_executorch_pin 2025-09-07T06:39:15.3309697Z * [new branch] update_slow_tests_1722488736 -> origin/update_slow_tests_1722488736 2025-09-07T06:39:15.3309786Z * [new branch] update_slow_tests_1722879173 -> origin/update_slow_tests_1722879173 2025-09-07T06:39:15.3309872Z * [new branch] update_slow_tests_1752478971 -> origin/update_slow_tests_1752478971 2025-09-07T06:39:15.3309956Z * [new branch] update_slow_tests_1755502951 -> origin/update_slow_tests_1755502951 2025-09-07T06:39:15.3310041Z * [new branch] update_slow_tests_1756107664 -> origin/update_slow_tests_1756107664 2025-09-07T06:39:15.3310127Z * [new branch] update_submodule_FBGEMM -> origin/update_submodule_FBGEMM 2025-09-07T06:39:15.3310212Z * [new branch] update_submodule_kineto -> origin/update_submodule_kineto 2025-09-07T06:39:15.3310302Z * [new branch] update_submodule_tensorpipe -> origin/update_submodule_tensorpipe 2025-09-07T06:39:15.3310369Z * [new branch] v0.1.2 -> origin/v0.1.2 2025-09-07T06:39:15.3310436Z * [new branch] v1.0.1 -> origin/v1.0.1 2025-09-07T06:39:15.3311453Z * [new branch] v1.0.3 -> origin/v1.0.3 2025-09-07T06:39:15.3311516Z * [new branch] v1.1.0 -> origin/v1.1.0 2025-09-07T06:39:15.3311575Z * [new branch] v1.2.0 -> origin/v1.2.0 2025-09-07T06:39:15.3311633Z * [new branch] v1.3.0 -> origin/v1.3.0 2025-09-07T06:39:15.3311692Z * [new branch] v1.3.1 -> origin/v1.3.1 2025-09-07T06:39:15.3311760Z * [new branch] validate_fn -> origin/validate_fn 2025-09-07T06:39:15.3311837Z * [new branch] validations_2.6 -> origin/validations_2.6 2025-09-07T06:39:15.3311910Z * [new branch] validations_2.8 -> origin/validations_2.8 2025-09-07T06:39:15.3312017Z * [new branch] viable/strict -> origin/viable/strict 2025-09-07T06:39:15.3312084Z * [new branch] vllmbuildci -> origin/vllmbuildci 2025-09-07T06:39:15.3312150Z * [new branch] vllmpin -> origin/vllmpin 2025-09-07T06:39:15.3312234Z * [new branch] wdvr/conda_devcontainer -> origin/wdvr/conda_devcontainer 2025-09-07T06:39:15.3312303Z * [new branch] wdvr/iss_145259 -> origin/wdvr/iss_145259 2025-09-07T06:39:15.3312380Z * [new branch] weight_sharing_cpp -> origin/weight_sharing_cpp 2025-09-07T06:39:15.3312446Z * [new branch] whc/flight4 -> origin/whc/flight4 2025-09-07T06:39:15.3312559Z * [new branch] whc/flight51 -> origin/whc/flight51 2025-09-07T06:39:15.3312627Z * [new branch] whc/flight53 -> origin/whc/flight53 2025-09-07T06:39:15.3312693Z * [new branch] whc/stage2 -> origin/whc/stage2 2025-09-07T06:39:15.3312759Z * [new branch] whc/uneven -> origin/whc/uneven 2025-09-07T06:39:15.3312834Z * [new branch] whc/uneven-merge -> origin/whc/uneven-merge 2025-09-07T06:39:15.3312901Z * [new branch] win_warnings -> origin/win_warnings 2025-09-07T06:39:15.3312979Z * [new branch] windows_libtorch_free -> origin/windows_libtorch_free 2025-09-07T06:39:15.3313052Z * [new branch] workonoldcommit -> origin/workonoldcommit 2025-09-07T06:39:15.3313272Z * [new branch] wychi-autotune-prune-configs-by-shared-mem -> origin/wychi-autotune-prune-configs-by-shared-mem 2025-09-07T06:39:15.3314317Z * [new branch] xmfan/ca_0516 -> origin/xmfan/ca_0516 2025-09-07T06:39:15.3314396Z * [new branch] xmfan/ca_1051b93192 -> origin/xmfan/ca_1051b93192 2025-09-07T06:39:15.3314548Z * [new branch] xmfan/ca_1a722f62c248391fc4a542e8851a5559aa356ae8 -> origin/xmfan/ca_1a722f62c248391fc4a542e8851a5559aa356ae8 2025-09-07T06:39:15.3314622Z * [new branch] xmfan/ca_5a2be192d1 -> origin/xmfan/ca_5a2be192d1 2025-09-07T06:39:15.3314696Z * [new branch] xmfan/ca_9d59b516e9 -> origin/xmfan/ca_9d59b516e9 2025-09-07T06:39:15.3314764Z * [new branch] xmfan/ca_api -> origin/xmfan/ca_api 2025-09-07T06:39:15.3314831Z * [new branch] xmfan/ca_apr8 -> origin/xmfan/ca_apr8 2025-09-07T06:39:15.3314898Z * [new branch] xmfan/ca_base -> origin/xmfan/ca_base 2025-09-07T06:39:15.3314981Z * [new branch] xmfan/ca_cudagraphs -> origin/xmfan/ca_cudagraphs 2025-09-07T06:39:15.3315052Z * [new branch] xmfan/ca_dynamic -> origin/xmfan/ca_dynamic 2025-09-07T06:39:15.3315122Z * [new branch] xmfan/ca_fix_dyn -> origin/xmfan/ca_fix_dyn 2025-09-07T06:39:15.3315201Z * [new branch] xmfan/ca_fix_lowering -> origin/xmfan/ca_fix_lowering 2025-09-07T06:39:15.3315280Z * [new branch] xmfan/ca_fix_polyfills -> origin/xmfan/ca_fix_polyfills 2025-09-07T06:39:15.3315346Z * [new branch] xmfan/ca_jan3 -> origin/xmfan/ca_jan3 2025-09-07T06:39:15.3315415Z * [new branch] xmfan/ca_jun18 -> origin/xmfan/ca_jun18 2025-09-07T06:39:15.3315482Z * [new branch] xmfan/ca_jun24 -> origin/xmfan/ca_jun24 2025-09-07T06:39:15.3315554Z * [new branch] xmfan/ca_mem_base -> origin/xmfan/ca_mem_base 2025-09-07T06:39:15.3315626Z * [new branch] xmfan/ca_mem_fix -> origin/xmfan/ca_mem_fix 2025-09-07T06:39:15.3315699Z * [new branch] xmfan/ca_memory_fix -> origin/xmfan/ca_memory_fix 2025-09-07T06:39:15.3315786Z * [new branch] xmfan/ca_memory_fix_rebased -> origin/xmfan/ca_memory_fix_rebased 2025-09-07T06:39:15.3315941Z * [new branch] xmfan/ca_memory_fix_rebased2 -> origin/xmfan/ca_memory_fix_rebased2 2025-09-07T06:39:15.3316017Z * [new branch] xmfan/ca_move_to_cuda -> origin/xmfan/ca_move_to_cuda 2025-09-07T06:39:15.3316086Z * [new branch] xmfan/ca_nested -> origin/xmfan/ca_nested 2025-09-07T06:39:15.3316159Z * [new branch] xmfan/ca_overhead -> origin/xmfan/ca_overhead 2025-09-07T06:39:15.3317211Z * [new branch] xmfan/ca_overhead_0eba7e5451 -> origin/xmfan/ca_overhead_0eba7e5451 2025-09-07T06:39:15.3317282Z * [new branch] xmfan/ca_scalar -> origin/xmfan/ca_scalar 2025-09-07T06:39:15.3317432Z * [new branch] xmfan/ca_subclass_mem_fix -> origin/xmfan/ca_subclass_mem_fix 2025-09-07T06:39:15.3317503Z * [new branch] xmfan/ca_warm_mem -> origin/xmfan/ca_warm_mem 2025-09-07T06:39:15.3317582Z * [new branch] xmfan/ca_warm_mem_base -> origin/xmfan/ca_warm_mem_base 2025-09-07T06:39:15.3317655Z * [new branch] xmfan/cacu_jun18 -> origin/xmfan/cacu_jun18 2025-09-07T06:39:15.3317725Z * [new branch] xmfan/cacu_jun19 -> origin/xmfan/cacu_jun19 2025-09-07T06:39:15.3317794Z * [new branch] xmfan/cacu_jun4 -> origin/xmfan/cacu_jun4 2025-09-07T06:39:15.3317864Z * [new branch] xmfan/cacu_may27 -> origin/xmfan/cacu_may27 2025-09-07T06:39:15.3317950Z * [new branch] xmfan/disable_duck_shape -> origin/xmfan/disable_duck_shape 2025-09-07T06:39:15.3318048Z * [new branch] xmfan/fca_cpp_node_passthrough -> origin/xmfan/fca_cpp_node_passthrough 2025-09-07T06:39:15.3318126Z * [new branch] xmfan/issue_123374 -> origin/xmfan/issue_123374 2025-09-07T06:39:15.3318278Z * [new branch] xmfan/post_3945954741e2d37023c5d6954f9483008e0892f9 -> origin/xmfan/post_3945954741e2d37023c5d6954f9483008e0892f9 2025-09-07T06:39:15.3318423Z * [new branch] xmfan/pre_3945954741e2d37023c5d6954f9483008e0892f9 -> origin/xmfan/pre_3945954741e2d37023c5d6954f9483008e0892f9 2025-09-07T06:39:15.3318501Z * [new branch] xmfan/segfault_test -> origin/xmfan/segfault_test 2025-09-07T06:39:15.3318574Z * [new branch] xmfan/single_step -> origin/xmfan/single_step 2025-09-07T06:39:15.3318641Z * [new branch] xmfan/sth_0829 -> origin/xmfan/sth_0829 2025-09-07T06:39:15.3318707Z * [new branch] xmfan/test -> origin/xmfan/test 2025-09-07T06:39:15.3318798Z * [new branch] yguo/debug-0226-constexpr -> origin/yguo/debug-0226-constexpr 2025-09-07T06:39:15.3318883Z * [new branch] yguo/new_latest_changes -> origin/yguo/new_latest_changes 2025-09-07T06:39:15.3318976Z * [new branch] yguo/patch_constexpr_changes -> origin/yguo/patch_constexpr_changes 2025-09-07T06:39:15.3319053Z * [new branch] yihan_quantization -> origin/yihan_quantization 2025-09-07T06:39:15.3319149Z * [new branch] yiming/add_jit_trace_benchmark -> origin/yiming/add_jit_trace_benchmark 2025-09-07T06:39:15.3319245Z * [new branch] yiming/add_nativert_benchmark -> origin/yiming/add_nativert_benchmark 2025-09-07T06:39:15.3320274Z * [new branch] yiming/bootcamp -> origin/yiming/bootcamp 2025-09-07T06:39:15.3320351Z * [new branch] zainr/canary-test -> origin/zainr/canary-test 2025-09-07T06:39:15.3320445Z * [new branch] zainr/cleanup-gh-runners -> origin/zainr/cleanup-gh-runners 2025-09-07T06:39:15.3320524Z * [new branch] zainr/git-push-v2 -> origin/zainr/git-push-v2 2025-09-07T06:39:15.3320608Z * [new branch] zainr/pull-migration-c -> origin/zainr/pull-migration-c 2025-09-07T06:39:15.3320684Z * [new branch] zainr/test -> origin/zainr/test 2025-09-07T06:39:15.3320787Z * [new branch] zainr/test2 -> origin/zainr/test2 2025-09-07T06:39:15.3320859Z * [new branch] zainr/unstable -> origin/zainr/unstable 2025-09-07T06:39:15.3320937Z * [new branch] zainr/unstable-xla -> origin/zainr/unstable-xla 2025-09-07T06:39:15.3321015Z * [new branch] zasdfgbnm-patch-3 -> origin/zasdfgbnm-patch-3 2025-09-07T06:39:15.3321078Z * [new branch] zb2p -> origin/zb2p 2025-09-07T06:39:15.3321159Z * [new branch] zero_grad_optimization -> origin/zero_grad_optimization 2025-09-07T06:39:15.3321284Z * [new branch] zeros-and-scatter-part2 -> origin/zeros-and-scatter-part2 2025-09-07T06:39:15.3321364Z * [new branch] zhxchen17/scratch/0 -> origin/zhxchen17/scratch/0 2025-09-07T06:39:15.3321445Z * [new branch] zhxhcen17/moodycamel -> origin/zhxhcen17/moodycamel 2025-09-07T06:39:15.3321513Z * [new branch] zxiiro/main -> origin/zxiiro/main 2025-09-07T06:39:15.3321683Z * [new tag] bc2caa7fdf006894eff7af936babde69ab5a40f8-huydhn-debug -> bc2caa7fdf006894eff7af936babde69ab5a40f8-huydhn-debug 2025-09-07T06:39:15.3321746Z * [new tag] ci/binaries/77164 -> ci/binaries/77164 2025-09-07T06:39:15.3321815Z * [new tag] ciflow/binaries/156049 -> ciflow/binaries/156049 2025-09-07T06:39:15.3321883Z * [new tag] ciflow/binaries/156712 -> ciflow/binaries/156712 2025-09-07T06:39:15.3321949Z * [new tag] ciflow/binaries/157432 -> ciflow/binaries/157432 2025-09-07T06:39:15.3322016Z * [new tag] ciflow/binaries/157685 -> ciflow/binaries/157685 2025-09-07T06:39:15.3322084Z * [new tag] ciflow/binaries/157689 -> ciflow/binaries/157689 2025-09-07T06:39:15.3322151Z * [new tag] ciflow/binaries/158104 -> ciflow/binaries/158104 2025-09-07T06:39:15.3323321Z * [new tag] ciflow/binaries/160229 -> ciflow/binaries/160229 2025-09-07T06:39:15.3323398Z * [new tag] ciflow/binaries/160720 -> ciflow/binaries/160720 2025-09-07T06:39:15.3323465Z * [new tag] ciflow/binaries/162080 -> ciflow/binaries/162080 2025-09-07T06:39:15.3323531Z * [new tag] ciflow/binaries/162329 -> ciflow/binaries/162329 2025-09-07T06:39:15.3323619Z * [new tag] ciflow/binaries_libtorch/156049 -> ciflow/binaries_libtorch/156049 2025-09-07T06:39:15.3323706Z * [new tag] ciflow/binaries_libtorch/156711 -> ciflow/binaries_libtorch/156711 2025-09-07T06:39:15.3323795Z * [new tag] ciflow/binaries_libtorch/157432 -> ciflow/binaries_libtorch/157432 2025-09-07T06:39:15.3323873Z * [new tag] ciflow/binaries_wheel/156049 -> ciflow/binaries_wheel/156049 2025-09-07T06:39:15.3323951Z * [new tag] ciflow/binaries_wheel/156711 -> ciflow/binaries_wheel/156711 2025-09-07T06:39:15.3324026Z * [new tag] ciflow/binaries_wheel/157432 -> ciflow/binaries_wheel/157432 2025-09-07T06:39:15.3324101Z * [new tag] ciflow/binaries_wheel/162136 -> ciflow/binaries_wheel/162136 2025-09-07T06:39:15.3324176Z * [new tag] ciflow/binaries_wheel/162252 -> ciflow/binaries_wheel/162252 2025-09-07T06:39:15.3324250Z * [new tag] ciflow/binaries_wheel/162325 -> ciflow/binaries_wheel/162325 2025-09-07T06:39:15.3324336Z * [new tag] ciflow/h100-distributed/156703 -> ciflow/h100-distributed/156703 2025-09-07T06:39:15.3324412Z * [new tag] ciflow/h100-symm-mem/157635 -> ciflow/h100-symm-mem/157635 2025-09-07T06:39:15.3324484Z * [new tag] ciflow/h100-symm-mem/161984 -> ciflow/h100-symm-mem/161984 2025-09-07T06:39:15.3324557Z * [new tag] ciflow/h100-symm-mem/162003 -> ciflow/h100-symm-mem/162003 2025-09-07T06:39:15.3324687Z * [new tag] ciflow/h100-symm-mem/162011 -> ciflow/h100-symm-mem/162011 2025-09-07T06:39:15.3324759Z * [new tag] ciflow/h100-symm-mem/162026 -> ciflow/h100-symm-mem/162026 2025-09-07T06:39:15.3324830Z * [new tag] ciflow/h100-symm-mem/162033 -> ciflow/h100-symm-mem/162033 2025-09-07T06:39:15.3324901Z * [new tag] ciflow/h100-symm-mem/162040 -> ciflow/h100-symm-mem/162040 2025-09-07T06:39:15.3324971Z * [new tag] ciflow/h100-symm-mem/162041 -> ciflow/h100-symm-mem/162041 2025-09-07T06:39:15.3325042Z * [new tag] ciflow/h100-symm-mem/162142 -> ciflow/h100-symm-mem/162142 2025-09-07T06:39:15.3325171Z * [new tag] ciflow/h100-symm-mem/162150 -> ciflow/h100-symm-mem/162150 2025-09-07T06:39:15.3325240Z * [new tag] ciflow/h100-symm-mem/162243 -> ciflow/h100-symm-mem/162243 2025-09-07T06:39:15.3326317Z * [new tag] ciflow/h100-symm-mem/162320 -> ciflow/h100-symm-mem/162320 2025-09-07T06:39:15.3326383Z * [new tag] ciflow/h100/159158 -> ciflow/h100/159158 2025-09-07T06:39:15.3326443Z * [new tag] ciflow/h100/160480 -> ciflow/h100/160480 2025-09-07T06:39:15.3326503Z * [new tag] ciflow/h100/161749 -> ciflow/h100/161749 2025-09-07T06:39:15.3326562Z * [new tag] ciflow/h100/162022 -> ciflow/h100/162022 2025-09-07T06:39:15.3326621Z * [new tag] ciflow/h100/162278 -> ciflow/h100/162278 2025-09-07T06:39:15.3326765Z * [new tag] ciflow/inductor-perf-test-nightly-rocm/156592 -> ciflow/inductor-perf-test-nightly-rocm/156592 2025-09-07T06:39:15.3326890Z * [new tag] ciflow/inductor-perf-test-nightly/156592 -> ciflow/inductor-perf-test-nightly/156592 2025-09-07T06:39:15.3326981Z * [new tag] ciflow/inductor-periodic/162063 -> ciflow/inductor-periodic/162063 2025-09-07T06:39:15.3327073Z * [new tag] ciflow/inductor-periodic/162227 -> ciflow/inductor-periodic/162227 2025-09-07T06:39:15.3327160Z * [new tag] ciflow/inductor-periodic/162323 -> ciflow/inductor-periodic/162323 2025-09-07T06:39:15.3327236Z * [new tag] ciflow/inductor-rocm/154170 -> ciflow/inductor-rocm/154170 2025-09-07T06:39:15.3327308Z * [new tag] ciflow/inductor-rocm/159146 -> ciflow/inductor-rocm/159146 2025-09-07T06:39:15.3327382Z * [new tag] ciflow/inductor-rocm/159158 -> ciflow/inductor-rocm/159158 2025-09-07T06:39:15.3327455Z * [new tag] ciflow/inductor-rocm/161715 -> ciflow/inductor-rocm/161715 2025-09-07T06:39:15.3327528Z * [new tag] ciflow/inductor-rocm/162053 -> ciflow/inductor-rocm/162053 2025-09-07T06:39:15.3327601Z * [new tag] ciflow/inductor-rocm/162056 -> ciflow/inductor-rocm/162056 2025-09-07T06:39:15.3327669Z * [new tag] ciflow/inductor/137400 -> ciflow/inductor/137400 2025-09-07T06:39:15.3327738Z * [new tag] ciflow/inductor/148180 -> ciflow/inductor/148180 2025-09-07T06:39:15.3327806Z * [new tag] ciflow/inductor/148328 -> ciflow/inductor/148328 2025-09-07T06:39:15.3327871Z * [new tag] ciflow/inductor/148484 -> ciflow/inductor/148484 2025-09-07T06:39:15.3327937Z * [new tag] ciflow/inductor/148492 -> ciflow/inductor/148492 2025-09-07T06:39:15.3328004Z * [new tag] ciflow/inductor/152624 -> ciflow/inductor/152624 2025-09-07T06:39:15.3328069Z * [new tag] ciflow/inductor/154694 -> ciflow/inductor/154694 2025-09-07T06:39:15.3329189Z * [new tag] ciflow/inductor/156049 -> ciflow/inductor/156049 2025-09-07T06:39:15.3329262Z * [new tag] ciflow/inductor/156592 -> ciflow/inductor/156592 2025-09-07T06:39:15.3329328Z * [new tag] ciflow/inductor/157635 -> ciflow/inductor/157635 2025-09-07T06:39:15.3329454Z * [new tag] ciflow/inductor/157685 -> ciflow/inductor/157685 2025-09-07T06:39:15.3329521Z * [new tag] ciflow/inductor/157686 -> ciflow/inductor/157686 2025-09-07T06:39:15.3329587Z * [new tag] ciflow/inductor/157689 -> ciflow/inductor/157689 2025-09-07T06:39:15.3329652Z * [new tag] ciflow/inductor/157699 -> ciflow/inductor/157699 2025-09-07T06:39:15.3329718Z * [new tag] ciflow/inductor/157743 -> ciflow/inductor/157743 2025-09-07T06:39:15.3329783Z * [new tag] ciflow/inductor/157994 -> ciflow/inductor/157994 2025-09-07T06:39:15.3329883Z * [new tag] ciflow/inductor/158091 -> ciflow/inductor/158091 2025-09-07T06:39:15.3329950Z * [new tag] ciflow/inductor/158104 -> ciflow/inductor/158104 2025-09-07T06:39:15.3330014Z * [new tag] ciflow/inductor/158404 -> ciflow/inductor/158404 2025-09-07T06:39:15.3330081Z * [new tag] ciflow/inductor/158647 -> ciflow/inductor/158647 2025-09-07T06:39:15.3330147Z * [new tag] ciflow/inductor/158932 -> ciflow/inductor/158932 2025-09-07T06:39:15.3330213Z * [new tag] ciflow/inductor/159146 -> ciflow/inductor/159146 2025-09-07T06:39:15.3330278Z * [new tag] ciflow/inductor/159158 -> ciflow/inductor/159158 2025-09-07T06:39:15.3330343Z * [new tag] ciflow/inductor/159274 -> ciflow/inductor/159274 2025-09-07T06:39:15.3330410Z * [new tag] ciflow/inductor/159664 -> ciflow/inductor/159664 2025-09-07T06:39:15.3330475Z * [new tag] ciflow/inductor/159778 -> ciflow/inductor/159778 2025-09-07T06:39:15.3330541Z * [new tag] ciflow/inductor/159835 -> ciflow/inductor/159835 2025-09-07T06:39:15.3330608Z * [new tag] ciflow/inductor/159944 -> ciflow/inductor/159944 2025-09-07T06:39:15.3330674Z * [new tag] ciflow/inductor/160161 -> ciflow/inductor/160161 2025-09-07T06:39:15.3330739Z * [new tag] ciflow/inductor/160174 -> ciflow/inductor/160174 2025-09-07T06:39:15.3330805Z * [new tag] ciflow/inductor/160323 -> ciflow/inductor/160323 2025-09-07T06:39:15.3331861Z * [new tag] ciflow/inductor/160324 -> ciflow/inductor/160324 2025-09-07T06:39:15.3331931Z * [new tag] ciflow/inductor/160325 -> ciflow/inductor/160325 2025-09-07T06:39:15.3331998Z * [new tag] ciflow/inductor/160326 -> ciflow/inductor/160326 2025-09-07T06:39:15.3332063Z * [new tag] ciflow/inductor/160327 -> ciflow/inductor/160327 2025-09-07T06:39:15.3332132Z * [new tag] ciflow/inductor/160328 -> ciflow/inductor/160328 2025-09-07T06:39:15.3332198Z * [new tag] ciflow/inductor/160329 -> ciflow/inductor/160329 2025-09-07T06:39:15.3332265Z * [new tag] ciflow/inductor/160480 -> ciflow/inductor/160480 2025-09-07T06:39:15.3332330Z * [new tag] ciflow/inductor/160532 -> ciflow/inductor/160532 2025-09-07T06:39:15.3332396Z * [new tag] ciflow/inductor/160539 -> ciflow/inductor/160539 2025-09-07T06:39:15.3332461Z * [new tag] ciflow/inductor/160580 -> ciflow/inductor/160580 2025-09-07T06:39:15.3332526Z * [new tag] ciflow/inductor/160685 -> ciflow/inductor/160685 2025-09-07T06:39:15.3332591Z * [new tag] ciflow/inductor/160686 -> ciflow/inductor/160686 2025-09-07T06:39:15.3332658Z * [new tag] ciflow/inductor/160687 -> ciflow/inductor/160687 2025-09-07T06:39:15.3332726Z * [new tag] ciflow/inductor/160688 -> ciflow/inductor/160688 2025-09-07T06:39:15.3332792Z * [new tag] ciflow/inductor/160690 -> ciflow/inductor/160690 2025-09-07T06:39:15.3332899Z * [new tag] ciflow/inductor/160706 -> ciflow/inductor/160706 2025-09-07T06:39:15.3332965Z * [new tag] ciflow/inductor/160729 -> ciflow/inductor/160729 2025-09-07T06:39:15.3333031Z * [new tag] ciflow/inductor/160798 -> ciflow/inductor/160798 2025-09-07T06:39:15.3333161Z * [new tag] ciflow/inductor/160836 -> ciflow/inductor/160836 2025-09-07T06:39:15.3333229Z * [new tag] ciflow/inductor/160843 -> ciflow/inductor/160843 2025-09-07T06:39:15.3333294Z * [new tag] ciflow/inductor/160869 -> ciflow/inductor/160869 2025-09-07T06:39:15.3333363Z * [new tag] ciflow/inductor/160920 -> ciflow/inductor/160920 2025-09-07T06:39:15.3333486Z * [new tag] ciflow/inductor/160943 -> ciflow/inductor/160943 2025-09-07T06:39:15.3333551Z * [new tag] ciflow/inductor/161092 -> ciflow/inductor/161092 2025-09-07T06:39:15.3334618Z * [new tag] ciflow/inductor/161093 -> ciflow/inductor/161093 2025-09-07T06:39:15.3334693Z * [new tag] ciflow/inductor/161109 -> ciflow/inductor/161109 2025-09-07T06:39:15.3334758Z * [new tag] ciflow/inductor/161118 -> ciflow/inductor/161118 2025-09-07T06:39:15.3334824Z * [new tag] ciflow/inductor/161178 -> ciflow/inductor/161178 2025-09-07T06:39:15.3334889Z * [new tag] ciflow/inductor/161246 -> ciflow/inductor/161246 2025-09-07T06:39:15.3334954Z * [new tag] ciflow/inductor/161349 -> ciflow/inductor/161349 2025-09-07T06:39:15.3335021Z * [new tag] ciflow/inductor/161350 -> ciflow/inductor/161350 2025-09-07T06:39:15.3335091Z * [new tag] ciflow/inductor/161351 -> ciflow/inductor/161351 2025-09-07T06:39:15.3335157Z * [new tag] ciflow/inductor/161397 -> ciflow/inductor/161397 2025-09-07T06:39:15.3335223Z * [new tag] ciflow/inductor/161404 -> ciflow/inductor/161404 2025-09-07T06:39:15.3335291Z * [new tag] ciflow/inductor/161405 -> ciflow/inductor/161405 2025-09-07T06:39:15.3335356Z * [new tag] ciflow/inductor/161406 -> ciflow/inductor/161406 2025-09-07T06:39:15.3335422Z * [new tag] ciflow/inductor/161410 -> ciflow/inductor/161410 2025-09-07T06:39:15.3335487Z * [new tag] ciflow/inductor/161414 -> ciflow/inductor/161414 2025-09-07T06:39:15.3335552Z * [new tag] ciflow/inductor/161442 -> ciflow/inductor/161442 2025-09-07T06:39:15.3335619Z * [new tag] ciflow/inductor/161458 -> ciflow/inductor/161458 2025-09-07T06:39:15.3335687Z * [new tag] ciflow/inductor/161468 -> ciflow/inductor/161468 2025-09-07T06:39:15.3335752Z * [new tag] ciflow/inductor/161469 -> ciflow/inductor/161469 2025-09-07T06:39:15.3335817Z * [new tag] ciflow/inductor/161485 -> ciflow/inductor/161485 2025-09-07T06:39:15.3335884Z * [new tag] ciflow/inductor/161499 -> ciflow/inductor/161499 2025-09-07T06:39:15.3335949Z * [new tag] ciflow/inductor/161534 -> ciflow/inductor/161534 2025-09-07T06:39:15.3336014Z * [new tag] ciflow/inductor/161595 -> ciflow/inductor/161595 2025-09-07T06:39:15.3336080Z * [new tag] ciflow/inductor/161596 -> ciflow/inductor/161596 2025-09-07T06:39:15.3336145Z * [new tag] ciflow/inductor/161630 -> ciflow/inductor/161630 2025-09-07T06:39:15.3337197Z * [new tag] ciflow/inductor/161667 -> ciflow/inductor/161667 2025-09-07T06:39:15.3337268Z * [new tag] ciflow/inductor/161670 -> ciflow/inductor/161670 2025-09-07T06:39:15.3337333Z * [new tag] ciflow/inductor/161673 -> ciflow/inductor/161673 2025-09-07T06:39:15.3337399Z * [new tag] ciflow/inductor/161674 -> ciflow/inductor/161674 2025-09-07T06:39:15.3337526Z * [new tag] ciflow/inductor/161675 -> ciflow/inductor/161675 2025-09-07T06:39:15.3337592Z * [new tag] ciflow/inductor/161693 -> ciflow/inductor/161693 2025-09-07T06:39:15.3337657Z * [new tag] ciflow/inductor/161695 -> ciflow/inductor/161695 2025-09-07T06:39:15.3337724Z * [new tag] ciflow/inductor/161715 -> ciflow/inductor/161715 2025-09-07T06:39:15.3337789Z * [new tag] ciflow/inductor/161730 -> ciflow/inductor/161730 2025-09-07T06:39:15.3337854Z * [new tag] ciflow/inductor/161732 -> ciflow/inductor/161732 2025-09-07T06:39:15.3337920Z * [new tag] ciflow/inductor/161744 -> ciflow/inductor/161744 2025-09-07T06:39:15.3338018Z * [new tag] ciflow/inductor/161746 -> ciflow/inductor/161746 2025-09-07T06:39:15.3338083Z * [new tag] ciflow/inductor/161747 -> ciflow/inductor/161747 2025-09-07T06:39:15.3338151Z * [new tag] ciflow/inductor/161819 -> ciflow/inductor/161819 2025-09-07T06:39:15.3338216Z * [new tag] ciflow/inductor/161821 -> ciflow/inductor/161821 2025-09-07T06:39:15.3338282Z * [new tag] ciflow/inductor/161828 -> ciflow/inductor/161828 2025-09-07T06:39:15.3338347Z * [new tag] ciflow/inductor/161879 -> ciflow/inductor/161879 2025-09-07T06:39:15.3338412Z * [new tag] ciflow/inductor/161880 -> ciflow/inductor/161880 2025-09-07T06:39:15.3338477Z * [new tag] ciflow/inductor/161881 -> ciflow/inductor/161881 2025-09-07T06:39:15.3338543Z * [new tag] ciflow/inductor/161907 -> ciflow/inductor/161907 2025-09-07T06:39:15.3338612Z * [new tag] ciflow/inductor/161914 -> ciflow/inductor/161914 2025-09-07T06:39:15.3338677Z * [new tag] ciflow/inductor/161924 -> ciflow/inductor/161924 2025-09-07T06:39:15.3338744Z * [new tag] ciflow/inductor/161936 -> ciflow/inductor/161936 2025-09-07T06:39:15.3338810Z * [new tag] ciflow/inductor/161938 -> ciflow/inductor/161938 2025-09-07T06:39:15.3338875Z * [new tag] ciflow/inductor/161939 -> ciflow/inductor/161939 2025-09-07T06:39:15.3339924Z * [new tag] ciflow/inductor/161940 -> ciflow/inductor/161940 2025-09-07T06:39:15.3339993Z * [new tag] ciflow/inductor/161955 -> ciflow/inductor/161955 2025-09-07T06:39:15.3340058Z * [new tag] ciflow/inductor/161957 -> ciflow/inductor/161957 2025-09-07T06:39:15.3340124Z * [new tag] ciflow/inductor/161975 -> ciflow/inductor/161975 2025-09-07T06:39:15.3340195Z * [new tag] ciflow/inductor/161977 -> ciflow/inductor/161977 2025-09-07T06:39:15.3340260Z * [new tag] ciflow/inductor/161978 -> ciflow/inductor/161978 2025-09-07T06:39:15.3340327Z * [new tag] ciflow/inductor/161979 -> ciflow/inductor/161979 2025-09-07T06:39:15.3340393Z * [new tag] ciflow/inductor/161980 -> ciflow/inductor/161980 2025-09-07T06:39:15.3340459Z * [new tag] ciflow/inductor/161988 -> ciflow/inductor/161988 2025-09-07T06:39:15.3340524Z * [new tag] ciflow/inductor/161994 -> ciflow/inductor/161994 2025-09-07T06:39:15.3340591Z * [new tag] ciflow/inductor/162013 -> ciflow/inductor/162013 2025-09-07T06:39:15.3340656Z * [new tag] ciflow/inductor/162014 -> ciflow/inductor/162014 2025-09-07T06:39:15.3340721Z * [new tag] ciflow/inductor/162017 -> ciflow/inductor/162017 2025-09-07T06:39:15.3340789Z * [new tag] ciflow/inductor/162021 -> ciflow/inductor/162021 2025-09-07T06:39:15.3340854Z * [new tag] ciflow/inductor/162023 -> ciflow/inductor/162023 2025-09-07T06:39:15.3340921Z * [new tag] ciflow/inductor/162027 -> ciflow/inductor/162027 2025-09-07T06:39:15.3341028Z * [new tag] ciflow/inductor/162029 -> ciflow/inductor/162029 2025-09-07T06:39:15.3341093Z * [new tag] ciflow/inductor/162030 -> ciflow/inductor/162030 2025-09-07T06:39:15.3341159Z * [new tag] ciflow/inductor/162031 -> ciflow/inductor/162031 2025-09-07T06:39:15.3341225Z * [new tag] ciflow/inductor/162033 -> ciflow/inductor/162033 2025-09-07T06:39:15.3341291Z * [new tag] ciflow/inductor/162052 -> ciflow/inductor/162052 2025-09-07T06:39:15.3341356Z * [new tag] ciflow/inductor/162053 -> ciflow/inductor/162053 2025-09-07T06:39:15.3341458Z * [new tag] ciflow/inductor/162056 -> ciflow/inductor/162056 2025-09-07T06:39:15.3341524Z * [new tag] ciflow/inductor/162063 -> ciflow/inductor/162063 2025-09-07T06:39:15.3342563Z * [new tag] ciflow/inductor/162066 -> ciflow/inductor/162066 2025-09-07T06:39:15.3342636Z * [new tag] ciflow/inductor/162068 -> ciflow/inductor/162068 2025-09-07T06:39:15.3342702Z * [new tag] ciflow/inductor/162081 -> ciflow/inductor/162081 2025-09-07T06:39:15.3342768Z * [new tag] ciflow/inductor/162088 -> ciflow/inductor/162088 2025-09-07T06:39:15.3342836Z * [new tag] ciflow/inductor/162089 -> ciflow/inductor/162089 2025-09-07T06:39:15.3342903Z * [new tag] ciflow/inductor/162094 -> ciflow/inductor/162094 2025-09-07T06:39:15.3342968Z * [new tag] ciflow/inductor/162098 -> ciflow/inductor/162098 2025-09-07T06:39:15.3343039Z * [new tag] ciflow/inductor/162101 -> ciflow/inductor/162101 2025-09-07T06:39:15.3343179Z * [new tag] ciflow/inductor/162102 -> ciflow/inductor/162102 2025-09-07T06:39:15.3343246Z * [new tag] ciflow/inductor/162104 -> ciflow/inductor/162104 2025-09-07T06:39:15.3343314Z * [new tag] ciflow/inductor/162106 -> ciflow/inductor/162106 2025-09-07T06:39:15.3343381Z * [new tag] ciflow/inductor/162108 -> ciflow/inductor/162108 2025-09-07T06:39:15.3343447Z * [new tag] ciflow/inductor/162126 -> ciflow/inductor/162126 2025-09-07T06:39:15.3343512Z * [new tag] ciflow/inductor/162149 -> ciflow/inductor/162149 2025-09-07T06:39:15.3343578Z * [new tag] ciflow/inductor/162164 -> ciflow/inductor/162164 2025-09-07T06:39:15.3343644Z * [new tag] ciflow/inductor/162166 -> ciflow/inductor/162166 2025-09-07T06:39:15.3343713Z * [new tag] ciflow/inductor/162169 -> ciflow/inductor/162169 2025-09-07T06:39:15.3343779Z * [new tag] ciflow/inductor/162170 -> ciflow/inductor/162170 2025-09-07T06:39:15.3343844Z * [new tag] ciflow/inductor/162171 -> ciflow/inductor/162171 2025-09-07T06:39:15.3343912Z * [new tag] ciflow/inductor/162183 -> ciflow/inductor/162183 2025-09-07T06:39:15.3343978Z * [new tag] ciflow/inductor/162189 -> ciflow/inductor/162189 2025-09-07T06:39:15.3344043Z * [new tag] ciflow/inductor/162190 -> ciflow/inductor/162190 2025-09-07T06:39:15.3344108Z * [new tag] ciflow/inductor/162191 -> ciflow/inductor/162191 2025-09-07T06:39:15.3344175Z * [new tag] ciflow/inductor/162194 -> ciflow/inductor/162194 2025-09-07T06:39:15.3345216Z * [new tag] ciflow/inductor/162200 -> ciflow/inductor/162200 2025-09-07T06:39:15.3345285Z * [new tag] ciflow/inductor/162201 -> ciflow/inductor/162201 2025-09-07T06:39:15.3345354Z * [new tag] ciflow/inductor/162208 -> ciflow/inductor/162208 2025-09-07T06:39:15.3345420Z * [new tag] ciflow/inductor/162211 -> ciflow/inductor/162211 2025-09-07T06:39:15.3345681Z * [new tag] ciflow/inductor/162216 -> ciflow/inductor/162216 2025-09-07T06:39:15.3345749Z * [new tag] ciflow/inductor/162220 -> ciflow/inductor/162220 2025-09-07T06:39:15.3345814Z * [new tag] ciflow/inductor/162222 -> ciflow/inductor/162222 2025-09-07T06:39:15.3345880Z * [new tag] ciflow/inductor/162227 -> ciflow/inductor/162227 2025-09-07T06:39:15.3345944Z * [new tag] ciflow/inductor/162238 -> ciflow/inductor/162238 2025-09-07T06:39:15.3346011Z * [new tag] ciflow/inductor/162239 -> ciflow/inductor/162239 2025-09-07T06:39:15.3346076Z * [new tag] ciflow/inductor/162240 -> ciflow/inductor/162240 2025-09-07T06:39:15.3346205Z * [new tag] ciflow/inductor/162244 -> ciflow/inductor/162244 2025-09-07T06:39:15.3346271Z * [new tag] ciflow/inductor/162245 -> ciflow/inductor/162245 2025-09-07T06:39:15.3346338Z * [new tag] ciflow/inductor/162262 -> ciflow/inductor/162262 2025-09-07T06:39:15.3346403Z * [new tag] ciflow/inductor/162275 -> ciflow/inductor/162275 2025-09-07T06:39:15.3346469Z * [new tag] ciflow/inductor/162278 -> ciflow/inductor/162278 2025-09-07T06:39:15.3346535Z * [new tag] ciflow/inductor/162284 -> ciflow/inductor/162284 2025-09-07T06:39:15.3346600Z * [new tag] ciflow/inductor/162286 -> ciflow/inductor/162286 2025-09-07T06:39:15.3346666Z * [new tag] ciflow/inductor/162288 -> ciflow/inductor/162288 2025-09-07T06:39:15.3346732Z * [new tag] ciflow/inductor/162293 -> ciflow/inductor/162293 2025-09-07T06:39:15.3346800Z * [new tag] ciflow/inductor/162294 -> ciflow/inductor/162294 2025-09-07T06:39:15.3346866Z * [new tag] ciflow/inductor/162295 -> ciflow/inductor/162295 2025-09-07T06:39:15.3346933Z * [new tag] ciflow/inductor/162296 -> ciflow/inductor/162296 2025-09-07T06:39:15.3346998Z * [new tag] ciflow/inductor/162298 -> ciflow/inductor/162298 2025-09-07T06:39:15.3348047Z * [new tag] ciflow/inductor/162307 -> ciflow/inductor/162307 2025-09-07T06:39:15.3348117Z * [new tag] ciflow/inductor/162309 -> ciflow/inductor/162309 2025-09-07T06:39:15.3348183Z * [new tag] ciflow/inductor/162311 -> ciflow/inductor/162311 2025-09-07T06:39:15.3348249Z * [new tag] ciflow/inductor/162312 -> ciflow/inductor/162312 2025-09-07T06:39:15.3348314Z * [new tag] ciflow/inductor/162315 -> ciflow/inductor/162315 2025-09-07T06:39:15.3348386Z * [new tag] ciflow/inductor/162316 -> ciflow/inductor/162316 2025-09-07T06:39:15.3348453Z * [new tag] ciflow/inductor/162318 -> ciflow/inductor/162318 2025-09-07T06:39:15.3348518Z * [new tag] ciflow/inductor/162323 -> ciflow/inductor/162323 2025-09-07T06:39:15.3348587Z * [new tag] ciflow/inductor/162341 -> ciflow/inductor/162341 2025-09-07T06:39:15.3348653Z * [new tag] ciflow/inductor/162345 -> ciflow/inductor/162345 2025-09-07T06:39:15.3348725Z * [new tag] ciflow/inductor/3b9a386 -> ciflow/inductor/3b9a386 2025-09-07T06:39:15.3348794Z * [new tag] ciflow/inductor/3d4b92b -> ciflow/inductor/3d4b92b 2025-09-07T06:39:15.3348863Z * [new tag] ciflow/inductor/d224ac7 -> ciflow/inductor/d224ac7 2025-09-07T06:39:15.3348940Z * [new tag] ciflow/linux-aarch64/157994 -> ciflow/linux-aarch64/157994 2025-09-07T06:39:15.3349015Z * [new tag] ciflow/linux-aarch64/159737 -> ciflow/linux-aarch64/159737 2025-09-07T06:39:15.3349088Z * [new tag] ciflow/linux-aarch64/160078 -> ciflow/linux-aarch64/160078 2025-09-07T06:39:15.3349152Z * [new tag] ciflow/mps/157553 -> ciflow/mps/157553 2025-09-07T06:39:15.3349254Z * [new tag] ciflow/mps/157635 -> ciflow/mps/157635 2025-09-07T06:39:15.3349315Z * [new tag] ciflow/mps/161988 -> ciflow/mps/161988 2025-09-07T06:39:15.3349376Z * [new tag] ciflow/mps/162108 -> ciflow/mps/162108 2025-09-07T06:39:15.3349435Z * [new tag] ciflow/mps/162153 -> ciflow/mps/162153 2025-09-07T06:39:15.3349494Z * [new tag] ciflow/mps/162281 -> ciflow/mps/162281 2025-09-07T06:39:15.3349563Z * [new tag] ciflow/nightly/156049 -> ciflow/nightly/156049 2025-09-07T06:39:15.3349665Z * [new tag] ciflow/nightly/158104 -> ciflow/nightly/158104 2025-09-07T06:39:15.3349740Z * [new tag] ciflow/op-benchmark/157994 -> ciflow/op-benchmark/157994 2025-09-07T06:39:15.3350823Z * [new tag] ciflow/periodic-rocm-mi300/161529 -> ciflow/periodic-rocm-mi300/161529 2025-09-07T06:39:15.3350924Z * [new tag] ciflow/periodic-rocm-mi300/161715 -> ciflow/periodic-rocm-mi300/161715 2025-09-07T06:39:15.3350996Z * [new tag] ciflow/periodic/054a2fd -> ciflow/periodic/054a2fd 2025-09-07T06:39:15.3351065Z * [new tag] ciflow/periodic/156703 -> ciflow/periodic/156703 2025-09-07T06:39:15.3351131Z * [new tag] ciflow/periodic/161715 -> ciflow/periodic/161715 2025-09-07T06:39:15.3351197Z * [new tag] ciflow/periodic/162021 -> ciflow/periodic/162021 2025-09-07T06:39:15.3351263Z * [new tag] ciflow/periodic/162323 -> ciflow/periodic/162323 2025-09-07T06:39:15.3351337Z * [new tag] ciflow/periodic/2a6d37d -> ciflow/periodic/2a6d37d 2025-09-07T06:39:15.3351404Z * [new tag] ciflow/periodic/317eeb8 -> ciflow/periodic/317eeb8 2025-09-07T06:39:15.3351472Z * [new tag] ciflow/periodic/3c32 -> ciflow/periodic/3c32 2025-09-07T06:39:15.3351541Z * [new tag] ciflow/periodic/3e98831 -> ciflow/periodic/3e98831 2025-09-07T06:39:15.3351618Z * [new tag] ciflow/periodic/94512-point -> ciflow/periodic/94512-point 2025-09-07T06:39:15.3351701Z * [new tag] ciflow/periodic/csl/test87519 -> ciflow/periodic/csl/test87519 2025-09-07T06:39:15.3351783Z * [new tag] ciflow/periodic/csltest88275 -> ciflow/periodic/csltest88275 2025-09-07T06:39:15.3351862Z * [new tag] ciflow/periodic/csltest88761 -> ciflow/periodic/csltest88761 2025-09-07T06:39:15.3351939Z * [new tag] ciflow/periodic/release_1.12 -> ciflow/periodic/release_1.12 2025-09-07T06:39:15.3352028Z * [new tag] ciflow/periodic/release_1.12.0 -> ciflow/periodic/release_1.12.0 2025-09-07T06:39:15.3352104Z * [new tag] ciflow/periodic/sha-ec5b83 -> ciflow/periodic/sha-ec5b83 2025-09-07T06:39:15.3352175Z * [new tag] ciflow/rocm-mi300/154170 -> ciflow/rocm-mi300/154170 2025-09-07T06:39:15.3352245Z * [new tag] ciflow/rocm-mi300/158747 -> ciflow/rocm-mi300/158747 2025-09-07T06:39:15.3352312Z * [new tag] ciflow/rocm-mi300/159146 -> ciflow/rocm-mi300/159146 2025-09-07T06:39:15.3352378Z * [new tag] ciflow/rocm-mi300/159158 -> ciflow/rocm-mi300/159158 2025-09-07T06:39:15.3352444Z * [new tag] ciflow/rocm-mi300/161715 -> ciflow/rocm-mi300/161715 2025-09-07T06:39:15.3352510Z * [new tag] ciflow/rocm-mi300/161957 -> ciflow/rocm-mi300/161957 2025-09-07T06:39:15.3353633Z * [new tag] ciflow/rocm-mi300/162053 -> ciflow/rocm-mi300/162053 2025-09-07T06:39:15.3353711Z * [new tag] ciflow/rocm-mi300/162056 -> ciflow/rocm-mi300/162056 2025-09-07T06:39:15.3353777Z * [new tag] ciflow/rocm-mi300/162112 -> ciflow/rocm-mi300/162112 2025-09-07T06:39:15.3353905Z * [new tag] ciflow/rocm-mi300/162245 -> ciflow/rocm-mi300/162245 2025-09-07T06:39:15.3353973Z * [new tag] ciflow/rocm-mi300/162278 -> ciflow/rocm-mi300/162278 2025-09-07T06:39:15.3354039Z * [new tag] ciflow/rocm-mi300/162288 -> ciflow/rocm-mi300/162288 2025-09-07T06:39:15.3354105Z * [new tag] ciflow/rocm-mi355/162053 -> ciflow/rocm-mi355/162053 2025-09-07T06:39:15.3354171Z * [new tag] ciflow/rocm-mi355/162056 -> ciflow/rocm-mi355/162056 2025-09-07T06:39:15.3354233Z * [new tag] ciflow/rocm/148492 -> ciflow/rocm/148492 2025-09-07T06:39:15.3354294Z * [new tag] ciflow/rocm/154170 -> ciflow/rocm/154170 2025-09-07T06:39:15.3354407Z * [new tag] ciflow/rocm/156491 -> ciflow/rocm/156491 2025-09-07T06:39:15.3354468Z * [new tag] ciflow/rocm/156592 -> ciflow/rocm/156592 2025-09-07T06:39:15.3354527Z * [new tag] ciflow/rocm/158747 -> ciflow/rocm/158747 2025-09-07T06:39:15.3354589Z * [new tag] ciflow/rocm/159146 -> ciflow/rocm/159146 2025-09-07T06:39:15.3354648Z * [new tag] ciflow/rocm/159158 -> ciflow/rocm/159158 2025-09-07T06:39:15.3354707Z * [new tag] ciflow/rocm/161715 -> ciflow/rocm/161715 2025-09-07T06:39:15.3354767Z * [new tag] ciflow/rocm/161972 -> ciflow/rocm/161972 2025-09-07T06:39:15.3354826Z * [new tag] ciflow/rocm/162052 -> ciflow/rocm/162052 2025-09-07T06:39:15.3354884Z * [new tag] ciflow/rocm/162053 -> ciflow/rocm/162053 2025-09-07T06:39:15.3354943Z * [new tag] ciflow/rocm/162056 -> ciflow/rocm/162056 2025-09-07T06:39:15.3355005Z * [new tag] ciflow/rocm/162112 -> ciflow/rocm/162112 2025-09-07T06:39:15.3355064Z * [new tag] ciflow/rocm/162278 -> ciflow/rocm/162278 2025-09-07T06:39:15.3355124Z * [new tag] ciflow/rocm/162288 -> ciflow/rocm/162288 2025-09-07T06:39:15.3355184Z * [new tag] ciflow/rocm/162305 -> ciflow/rocm/162305 2025-09-07T06:39:15.3356236Z * [new tag] ciflow/slow/01c7106 -> ciflow/slow/01c7106 2025-09-07T06:39:15.3356302Z * [new tag] ciflow/slow/0577043 -> ciflow/slow/0577043 2025-09-07T06:39:15.3356490Z * [new tag] ciflow/slow/0d5b74da0cab798fbfdb9caa53fad816999c8386-sdym -> ciflow/slow/0d5b74da0cab798fbfdb9caa53fad816999c8386-sdym 2025-09-07T06:39:15.3356552Z * [new tag] ciflow/slow/0e81104 -> ciflow/slow/0e81104 2025-09-07T06:39:15.3356619Z * [new tag] ciflow/slow/161395 -> ciflow/slow/161395 2025-09-07T06:39:15.3356681Z * [new tag] ciflow/slow/1732077 -> ciflow/slow/1732077 2025-09-07T06:39:15.3356742Z * [new tag] ciflow/slow/187eb7c -> ciflow/slow/187eb7c 2025-09-07T06:39:15.3356807Z * [new tag] ciflow/slow/1faef89 -> ciflow/slow/1faef89 2025-09-07T06:39:15.3356868Z * [new tag] ciflow/slow/3920ec1 -> ciflow/slow/3920ec1 2025-09-07T06:39:15.3356929Z * [new tag] ciflow/slow/3b7c6b2 -> ciflow/slow/3b7c6b2 2025-09-07T06:39:15.3356990Z * [new tag] ciflow/slow/59a3759 -> ciflow/slow/59a3759 2025-09-07T06:39:15.3357053Z * [new tag] ciflow/slow/70ef0bb -> ciflow/slow/70ef0bb 2025-09-07T06:39:15.3357113Z * [new tag] ciflow/slow/788ff06 -> ciflow/slow/788ff06 2025-09-07T06:39:15.3357280Z * [new tag] ciflow/slow/8751002215790a3a88750faa8f4366933e296693-sdym -> ciflow/slow/8751002215790a3a88750faa8f4366933e296693-sdym 2025-09-07T06:39:15.3357344Z * [new tag] ciflow/slow/9d85864 -> ciflow/slow/9d85864 2025-09-07T06:39:15.3357405Z * [new tag] ciflow/slow/9ffad5b -> ciflow/slow/9ffad5b 2025-09-07T06:39:15.3357507Z * [new tag] ciflow/slow/a206e8b -> ciflow/slow/a206e8b 2025-09-07T06:39:15.3357569Z * [new tag] ciflow/slow/a837609 -> ciflow/slow/a837609 2025-09-07T06:39:15.3357630Z * [new tag] ciflow/slow/af841f3 -> ciflow/slow/af841f3 2025-09-07T06:39:15.3357805Z * [new tag] ciflow/slow/da3aba1e46157c4df504b067477cdf2b3c96b194-sdym -> ciflow/slow/da3aba1e46157c4df504b067477cdf2b3c96b194-sdym 2025-09-07T06:39:15.3357888Z * [new tag] ciflow/triton_binaries/162329 -> ciflow/triton_binaries/162329 2025-09-07T06:39:15.3357951Z * [new tag] ciflow/trunk/113258 -> ciflow/trunk/113258 2025-09-07T06:39:15.3358059Z * [new tag] ciflow/trunk/137400 -> ciflow/trunk/137400 2025-09-07T06:39:15.3358120Z * [new tag] ciflow/trunk/148180 -> ciflow/trunk/148180 2025-09-07T06:39:15.3359168Z * [new tag] ciflow/trunk/148328 -> ciflow/trunk/148328 2025-09-07T06:39:15.3359233Z * [new tag] ciflow/trunk/148492 -> ciflow/trunk/148492 2025-09-07T06:39:15.3359294Z * [new tag] ciflow/trunk/148919 -> ciflow/trunk/148919 2025-09-07T06:39:15.3359354Z * [new tag] ciflow/trunk/152624 -> ciflow/trunk/152624 2025-09-07T06:39:15.3359414Z * [new tag] ciflow/trunk/154170 -> ciflow/trunk/154170 2025-09-07T06:39:15.3359474Z * [new tag] ciflow/trunk/154694 -> ciflow/trunk/154694 2025-09-07T06:39:15.3359535Z * [new tag] ciflow/trunk/156049 -> ciflow/trunk/156049 2025-09-07T06:39:15.3359599Z * [new tag] ciflow/trunk/156703 -> ciflow/trunk/156703 2025-09-07T06:39:15.3359659Z * [new tag] ciflow/trunk/156711 -> ciflow/trunk/156711 2025-09-07T06:39:15.3359720Z * [new tag] ciflow/trunk/157432 -> ciflow/trunk/157432 2025-09-07T06:39:15.3359782Z * [new tag] ciflow/trunk/157685 -> ciflow/trunk/157685 2025-09-07T06:39:15.3359842Z * [new tag] ciflow/trunk/157689 -> ciflow/trunk/157689 2025-09-07T06:39:15.3359903Z * [new tag] ciflow/trunk/157699 -> ciflow/trunk/157699 2025-09-07T06:39:15.3359962Z * [new tag] ciflow/trunk/157813 -> ciflow/trunk/157813 2025-09-07T06:39:15.3360022Z * [new tag] ciflow/trunk/157994 -> ciflow/trunk/157994 2025-09-07T06:39:15.3360083Z * [new tag] ciflow/trunk/158091 -> ciflow/trunk/158091 2025-09-07T06:39:15.3360143Z * [new tag] ciflow/trunk/158104 -> ciflow/trunk/158104 2025-09-07T06:39:15.3360205Z * [new tag] ciflow/trunk/158404 -> ciflow/trunk/158404 2025-09-07T06:39:15.3360265Z * [new tag] ciflow/trunk/158647 -> ciflow/trunk/158647 2025-09-07T06:39:15.3360327Z * [new tag] ciflow/trunk/158846 -> ciflow/trunk/158846 2025-09-07T06:39:15.3360387Z * [new tag] ciflow/trunk/159158 -> ciflow/trunk/159158 2025-09-07T06:39:15.3360446Z * [new tag] ciflow/trunk/159682 -> ciflow/trunk/159682 2025-09-07T06:39:15.3360507Z * [new tag] ciflow/trunk/159835 -> ciflow/trunk/159835 2025-09-07T06:39:15.3360566Z * [new tag] ciflow/trunk/160161 -> ciflow/trunk/160161 2025-09-07T06:39:15.3361601Z * [new tag] ciflow/trunk/160236 -> ciflow/trunk/160236 2025-09-07T06:39:15.3361666Z * [new tag] ciflow/trunk/160329 -> ciflow/trunk/160329 2025-09-07T06:39:15.3361728Z * [new tag] ciflow/trunk/160480 -> ciflow/trunk/160480 2025-09-07T06:39:15.3361788Z * [new tag] ciflow/trunk/160532 -> ciflow/trunk/160532 2025-09-07T06:39:15.3361848Z * [new tag] ciflow/trunk/160836 -> ciflow/trunk/160836 2025-09-07T06:39:15.3361947Z * [new tag] ciflow/trunk/160843 -> ciflow/trunk/160843 2025-09-07T06:39:15.3362008Z * [new tag] ciflow/trunk/160869 -> ciflow/trunk/160869 2025-09-07T06:39:15.3362069Z * [new tag] ciflow/trunk/160940 -> ciflow/trunk/160940 2025-09-07T06:39:15.3362128Z * [new tag] ciflow/trunk/160943 -> ciflow/trunk/160943 2025-09-07T06:39:15.3362188Z * [new tag] ciflow/trunk/160953 -> ciflow/trunk/160953 2025-09-07T06:39:15.3362249Z * [new tag] ciflow/trunk/161035 -> ciflow/trunk/161035 2025-09-07T06:39:15.3362345Z * [new tag] ciflow/trunk/161178 -> ciflow/trunk/161178 2025-09-07T06:39:15.3362405Z * [new tag] ciflow/trunk/161349 -> ciflow/trunk/161349 2025-09-07T06:39:15.3362466Z * [new tag] ciflow/trunk/161350 -> ciflow/trunk/161350 2025-09-07T06:39:15.3362528Z * [new tag] ciflow/trunk/161351 -> ciflow/trunk/161351 2025-09-07T06:39:15.3362588Z * [new tag] ciflow/trunk/161395 -> ciflow/trunk/161395 2025-09-07T06:39:15.3362649Z * [new tag] ciflow/trunk/161405 -> ciflow/trunk/161405 2025-09-07T06:39:15.3362708Z * [new tag] ciflow/trunk/161406 -> ciflow/trunk/161406 2025-09-07T06:39:15.3362768Z * [new tag] ciflow/trunk/161410 -> ciflow/trunk/161410 2025-09-07T06:39:15.3362828Z * [new tag] ciflow/trunk/161468 -> ciflow/trunk/161468 2025-09-07T06:39:15.3362889Z * [new tag] ciflow/trunk/161499 -> ciflow/trunk/161499 2025-09-07T06:39:15.3362950Z * [new tag] ciflow/trunk/161527 -> ciflow/trunk/161527 2025-09-07T06:39:15.3363010Z * [new tag] ciflow/trunk/161534 -> ciflow/trunk/161534 2025-09-07T06:39:15.3363135Z * [new tag] ciflow/trunk/161591 -> ciflow/trunk/161591 2025-09-07T06:39:15.3363197Z * [new tag] ciflow/trunk/161595 -> ciflow/trunk/161595 2025-09-07T06:39:15.3364248Z * [new tag] ciflow/trunk/161596 -> ciflow/trunk/161596 2025-09-07T06:39:15.3364311Z * [new tag] ciflow/trunk/161633 -> ciflow/trunk/161633 2025-09-07T06:39:15.3364372Z * [new tag] ciflow/trunk/161634 -> ciflow/trunk/161634 2025-09-07T06:39:15.3364432Z * [new tag] ciflow/trunk/161635 -> ciflow/trunk/161635 2025-09-07T06:39:15.3364492Z * [new tag] ciflow/trunk/161667 -> ciflow/trunk/161667 2025-09-07T06:39:15.3364557Z * [new tag] ciflow/trunk/161670 -> ciflow/trunk/161670 2025-09-07T06:39:15.3364616Z * [new tag] ciflow/trunk/161692 -> ciflow/trunk/161692 2025-09-07T06:39:15.3364678Z * [new tag] ciflow/trunk/161693 -> ciflow/trunk/161693 2025-09-07T06:39:15.3364740Z * [new tag] ciflow/trunk/161695 -> ciflow/trunk/161695 2025-09-07T06:39:15.3364800Z * [new tag] ciflow/trunk/161730 -> ciflow/trunk/161730 2025-09-07T06:39:15.3364860Z * [new tag] ciflow/trunk/161744 -> ciflow/trunk/161744 2025-09-07T06:39:15.3364920Z * [new tag] ciflow/trunk/161749 -> ciflow/trunk/161749 2025-09-07T06:39:15.3364980Z * [new tag] ciflow/trunk/161881 -> ciflow/trunk/161881 2025-09-07T06:39:15.3365041Z * [new tag] ciflow/trunk/161924 -> ciflow/trunk/161924 2025-09-07T06:39:15.3365101Z * [new tag] ciflow/trunk/161926 -> ciflow/trunk/161926 2025-09-07T06:39:15.3365163Z * [new tag] ciflow/trunk/161936 -> ciflow/trunk/161936 2025-09-07T06:39:15.3365224Z * [new tag] ciflow/trunk/161952 -> ciflow/trunk/161952 2025-09-07T06:39:15.3365348Z * [new tag] ciflow/trunk/161955 -> ciflow/trunk/161955 2025-09-07T06:39:15.3365408Z * [new tag] ciflow/trunk/161957 -> ciflow/trunk/161957 2025-09-07T06:39:15.3365469Z * [new tag] ciflow/trunk/161959 -> ciflow/trunk/161959 2025-09-07T06:39:15.3365530Z * [new tag] ciflow/trunk/161977 -> ciflow/trunk/161977 2025-09-07T06:39:15.3365590Z * [new tag] ciflow/trunk/161988 -> ciflow/trunk/161988 2025-09-07T06:39:15.3365650Z * [new tag] ciflow/trunk/161994 -> ciflow/trunk/161994 2025-09-07T06:39:15.3365710Z * [new tag] ciflow/trunk/162007 -> ciflow/trunk/162007 2025-09-07T06:39:15.3366826Z * [new tag] ciflow/trunk/162013 -> ciflow/trunk/162013 2025-09-07T06:39:15.3366890Z * [new tag] ciflow/trunk/162017 -> ciflow/trunk/162017 2025-09-07T06:39:15.3366955Z * [new tag] ciflow/trunk/162021 -> ciflow/trunk/162021 2025-09-07T06:39:15.3367015Z * [new tag] ciflow/trunk/162022 -> ciflow/trunk/162022 2025-09-07T06:39:15.3367074Z * [new tag] ciflow/trunk/162040 -> ciflow/trunk/162040 2025-09-07T06:39:15.3367135Z * [new tag] ciflow/trunk/162041 -> ciflow/trunk/162041 2025-09-07T06:39:15.3367195Z * [new tag] ciflow/trunk/162062 -> ciflow/trunk/162062 2025-09-07T06:39:15.3367254Z * [new tag] ciflow/trunk/162066 -> ciflow/trunk/162066 2025-09-07T06:39:15.3367315Z * [new tag] ciflow/trunk/162089 -> ciflow/trunk/162089 2025-09-07T06:39:15.3367381Z * [new tag] ciflow/trunk/162099 -> ciflow/trunk/162099 2025-09-07T06:39:15.3367440Z * [new tag] ciflow/trunk/162104 -> ciflow/trunk/162104 2025-09-07T06:39:15.3367500Z * [new tag] ciflow/trunk/162106 -> ciflow/trunk/162106 2025-09-07T06:39:15.3367562Z * [new tag] ciflow/trunk/162112 -> ciflow/trunk/162112 2025-09-07T06:39:15.3367622Z * [new tag] ciflow/trunk/162119 -> ciflow/trunk/162119 2025-09-07T06:39:15.3367683Z * [new tag] ciflow/trunk/162142 -> ciflow/trunk/162142 2025-09-07T06:39:15.3367742Z * [new tag] ciflow/trunk/162169 -> ciflow/trunk/162169 2025-09-07T06:39:15.3367802Z * [new tag] ciflow/trunk/162183 -> ciflow/trunk/162183 2025-09-07T06:39:15.3367862Z * [new tag] ciflow/trunk/162190 -> ciflow/trunk/162190 2025-09-07T06:39:15.3367923Z * [new tag] ciflow/trunk/162194 -> ciflow/trunk/162194 2025-09-07T06:39:15.3367986Z * [new tag] ciflow/trunk/162200 -> ciflow/trunk/162200 2025-09-07T06:39:15.3368046Z * [new tag] ciflow/trunk/162206 -> ciflow/trunk/162206 2025-09-07T06:39:15.3368108Z * [new tag] ciflow/trunk/162208 -> ciflow/trunk/162208 2025-09-07T06:39:15.3368168Z * [new tag] ciflow/trunk/162222 -> ciflow/trunk/162222 2025-09-07T06:39:15.3368227Z * [new tag] ciflow/trunk/162238 -> ciflow/trunk/162238 2025-09-07T06:39:15.3369328Z * [new tag] ciflow/trunk/162244 -> ciflow/trunk/162244 2025-09-07T06:39:15.3369392Z * [new tag] ciflow/trunk/162267 -> ciflow/trunk/162267 2025-09-07T06:39:15.3369453Z * [new tag] ciflow/trunk/162269 -> ciflow/trunk/162269 2025-09-07T06:39:15.3369514Z * [new tag] ciflow/trunk/162278 -> ciflow/trunk/162278 2025-09-07T06:39:15.3369579Z * [new tag] ciflow/trunk/162286 -> ciflow/trunk/162286 2025-09-07T06:39:15.3369638Z * [new tag] ciflow/trunk/162288 -> ciflow/trunk/162288 2025-09-07T06:39:15.3369700Z * [new tag] ciflow/trunk/162293 -> ciflow/trunk/162293 2025-09-07T06:39:15.3369803Z * [new tag] ciflow/trunk/162310 -> ciflow/trunk/162310 2025-09-07T06:39:15.3369864Z * [new tag] ciflow/trunk/162311 -> ciflow/trunk/162311 2025-09-07T06:39:15.3369925Z * [new tag] ciflow/trunk/162315 -> ciflow/trunk/162315 2025-09-07T06:39:15.3369985Z * [new tag] ciflow/trunk/162325 -> ciflow/trunk/162325 2025-09-07T06:39:15.3370044Z * [new tag] ciflow/trunk/162328 -> ciflow/trunk/162328 2025-09-07T06:39:15.3370105Z * [new tag] ciflow/trunk/162329 -> ciflow/trunk/162329 2025-09-07T06:39:15.3370202Z * [new tag] ciflow/unstable/123 -> ciflow/unstable/123 2025-09-07T06:39:15.3370263Z * [new tag] ciflow/vllm/162292 -> ciflow/vllm/162292 2025-09-07T06:39:15.3370334Z * [new tag] ciflow/win-arm64/156049 -> ciflow/win-arm64/156049 2025-09-07T06:39:15.3370403Z * [new tag] ciflow/win-arm64/158104 -> ciflow/win-arm64/158104 2025-09-07T06:39:15.3370465Z * [new tag] ciflow/xpu/157699 -> ciflow/xpu/157699 2025-09-07T06:39:15.3370526Z * [new tag] ciflow/xpu/157994 -> ciflow/xpu/157994 2025-09-07T06:39:15.3370587Z * [new tag] ciflow/xpu/159459 -> ciflow/xpu/159459 2025-09-07T06:39:15.3370646Z * [new tag] ciflow/xpu/159718 -> ciflow/xpu/159718 2025-09-07T06:39:15.3370706Z * [new tag] ciflow/xpu/159944 -> ciflow/xpu/159944 2025-09-07T06:39:15.3370766Z * [new tag] ciflow/xpu/160867 -> ciflow/xpu/160867 2025-09-07T06:39:15.3370827Z * [new tag] ciflow/xpu/160938 -> ciflow/xpu/160938 2025-09-07T06:39:15.3370885Z * [new tag] ciflow/xpu/160940 -> ciflow/xpu/160940 2025-09-07T06:39:15.3371903Z * [new tag] ciflow/xpu/160953 -> ciflow/xpu/160953 2025-09-07T06:39:15.3371965Z * [new tag] ciflow/xpu/161045 -> ciflow/xpu/161045 2025-09-07T06:39:15.3372024Z * [new tag] ciflow/xpu/161058 -> ciflow/xpu/161058 2025-09-07T06:39:15.3372083Z * [new tag] ciflow/xpu/161246 -> ciflow/xpu/161246 2025-09-07T06:39:15.3372142Z * [new tag] ciflow/xpu/161397 -> ciflow/xpu/161397 2025-09-07T06:39:15.3372201Z * [new tag] ciflow/xpu/161485 -> ciflow/xpu/161485 2025-09-07T06:39:15.3372260Z * [new tag] ciflow/xpu/161988 -> ciflow/xpu/161988 2025-09-07T06:39:15.3372324Z * [new tag] ciflow/xpu/162062 -> ciflow/xpu/162062 2025-09-07T06:39:15.3372384Z * [new tag] cslpull75 -> cslpull75 2025-09-07T06:39:15.3372441Z * [new tag] cslpull76 -> cslpull76 2025-09-07T06:39:15.3372497Z * [new tag] cslpull77 -> cslpull77 2025-09-07T06:39:15.3372550Z * [new tag] cslpull78 -> cslpull78 2025-09-07T06:39:15.3372604Z * [new tag] cslpull79 -> cslpull79 2025-09-07T06:39:15.3372656Z * [new tag] cslpull80 -> cslpull80 2025-09-07T06:39:15.3372709Z * [new tag] cslpull81 -> cslpull81 2025-09-07T06:39:15.3372761Z * [new tag] cslpull82 -> cslpull82 2025-09-07T06:39:15.3372814Z * [new tag] cslpull83 -> cslpull83 2025-09-07T06:39:15.3372866Z * [new tag] cslpull84 -> cslpull84 2025-09-07T06:39:15.3372920Z * [new tag] cslpull85 -> cslpull85 2025-09-07T06:39:15.3372973Z * [new tag] cslpull86 -> cslpull86 2025-09-07T06:39:15.3373026Z * [new tag] cslpull87 -> cslpull87 2025-09-07T06:39:15.3373205Z * [new tag] cslpull88 -> cslpull88 2025-09-07T06:39:15.3373260Z * [new tag] cslpull89 -> cslpull89 2025-09-07T06:39:15.3373314Z * [new tag] cslpull90 -> cslpull90 2025-09-07T06:39:15.3374365Z * [new tag] cslpull91 -> cslpull91 2025-09-07T06:39:15.3374425Z * [new tag] cslpull92 -> cslpull92 2025-09-07T06:39:15.3374481Z * [new tag] flight_5 -> flight_5 2025-09-07T06:39:15.3374539Z * [new tag] flight_5.1 -> flight_5.1 2025-09-07T06:39:15.3374669Z * [new tag] flight_5.2 -> flight_5.2 2025-09-07T06:39:15.3374723Z * [new tag] flight_5.3 -> flight_5.3 2025-09-07T06:39:15.3374779Z * [new tag] forpull1 -> forpull1 2025-09-07T06:39:15.3374849Z * [new tag] malfet/tag-2ef5611 -> malfet/tag-2ef5611 2025-09-07T06:39:15.3374913Z * [new tag] malfet/tag-317b1a0 -> malfet/tag-317b1a0 2025-09-07T06:39:15.3374976Z * [new tag] malfet/tag-ec6f767 -> malfet/tag-ec6f767 2025-09-07T06:39:15.3375040Z * [new tag] nightly-binary -> nightly-binary 2025-09-07T06:39:15.3375108Z * [new tag] sqzhang_flight4_plus -> sqzhang_flight4_plus 2025-09-07T06:39:15.3375170Z * [new tag] sqzhang_flight_3 -> sqzhang_flight_3 2025-09-07T06:39:15.3375302Z * [new tag] trunk/00636e0171e7e733628c408084805442270cf608 -> trunk/00636e0171e7e733628c408084805442270cf608 2025-09-07T06:39:15.3375439Z * [new tag] trunk/019fed39aa6b2dd8c69347378d53423e5efae8d4 -> trunk/019fed39aa6b2dd8c69347378d53423e5efae8d4 2025-09-07T06:39:15.3375573Z * [new tag] trunk/01ab325cc2e0dc221af4d710974e1b9175066544 -> trunk/01ab325cc2e0dc221af4d710974e1b9175066544 2025-09-07T06:39:15.3375823Z * [new tag] trunk/01edcd4df8bf0c7b4cc2d3ec868bd2059eeea83b -> trunk/01edcd4df8bf0c7b4cc2d3ec868bd2059eeea83b 2025-09-07T06:39:15.3375956Z * [new tag] trunk/040d00af048967dde7938d358d7f5988cbd18388 -> trunk/040d00af048967dde7938d358d7f5988cbd18388 2025-09-07T06:39:15.3376087Z * [new tag] trunk/0447f2d99b4351b2ff129dce6eebb371024f73e5 -> trunk/0447f2d99b4351b2ff129dce6eebb371024f73e5 2025-09-07T06:39:15.3376214Z * [new tag] trunk/047603d35bdc70046216384838d6340feab79bf4 -> trunk/047603d35bdc70046216384838d6340feab79bf4 2025-09-07T06:39:15.3376348Z * [new tag] trunk/06da7c0730b3764f178ec3a90dedf4ffa4202d81 -> trunk/06da7c0730b3764f178ec3a90dedf4ffa4202d81 2025-09-07T06:39:15.3376475Z * [new tag] trunk/081cab045472ce045634548cc6c14a4870641e23 -> trunk/081cab045472ce045634548cc6c14a4870641e23 2025-09-07T06:39:15.3377651Z * [new tag] trunk/09587daf8c9f21f5340f73921ce5f23d1a4a4572 -> trunk/09587daf8c9f21f5340f73921ce5f23d1a4a4572 2025-09-07T06:39:15.3377789Z * [new tag] trunk/09be1890d72cc34fc946965dc4a27736bf0ca8c6 -> trunk/09be1890d72cc34fc946965dc4a27736bf0ca8c6 2025-09-07T06:39:15.3377918Z * [new tag] trunk/09d2f1b6315d6d416fbf452793d65795863ebc66 -> trunk/09d2f1b6315d6d416fbf452793d65795863ebc66 2025-09-07T06:39:15.3378051Z * [new tag] trunk/0af70e2353e1dcda83175fd4834ecb7b63e009e0 -> trunk/0af70e2353e1dcda83175fd4834ecb7b63e009e0 2025-09-07T06:39:15.3378180Z * [new tag] trunk/0c0e056a9e20c17271a6144dd32c0c7e3ba26736 -> trunk/0c0e056a9e20c17271a6144dd32c0c7e3ba26736 2025-09-07T06:39:15.3378319Z * [new tag] trunk/0cd6c56bdfa9178ff61be82ce3b178926ddb64a9 -> trunk/0cd6c56bdfa9178ff61be82ce3b178926ddb64a9 2025-09-07T06:39:15.3378490Z * [new tag] trunk/0d421ace32c1605ee8e452ee1eeb03bd243dd96c -> trunk/0d421ace32c1605ee8e452ee1eeb03bd243dd96c 2025-09-07T06:39:15.3378625Z * [new tag] trunk/0d71a9dd5b4b6d1dde58d91c9b71d96bc6a6a171 -> trunk/0d71a9dd5b4b6d1dde58d91c9b71d96bc6a6a171 2025-09-07T06:39:15.3378754Z * [new tag] trunk/0d84ff3b78f55492d3d4708458c92d776274939e -> trunk/0d84ff3b78f55492d3d4708458c92d776274939e 2025-09-07T06:39:15.3378884Z * [new tag] trunk/0f45aaf4414048b17d720d0915ce221a8de8ec63 -> trunk/0f45aaf4414048b17d720d0915ce221a8de8ec63 2025-09-07T06:39:15.3379020Z * [new tag] trunk/0ff8eabf1387de5acd6712a03bda61f1a3dfa27f -> trunk/0ff8eabf1387de5acd6712a03bda61f1a3dfa27f 2025-09-07T06:39:15.3379149Z * [new tag] trunk/104f2680e03d13a4765ca69f905d8f16fc0c822f -> trunk/104f2680e03d13a4765ca69f905d8f16fc0c822f 2025-09-07T06:39:15.3379312Z * [new tag] trunk/12814701555d3e41dfcdf8f9273af5821e322df0 -> trunk/12814701555d3e41dfcdf8f9273af5821e322df0 2025-09-07T06:39:15.3379442Z * [new tag] trunk/13b65196db422bdb394cb482e208c61ed448898c -> trunk/13b65196db422bdb394cb482e208c61ed448898c 2025-09-07T06:39:15.3379575Z * [new tag] trunk/13d66e2a66eceed14b8a8f5a971087df4f688a46 -> trunk/13d66e2a66eceed14b8a8f5a971087df4f688a46 2025-09-07T06:39:15.3379708Z * [new tag] trunk/145a3a7bda15e3963a33eb1b54bba5d4a270b225 -> trunk/145a3a7bda15e3963a33eb1b54bba5d4a270b225 2025-09-07T06:39:15.3379836Z * [new tag] trunk/146371483318e17929daefd37c8e459d9d6d47bb -> trunk/146371483318e17929daefd37c8e459d9d6d47bb 2025-09-07T06:39:15.3379967Z * [new tag] trunk/15c77a8cfd341e74fd124b077492ef2bfa51b339 -> trunk/15c77a8cfd341e74fd124b077492ef2bfa51b339 2025-09-07T06:39:15.3380102Z * [new tag] trunk/17fa8eec4a1e32939ab4d364ee6e75487a79b654 -> trunk/17fa8eec4a1e32939ab4d364ee6e75487a79b654 2025-09-07T06:39:15.3380231Z * [new tag] trunk/190c391a28845a14df26abb228d26aa813efb20c -> trunk/190c391a28845a14df26abb228d26aa813efb20c 2025-09-07T06:39:15.3380365Z * [new tag] trunk/1a588ace4667bde1331fbd8ed957157dca5cee68 -> trunk/1a588ace4667bde1331fbd8ed957157dca5cee68 2025-09-07T06:39:15.3380498Z * [new tag] trunk/1aa7476885e8f6e7b0ec3a5b6383aad9d3f343e7 -> trunk/1aa7476885e8f6e7b0ec3a5b6383aad9d3f343e7 2025-09-07T06:39:15.3380627Z * [new tag] trunk/1aeb421c342c9e9607842f4c87cb46e8e816ee53 -> trunk/1aeb421c342c9e9607842f4c87cb46e8e816ee53 2025-09-07T06:39:15.3380758Z * [new tag] trunk/1c1b28d5b6a942fafe23b2f09302d93c25226d4a -> trunk/1c1b28d5b6a942fafe23b2f09302d93c25226d4a 2025-09-07T06:39:15.3381906Z * [new tag] trunk/1ebd70d0c0d562d3be9abdee2a21906584af7d99 -> trunk/1ebd70d0c0d562d3be9abdee2a21906584af7d99 2025-09-07T06:39:15.3382049Z * [new tag] trunk/1ec2c15914da4ef7bd926ed9aebc8671c75fe965 -> trunk/1ec2c15914da4ef7bd926ed9aebc8671c75fe965 2025-09-07T06:39:15.3382180Z * [new tag] trunk/1f51056bd64e73d1aa81321bc3c098575b1bc78a -> trunk/1f51056bd64e73d1aa81321bc3c098575b1bc78a 2025-09-07T06:39:15.3382308Z * [new tag] trunk/1f820de639c75a1562d3fb03f160439f853ae07b -> trunk/1f820de639c75a1562d3fb03f160439f853ae07b 2025-09-07T06:39:15.3382434Z * [new tag] trunk/204697f0e695d82894c5010fbec664c4391f90cc -> trunk/204697f0e695d82894c5010fbec664c4391f90cc 2025-09-07T06:39:15.3382562Z * [new tag] trunk/20629b1619fe636227d01fc85ba221daa7185a05 -> trunk/20629b1619fe636227d01fc85ba221daa7185a05 2025-09-07T06:39:15.3382694Z * [new tag] trunk/20b47acef845e9c4f71da9429a396d293f50ebe7 -> trunk/20b47acef845e9c4f71da9429a396d293f50ebe7 2025-09-07T06:39:15.3382825Z * [new tag] trunk/20bfb2539d7c5250379648eda35f80b8a7d642dd -> trunk/20bfb2539d7c5250379648eda35f80b8a7d642dd 2025-09-07T06:39:15.3382956Z * [new tag] trunk/21fae99c180d17def562797ea0fb154d8fdf88e3 -> trunk/21fae99c180d17def562797ea0fb154d8fdf88e3 2025-09-07T06:39:15.3383227Z * [new tag] trunk/248355faf53f9f7ba2fd0a367d59600c6d991e7f -> trunk/248355faf53f9f7ba2fd0a367d59600c6d991e7f 2025-09-07T06:39:15.3383359Z * [new tag] trunk/25f4aaed9ec26f39c13862323ff8582006473d23 -> trunk/25f4aaed9ec26f39c13862323ff8582006473d23 2025-09-07T06:39:15.3383487Z * [new tag] trunk/261a84a1764412f8e659c956e3f81997ec3de9d5 -> trunk/261a84a1764412f8e659c956e3f81997ec3de9d5 2025-09-07T06:39:15.3383613Z * [new tag] trunk/28f4ab0737937858730f29f5c4e601e109cf9d5f -> trunk/28f4ab0737937858730f29f5c4e601e109cf9d5f 2025-09-07T06:39:15.3383744Z * [new tag] trunk/291cd11f2d5df6f48d348cce0e4e762f274f4dc4 -> trunk/291cd11f2d5df6f48d348cce0e4e762f274f4dc4 2025-09-07T06:39:15.3383929Z * [new tag] trunk/29280864d941e6108ab57f7298f520c0cf9696e9 -> trunk/29280864d941e6108ab57f7298f520c0cf9696e9 2025-09-07T06:39:15.3384058Z * [new tag] trunk/2a45837e98c63cae9d1a2e2133a727b829e549d5 -> trunk/2a45837e98c63cae9d1a2e2133a727b829e549d5 2025-09-07T06:39:15.3384191Z * [new tag] trunk/2a5c0785e2f975697fd7bdf1411de6e03dcaa1ef -> trunk/2a5c0785e2f975697fd7bdf1411de6e03dcaa1ef 2025-09-07T06:39:15.3384321Z * [new tag] trunk/2b8a83901c58a0858ea9e4ce00055f48e6ed164c -> trunk/2b8a83901c58a0858ea9e4ce00055f48e6ed164c 2025-09-07T06:39:15.3384448Z * [new tag] trunk/2ba65472dd54488a86a50326ea990195fc6732d6 -> trunk/2ba65472dd54488a86a50326ea990195fc6732d6 2025-09-07T06:39:15.3384580Z * [new tag] trunk/2c03f0acc53ed13fe8ebfe809129f25996e009a0 -> trunk/2c03f0acc53ed13fe8ebfe809129f25996e009a0 2025-09-07T06:39:15.3384710Z * [new tag] trunk/2dd529df0092799f68ee7afcf52338276906706a -> trunk/2dd529df0092799f68ee7afcf52338276906706a 2025-09-07T06:39:15.3384845Z * [new tag] trunk/2f6b4b1ad3f82bb3bd984f6e65744ea339ffb8b5 -> trunk/2f6b4b1ad3f82bb3bd984f6e65744ea339ffb8b5 2025-09-07T06:39:15.3384977Z * [new tag] trunk/2fa0520a64ed8aa734a56c4d124958f0b5711ca8 -> trunk/2fa0520a64ed8aa734a56c4d124958f0b5711ca8 2025-09-07T06:39:15.3385108Z * [new tag] trunk/302df2ac5dc4222294c09d48804a2dddb8f4bad8 -> trunk/302df2ac5dc4222294c09d48804a2dddb8f4bad8 2025-09-07T06:39:15.3386258Z * [new tag] trunk/33028597bfa2e0178e28c8cce33cb9b3800cac43 -> trunk/33028597bfa2e0178e28c8cce33cb9b3800cac43 2025-09-07T06:39:15.3386388Z * [new tag] trunk/34aa78274d6770086025a967fa63a86830e08176 -> trunk/34aa78274d6770086025a967fa63a86830e08176 2025-09-07T06:39:15.3386519Z * [new tag] trunk/3559c354ce6a14d11fe29fb12fa2747a2f2af449 -> trunk/3559c354ce6a14d11fe29fb12fa2747a2f2af449 2025-09-07T06:39:15.3386655Z * [new tag] trunk/36d207fcaaede0d1e58a5168084c307b32b6fd8b -> trunk/36d207fcaaede0d1e58a5168084c307b32b6fd8b 2025-09-07T06:39:15.3386783Z * [new tag] trunk/377033757ae5ca524ea842f1b0a5f446ed3d8fe0 -> trunk/377033757ae5ca524ea842f1b0a5f446ed3d8fe0 2025-09-07T06:39:15.3386916Z * [new tag] trunk/3771380f83fcac154a7c89ad679311d8c4818287 -> trunk/3771380f83fcac154a7c89ad679311d8c4818287 2025-09-07T06:39:15.3387043Z * [new tag] trunk/3a207816cc569f78863d86c01f2a3d265350e39f -> trunk/3a207816cc569f78863d86c01f2a3d265350e39f 2025-09-07T06:39:15.3387173Z * [new tag] trunk/3a20a20e7065ec927fdd216d4da3b04f879b3c67 -> trunk/3a20a20e7065ec927fdd216d4da3b04f879b3c67 2025-09-07T06:39:15.3387308Z * [new tag] trunk/3bbc2e3e4f025523eaa5dbff220b3e96bca608d0 -> trunk/3bbc2e3e4f025523eaa5dbff220b3e96bca608d0 2025-09-07T06:39:15.3387441Z * [new tag] trunk/3c0ff1b569c45cfa6935ad8031a9d4cf1551aa3f -> trunk/3c0ff1b569c45cfa6935ad8031a9d4cf1551aa3f 2025-09-07T06:39:15.3387575Z * [new tag] trunk/3c45af079afc92a03b03ddf4f9198902ffcf30cf -> trunk/3c45af079afc92a03b03ddf4f9198902ffcf30cf 2025-09-07T06:39:15.3387744Z * [new tag] trunk/3dde5d7f9bf80dd6623a712bc429e9e4302464b5 -> trunk/3dde5d7f9bf80dd6623a712bc429e9e4302464b5 2025-09-07T06:39:15.3387878Z * [new tag] trunk/403a3a393cda7e60f503f3b04b8805a845dcf45d -> trunk/403a3a393cda7e60f503f3b04b8805a845dcf45d 2025-09-07T06:39:15.3388009Z * [new tag] trunk/420c52ecf36f86d32da0853bfbe074b682b070aa -> trunk/420c52ecf36f86d32da0853bfbe074b682b070aa 2025-09-07T06:39:15.3388139Z * [new tag] trunk/43b7c86a2c0f91320f5c5f4827b111edff06fdb6 -> trunk/43b7c86a2c0f91320f5c5f4827b111edff06fdb6 2025-09-07T06:39:15.3388267Z * [new tag] trunk/451ed931562ec8b46d1f7e6c266a68132a119336 -> trunk/451ed931562ec8b46d1f7e6c266a68132a119336 2025-09-07T06:39:15.3388428Z * [new tag] trunk/480c7391126656154318fabf1d57ebc01e196e63 -> trunk/480c7391126656154318fabf1d57ebc01e196e63 2025-09-07T06:39:15.3388562Z * [new tag] trunk/48bedd753da22634aa94fbafeb731e82025404f3 -> trunk/48bedd753da22634aa94fbafeb731e82025404f3 2025-09-07T06:39:15.3388692Z * [new tag] trunk/494878a11b79071ada0b98f34042d47155be6d1c -> trunk/494878a11b79071ada0b98f34042d47155be6d1c 2025-09-07T06:39:15.3388825Z * [new tag] trunk/4ae57d448c0a7d37e4cfd5c27d977fad2cef4051 -> trunk/4ae57d448c0a7d37e4cfd5c27d977fad2cef4051 2025-09-07T06:39:15.3388956Z * [new tag] trunk/4cdaf8265d86f984254b62052da8c26ef61ef1cf -> trunk/4cdaf8265d86f984254b62052da8c26ef61ef1cf 2025-09-07T06:39:15.3389092Z * [new tag] trunk/4d4abec80f03cd8fdefe1d9cb3a60d3690cd777e -> trunk/4d4abec80f03cd8fdefe1d9cb3a60d3690cd777e 2025-09-07T06:39:15.3389227Z * [new tag] trunk/4e42aa8ffc44b8340eb0eeaf80a2cafc4763a186 -> trunk/4e42aa8ffc44b8340eb0eeaf80a2cafc4763a186 2025-09-07T06:39:15.3389359Z * [new tag] trunk/4f72d932feee0749397fec876dcd43994f50b215 -> trunk/4f72d932feee0749397fec876dcd43994f50b215 2025-09-07T06:39:15.3390499Z * [new tag] trunk/50fc22dedf3c4a27be61fa05551c4f320281b42d -> trunk/50fc22dedf3c4a27be61fa05551c4f320281b42d 2025-09-07T06:39:15.3390635Z * [new tag] trunk/5211f1f908907ffc064b56e43cf8659f7fc22aa9 -> trunk/5211f1f908907ffc064b56e43cf8659f7fc22aa9 2025-09-07T06:39:15.3390766Z * [new tag] trunk/524b78d4f67045b83bb69edc56ab16efe282971c -> trunk/524b78d4f67045b83bb69edc56ab16efe282971c 2025-09-07T06:39:15.3390901Z * [new tag] trunk/54e275e0d81fe1e1ccfa4fb5f2a5a9aaca00ca15 -> trunk/54e275e0d81fe1e1ccfa4fb5f2a5a9aaca00ca15 2025-09-07T06:39:15.3391028Z * [new tag] trunk/5561e45758d59c94605873d5db48ed459c004c3b -> trunk/5561e45758d59c94605873d5db48ed459c004c3b 2025-09-07T06:39:15.3391156Z * [new tag] trunk/57278d45f046d4f89f45d373b1af4dd56934ff24 -> trunk/57278d45f046d4f89f45d373b1af4dd56934ff24 2025-09-07T06:39:15.3391288Z * [new tag] trunk/5927a70934ccf7b70182d364c23245a7dd685503 -> trunk/5927a70934ccf7b70182d364c23245a7dd685503 2025-09-07T06:39:15.3391421Z * [new tag] trunk/5985e28912aeb40b103ebfcf2fd0665eb4a50599 -> trunk/5985e28912aeb40b103ebfcf2fd0665eb4a50599 2025-09-07T06:39:15.3391553Z * [new tag] trunk/5a2da090ed6db88bb657c4e51ec0b310cd08bff6 -> trunk/5a2da090ed6db88bb657c4e51ec0b310cd08bff6 2025-09-07T06:39:15.3391685Z * [new tag] trunk/5c473e9f5ee0ef0fc38e6cf34a95b547f8cdc8d5 -> trunk/5c473e9f5ee0ef0fc38e6cf34a95b547f8cdc8d5 2025-09-07T06:39:15.3391813Z * [new tag] trunk/5c67426d6847667a7c55a2dd01f470fa37238c18 -> trunk/5c67426d6847667a7c55a2dd01f470fa37238c18 2025-09-07T06:39:15.3391943Z * [new tag] trunk/5da573c42c332bc68d4b7946c69f690a876d951a -> trunk/5da573c42c332bc68d4b7946c69f690a876d951a 2025-09-07T06:39:15.3392071Z * [new tag] trunk/5e5870e858f60ff4bf87d03f3592097e934a9580 -> trunk/5e5870e858f60ff4bf87d03f3592097e934a9580 2025-09-07T06:39:15.3392206Z * [new tag] trunk/5f3cbc9442aa55b5afb29f4ac8ca9be569003e84 -> trunk/5f3cbc9442aa55b5afb29f4ac8ca9be569003e84 2025-09-07T06:39:15.3392383Z * [new tag] trunk/600c25e9a17fe56e3dee872be8854db08916ba0c -> trunk/600c25e9a17fe56e3dee872be8854db08916ba0c 2025-09-07T06:39:15.3392516Z * [new tag] trunk/601ae8e4831fc8123fffcfb8fd2e6b6381b42e14 -> trunk/601ae8e4831fc8123fffcfb8fd2e6b6381b42e14 2025-09-07T06:39:15.3392647Z * [new tag] trunk/6087ef41e54c2494b117ffd923faf20f515a6806 -> trunk/6087ef41e54c2494b117ffd923faf20f515a6806 2025-09-07T06:39:15.3392779Z * [new tag] trunk/626cb7df8161dd4ecb4fe43b60f37ce9076f56b1 -> trunk/626cb7df8161dd4ecb4fe43b60f37ce9076f56b1 2025-09-07T06:39:15.3392910Z * [new tag] trunk/62c3f9a97fd3dea7132a93066d32d893ffe101e6 -> trunk/62c3f9a97fd3dea7132a93066d32d893ffe101e6 2025-09-07T06:39:15.3393142Z * [new tag] trunk/63a9c23fe99eacfd09610c36dfe8f01b053c1a35 -> trunk/63a9c23fe99eacfd09610c36dfe8f01b053c1a35 2025-09-07T06:39:15.3393270Z * [new tag] trunk/65985937d97505f648b6ed852c3129f2dd08b251 -> trunk/65985937d97505f648b6ed852c3129f2dd08b251 2025-09-07T06:39:15.3393397Z * [new tag] trunk/66f3b4a682a6153517dd23369fdc3289b6494b07 -> trunk/66f3b4a682a6153517dd23369fdc3289b6494b07 2025-09-07T06:39:15.3393523Z * [new tag] trunk/6737e2c996990024187ba620d2764f3b6f6add2c -> trunk/6737e2c996990024187ba620d2764f3b6f6add2c 2025-09-07T06:39:15.3393653Z * [new tag] trunk/67c31dcd364f10072a55f4a30ffd1151c686283a -> trunk/67c31dcd364f10072a55f4a30ffd1151c686283a 2025-09-07T06:39:15.3394808Z * [new tag] trunk/68738beff73e9c3512e18b4edea811a897ce42db -> trunk/68738beff73e9c3512e18b4edea811a897ce42db 2025-09-07T06:39:15.3394945Z * [new tag] trunk/69a25f68884a168550695fdb1a7c310c54d29536 -> trunk/69a25f68884a168550695fdb1a7c310c54d29536 2025-09-07T06:39:15.3395072Z * [new tag] trunk/6b1900c22f1a07b9519346898d4c71d8a2b0f12f -> trunk/6b1900c22f1a07b9519346898d4c71d8a2b0f12f 2025-09-07T06:39:15.3395206Z * [new tag] trunk/6b8b3ac4403f771bd4a8f9a45d93347304148774 -> trunk/6b8b3ac4403f771bd4a8f9a45d93347304148774 2025-09-07T06:39:15.3395333Z * [new tag] trunk/6f7608d603834d6068b2e7a5d59bec3973b6bb1b -> trunk/6f7608d603834d6068b2e7a5d59bec3973b6bb1b 2025-09-07T06:39:15.3395460Z * [new tag] trunk/70d36e047dfb3488fd6335016711a784d810ebda -> trunk/70d36e047dfb3488fd6335016711a784d810ebda 2025-09-07T06:39:15.3395589Z * [new tag] trunk/71992dd805ff9d6763f77214dfe8b0465e88c87b -> trunk/71992dd805ff9d6763f77214dfe8b0465e88c87b 2025-09-07T06:39:15.3395720Z * [new tag] trunk/734ce8eba9c69381f187359bf0fef1d71d84cd20 -> trunk/734ce8eba9c69381f187359bf0fef1d71d84cd20 2025-09-07T06:39:15.3395851Z * [new tag] trunk/73eb4511fb863a37944342b7e92aae706de603c8 -> trunk/73eb4511fb863a37944342b7e92aae706de603c8 2025-09-07T06:39:15.3395984Z * [new tag] trunk/75bc23cfc345bd4c05e7f97c416c4b3d2d1fa64b -> trunk/75bc23cfc345bd4c05e7f97c416c4b3d2d1fa64b 2025-09-07T06:39:15.3396111Z * [new tag] trunk/771f369448321a387f2018535bc8b8b6e5f12fab -> trunk/771f369448321a387f2018535bc8b8b6e5f12fab 2025-09-07T06:39:15.3396237Z * [new tag] trunk/789d4942127143f2adcb53612c058ce4c9a2cf20 -> trunk/789d4942127143f2adcb53612c058ce4c9a2cf20 2025-09-07T06:39:15.3396364Z * [new tag] trunk/791eff96c85678c950888f9da24650083ee673fe -> trunk/791eff96c85678c950888f9da24650083ee673fe 2025-09-07T06:39:15.3396497Z * [new tag] trunk/793fc12aff1f69fbbf9f4278182fb52bbe350fc9 -> trunk/793fc12aff1f69fbbf9f4278182fb52bbe350fc9 2025-09-07T06:39:15.3396631Z * [new tag] trunk/79fcd5247a9a129eee526a14df30bfc6a22b3f01 -> trunk/79fcd5247a9a129eee526a14df30bfc6a22b3f01 2025-09-07T06:39:15.3396762Z * [new tag] trunk/7f4ff79210eb06924f223ae3a1941ee0e2635348 -> trunk/7f4ff79210eb06924f223ae3a1941ee0e2635348 2025-09-07T06:39:15.3396954Z * [new tag] trunk/8076a185c85112be62be292eb47409c88a585b1c -> trunk/8076a185c85112be62be292eb47409c88a585b1c 2025-09-07T06:39:15.3397081Z * [new tag] trunk/80dd397f1979371a5583fa3d5c7352029522a78d -> trunk/80dd397f1979371a5583fa3d5c7352029522a78d 2025-09-07T06:39:15.3397206Z * [new tag] trunk/8171d6052ec12628eb67e0040839314056014429 -> trunk/8171d6052ec12628eb67e0040839314056014429 2025-09-07T06:39:15.3397339Z * [new tag] trunk/81aeefa657b7ccc26b275c50a9f33b2f056e8071 -> trunk/81aeefa657b7ccc26b275c50a9f33b2f056e8071 2025-09-07T06:39:15.3397467Z * [new tag] trunk/81b7b16618bda250ce55982894a83dc0805eb64c -> trunk/81b7b16618bda250ce55982894a83dc0805eb64c 2025-09-07T06:39:15.3397651Z * [new tag] trunk/827f0d405448de31f79d1089f7d7fceab2f87895 -> trunk/827f0d405448de31f79d1089f7d7fceab2f87895 2025-09-07T06:39:15.3397782Z * [new tag] trunk/82f63c8f6de63c30132a8ac299b6e8c2fd0d3fe8 -> trunk/82f63c8f6de63c30132a8ac299b6e8c2fd0d3fe8 2025-09-07T06:39:15.3397914Z * [new tag] trunk/850e1382a9c56bfde18af09d3e72352d775e9435 -> trunk/850e1382a9c56bfde18af09d3e72352d775e9435 2025-09-07T06:39:15.3399060Z * [new tag] trunk/8678d831c48e616b717bff50f2d03141d2e9f965 -> trunk/8678d831c48e616b717bff50f2d03141d2e9f965 2025-09-07T06:39:15.3399192Z * [new tag] trunk/869cbcc16e489a4f5a14a93d5779b0ea86061c60 -> trunk/869cbcc16e489a4f5a14a93d5779b0ea86061c60 2025-09-07T06:39:15.3399326Z * [new tag] trunk/8703debf669bc2238211bfd039f4ecdd8228b7f7 -> trunk/8703debf669bc2238211bfd039f4ecdd8228b7f7 2025-09-07T06:39:15.3399459Z * [new tag] trunk/874069fbe46e82da5cfa405e6c0deb12e89ff608 -> trunk/874069fbe46e82da5cfa405e6c0deb12e89ff608 2025-09-07T06:39:15.3399596Z * [new tag] trunk/8875d6e394da2fffd04f31b28bf258c94d4776a3 -> trunk/8875d6e394da2fffd04f31b28bf258c94d4776a3 2025-09-07T06:39:15.3399727Z * [new tag] trunk/88d94d17e8c5155451393afa6eb3bab48ab61c16 -> trunk/88d94d17e8c5155451393afa6eb3bab48ab61c16 2025-09-07T06:39:15.3399857Z * [new tag] trunk/890626632def7e0ef95a2d01e87a0e4627824a9f -> trunk/890626632def7e0ef95a2d01e87a0e4627824a9f 2025-09-07T06:39:15.3399987Z * [new tag] trunk/8975cda2520b7b1b5bc3b4d8213edf261fa82570 -> trunk/8975cda2520b7b1b5bc3b4d8213edf261fa82570 2025-09-07T06:39:15.3400114Z * [new tag] trunk/89d41d3f61d04f14730ec26f008a59bef6624610 -> trunk/89d41d3f61d04f14730ec26f008a59bef6624610 2025-09-07T06:39:15.3400246Z * [new tag] trunk/8bb213b6d599ef1273fe52f9b1f6d476056c3a41 -> trunk/8bb213b6d599ef1273fe52f9b1f6d476056c3a41 2025-09-07T06:39:15.3400380Z * [new tag] trunk/8e23a1227b5fb2e39afaa7d57c075a75b640a5af -> trunk/8e23a1227b5fb2e39afaa7d57c075a75b640a5af 2025-09-07T06:39:15.3400513Z * [new tag] trunk/8ec551bb354ab2b85fbbba9d461740a20366d248 -> trunk/8ec551bb354ab2b85fbbba9d461740a20366d248 2025-09-07T06:39:15.3400647Z * [new tag] trunk/8fd3c9ce919c8d5c645fd348bba517e948cbc29d -> trunk/8fd3c9ce919c8d5c645fd348bba517e948cbc29d 2025-09-07T06:39:15.3400774Z * [new tag] trunk/90f50f7e68e120d9574e6e3189e37b4280010ad9 -> trunk/90f50f7e68e120d9574e6e3189e37b4280010ad9 2025-09-07T06:39:15.3400904Z * [new tag] trunk/91f0bcf43fc0bc743350d491ac63b77e92054ac9 -> trunk/91f0bcf43fc0bc743350d491ac63b77e92054ac9 2025-09-07T06:39:15.3401033Z * [new tag] trunk/92576a594b8121f6b0b1b5a3ea16d08792fc68ab -> trunk/92576a594b8121f6b0b1b5a3ea16d08792fc68ab 2025-09-07T06:39:15.3401162Z * [new tag] trunk/92a43025e0baa1f2ce345f28d22913b518a1ab9d -> trunk/92a43025e0baa1f2ce345f28d22913b518a1ab9d 2025-09-07T06:39:15.3401296Z * [new tag] trunk/93fb23d6fae7c4e82c4239a1033e522088742634 -> trunk/93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:39:15.3401428Z * [new tag] trunk/9458d1ac3bd70c2af316a8ba95d2c6c9c1199c9c -> trunk/9458d1ac3bd70c2af316a8ba95d2c6c9c1199c9c 2025-09-07T06:39:15.3401606Z * [new tag] trunk/9480cdc0b61488c89a23c2f64f43b2dcedc8728e -> trunk/9480cdc0b61488c89a23c2f64f43b2dcedc8728e 2025-09-07T06:39:15.3401735Z * [new tag] trunk/9491d289b329e4ba4a9f5f5b1be7960671bb7840 -> trunk/9491d289b329e4ba4a9f5f5b1be7960671bb7840 2025-09-07T06:39:15.3401862Z * [new tag] trunk/9499c8761cd2067feb9877414e818f6fd00290f1 -> trunk/9499c8761cd2067feb9877414e818f6fd00290f1 2025-09-07T06:39:15.3401993Z * [new tag] trunk/95ee0bfea99d3d346d6502b91b497d2b35795504 -> trunk/95ee0bfea99d3d346d6502b91b497d2b35795504 2025-09-07T06:39:15.3403196Z * [new tag] trunk/98374612fc2febd686be20761e56bdc2424bc36a -> trunk/98374612fc2febd686be20761e56bdc2424bc36a 2025-09-07T06:39:15.3403399Z * [new tag] trunk/98efc9e93d8fc61eb53cb91378443617cb550500 -> trunk/98efc9e93d8fc61eb53cb91378443617cb550500 2025-09-07T06:39:15.3403537Z * [new tag] trunk/994f2a5dbcbdc915da39bf6f6ce4d1f5e74835c9 -> trunk/994f2a5dbcbdc915da39bf6f6ce4d1f5e74835c9 2025-09-07T06:39:15.3403665Z * [new tag] trunk/99f356fa58c8d726cef022d8710f5491291158f6 -> trunk/99f356fa58c8d726cef022d8710f5491291158f6 2025-09-07T06:39:15.3403797Z * [new tag] trunk/9a1c5c0a078b94d13ac5c1ae0d754d19fb73bf99 -> trunk/9a1c5c0a078b94d13ac5c1ae0d754d19fb73bf99 2025-09-07T06:39:15.3403930Z * [new tag] trunk/9a665ca3c472384e9d722bddba79e5a7680f1abd -> trunk/9a665ca3c472384e9d722bddba79e5a7680f1abd 2025-09-07T06:39:15.3404061Z * [new tag] trunk/9aedb3cd87b52160872173c177f61053d97bed57 -> trunk/9aedb3cd87b52160872173c177f61053d97bed57 2025-09-07T06:39:15.3404192Z * [new tag] trunk/9b81fe281da41f2421506339d26b027a468902f4 -> trunk/9b81fe281da41f2421506339d26b027a468902f4 2025-09-07T06:39:15.3404329Z * [new tag] trunk/9bdcee01f86e2969cff1140cdecfca13cb51816e -> trunk/9bdcee01f86e2969cff1140cdecfca13cb51816e 2025-09-07T06:39:15.3404464Z * [new tag] trunk/9c03d6be87eedc06e524e202e07a7e776551a839 -> trunk/9c03d6be87eedc06e524e202e07a7e776551a839 2025-09-07T06:39:15.3404592Z * [new tag] trunk/9c957723a0fedd9c637e63e023a613019e2cab60 -> trunk/9c957723a0fedd9c637e63e023a613019e2cab60 2025-09-07T06:39:15.3404720Z * [new tag] trunk/9e5247f51d81735e5f1e65e80588985fa93bccc5 -> trunk/9e5247f51d81735e5f1e65e80588985fa93bccc5 2025-09-07T06:39:15.3404853Z * [new tag] trunk/9eadb37cdd699f7e8e8177a5227bfeb16184ef26 -> trunk/9eadb37cdd699f7e8e8177a5227bfeb16184ef26 2025-09-07T06:39:15.3404987Z * [new tag] trunk/a00cdc1e4159db73c9ffb3f25e93e55877709a29 -> trunk/a00cdc1e4159db73c9ffb3f25e93e55877709a29 2025-09-07T06:39:15.3405122Z * [new tag] trunk/a02ee4a816d11380c6f564c1aba64d56af5ba705 -> trunk/a02ee4a816d11380c6f564c1aba64d56af5ba705 2025-09-07T06:39:15.3405250Z * [new tag] trunk/a3c7f77e50f900721817934120d60c2361b3c40d -> trunk/a3c7f77e50f900721817934120d60c2361b3c40d 2025-09-07T06:39:15.3405380Z * [new tag] trunk/a3d72b09ae12126a2b7d4a63a45ac100a882a802 -> trunk/a3d72b09ae12126a2b7d4a63a45ac100a882a802 2025-09-07T06:39:15.3405508Z * [new tag] trunk/a3e5466002791da609fcb069155d8ee347baee92 -> trunk/a3e5466002791da609fcb069155d8ee347baee92 2025-09-07T06:39:15.3405638Z * [new tag] trunk/a714437093ed196eee28f7de454cf4c41badc098 -> trunk/a714437093ed196eee28f7de454cf4c41badc098 2025-09-07T06:39:15.3405768Z * [new tag] trunk/a75e8cd27098f290de0b7439685d05ce02e91356 -> trunk/a75e8cd27098f290de0b7439685d05ce02e91356 2025-09-07T06:39:15.3405899Z * [new tag] trunk/a8d6943d36c1c2a5f90d3573460695bad4b623ae -> trunk/a8d6943d36c1c2a5f90d3573460695bad4b623ae 2025-09-07T06:39:15.3406038Z * [new tag] trunk/a918bbad6ab20649ff82eefb48417ecbe96bcb34 -> trunk/a918bbad6ab20649ff82eefb48417ecbe96bcb34 2025-09-07T06:39:15.3406226Z * [new tag] trunk/a99d8d39bc842d6ebc3e368b178e4884d24b056e -> trunk/a99d8d39bc842d6ebc3e368b178e4884d24b056e 2025-09-07T06:39:15.3406357Z * [new tag] trunk/aac1a50a191b4102d566c9c1ea22f06d6c2e3f02 -> trunk/aac1a50a191b4102d566c9c1ea22f06d6c2e3f02 2025-09-07T06:39:15.3407501Z * [new tag] trunk/aad96a202244c7d0d120c04ba8db593edd8c0f92 -> trunk/aad96a202244c7d0d120c04ba8db593edd8c0f92 2025-09-07T06:39:15.3407640Z * [new tag] trunk/ab643e4dbbaf7b663d4237514cbf01af9b11565c -> trunk/ab643e4dbbaf7b663d4237514cbf01af9b11565c 2025-09-07T06:39:15.3407774Z * [new tag] trunk/abc447174cd2cf8591edbc70a9f836f9a5779f47 -> trunk/abc447174cd2cf8591edbc70a9f836f9a5779f47 2025-09-07T06:39:15.3407954Z * [new tag] trunk/acece97c3a9dceb63194e314da93fdf37cf15a0d -> trunk/acece97c3a9dceb63194e314da93fdf37cf15a0d 2025-09-07T06:39:15.3408088Z * [new tag] trunk/adae7f66aacf3f248c3101b858cf98d5809119fa -> trunk/adae7f66aacf3f248c3101b858cf98d5809119fa 2025-09-07T06:39:15.3408225Z * [new tag] trunk/ae0edc133e61e3b16caf0b2ee0ff3f33ab72af4c -> trunk/ae0edc133e61e3b16caf0b2ee0ff3f33ab72af4c 2025-09-07T06:39:15.3408906Z * [new tag] trunk/aed33a8fcbd60b052d4559d261390c5797129c6d -> trunk/aed33a8fcbd60b052d4559d261390c5797129c6d 2025-09-07T06:39:15.3409034Z * [new tag] trunk/b04e922712080a3652e438d05e8bb74e0cd2d238 -> trunk/b04e922712080a3652e438d05e8bb74e0cd2d238 2025-09-07T06:39:15.3409167Z * [new tag] trunk/b0a3e58dd71c1a039ac0ef51e5bd8f704f632f6f -> trunk/b0a3e58dd71c1a039ac0ef51e5bd8f704f632f6f 2025-09-07T06:39:15.3409298Z * [new tag] trunk/b16d3f4c8c01d461c2f01064e9ca5fa2b33f5cf1 -> trunk/b16d3f4c8c01d461c2f01064e9ca5fa2b33f5cf1 2025-09-07T06:39:15.3409432Z * [new tag] trunk/b18bb6796f210a183e687d9d64984a5a9d13cf09 -> trunk/b18bb6796f210a183e687d9d64984a5a9d13cf09 2025-09-07T06:39:15.3409571Z * [new tag] trunk/b1bb98ddebdd3e41bf7987372409bdce96ae55de -> trunk/b1bb98ddebdd3e41bf7987372409bdce96ae55de 2025-09-07T06:39:15.3409700Z * [new tag] trunk/b2b4add0e754411372060e1d7b4057a66439172b -> trunk/b2b4add0e754411372060e1d7b4057a66439172b 2025-09-07T06:39:15.3409834Z * [new tag] trunk/b2c7b9ad2dc5a7c0b61febd307761bd5bc2f0f05 -> trunk/b2c7b9ad2dc5a7c0b61febd307761bd5bc2f0f05 2025-09-07T06:39:15.3409966Z * [new tag] trunk/b40d9432be44a6b5974ee62e7d19c3c61c5ece37 -> trunk/b40d9432be44a6b5974ee62e7d19c3c61c5ece37 2025-09-07T06:39:15.3410093Z * [new tag] trunk/b4ad38279b178b7bd14355123c1101e2e853e77b -> trunk/b4ad38279b178b7bd14355123c1101e2e853e77b 2025-09-07T06:39:15.3410225Z * [new tag] trunk/b67c41039835bd9b20b83cd6233e86baaa5f5dde -> trunk/b67c41039835bd9b20b83cd6233e86baaa5f5dde 2025-09-07T06:39:15.3410361Z * [new tag] trunk/b6d0a9ea9056ede4f7024dbf3bd6c43be3aff49c -> trunk/b6d0a9ea9056ede4f7024dbf3bd6c43be3aff49c 2025-09-07T06:39:15.3410494Z * [new tag] trunk/b7dad7dd49448c88d0751fa2e29c70afe985f734 -> trunk/b7dad7dd49448c88d0751fa2e29c70afe985f734 2025-09-07T06:39:15.3410624Z * [new tag] trunk/b7e207ca9f046ddd716076965a0cce403ba99052 -> trunk/b7e207ca9f046ddd716076965a0cce403ba99052 2025-09-07T06:39:15.3410753Z * [new tag] trunk/b919560c4a7010e2d89facee25586269a994746e -> trunk/b919560c4a7010e2d89facee25586269a994746e 2025-09-07T06:39:15.3410885Z * [new tag] trunk/b9ba612f7a968f7b27e121ca8f4d0a4d954f5354 -> trunk/b9ba612f7a968f7b27e121ca8f4d0a4d954f5354 2025-09-07T06:39:15.3411019Z * [new tag] trunk/ba7f546ccccb5e0b36d9070dc25f26a9647f89f8 -> trunk/ba7f546ccccb5e0b36d9070dc25f26a9647f89f8 2025-09-07T06:39:15.3411153Z * [new tag] trunk/bb950284c7e72905994bc25dd436c10e48088d85 -> trunk/bb950284c7e72905994bc25dd436c10e48088d85 2025-09-07T06:39:15.3412367Z * [new tag] trunk/bbedc71fd3267c639c38b4ec25eaa22f973d9c4d -> trunk/bbedc71fd3267c639c38b4ec25eaa22f973d9c4d 2025-09-07T06:39:15.3412510Z * [new tag] trunk/bc4db2c27fce6ff1648bdc5af31ec225d2a31f37 -> trunk/bc4db2c27fce6ff1648bdc5af31ec225d2a31f37 2025-09-07T06:39:15.3412639Z * [new tag] trunk/bc505977fb66677a09c31155c987330fbb18a865 -> trunk/bc505977fb66677a09c31155c987330fbb18a865 2025-09-07T06:39:15.3412774Z * [new tag] trunk/bd39e47feea7326afb5bbb67fcb1e69279239527 -> trunk/bd39e47feea7326afb5bbb67fcb1e69279239527 2025-09-07T06:39:15.3412908Z * [new tag] trunk/be5b03dde96638f25ffd732a4fed7e41b4cf40e1 -> trunk/be5b03dde96638f25ffd732a4fed7e41b4cf40e1 2025-09-07T06:39:15.3413042Z * [new tag] trunk/bffc7dd1f374d8408911cd22c6b3d6df39ded9b3 -> trunk/bffc7dd1f374d8408911cd22c6b3d6df39ded9b3 2025-09-07T06:39:15.3413339Z * [new tag] trunk/c024b1f5a18d5c5aee5cc2acdd4c52b24b93ffcf -> trunk/c024b1f5a18d5c5aee5cc2acdd4c52b24b93ffcf 2025-09-07T06:39:15.3413470Z * [new tag] trunk/c0983e6cc0acf71689e1851d12609e00b3f59371 -> trunk/c0983e6cc0acf71689e1851d12609e00b3f59371 2025-09-07T06:39:15.3413605Z * [new tag] trunk/c10195e723eeeedd099ed8b73eda7184ca618fad -> trunk/c10195e723eeeedd099ed8b73eda7184ca618fad 2025-09-07T06:39:15.3413736Z * [new tag] trunk/c157cf6488ade6a7ee2ce2d25b059e1335630a99 -> trunk/c157cf6488ade6a7ee2ce2d25b059e1335630a99 2025-09-07T06:39:15.3413863Z * [new tag] trunk/c2a30246172fd71d56529907ffd3c27b76b1f3a7 -> trunk/c2a30246172fd71d56529907ffd3c27b76b1f3a7 2025-09-07T06:39:15.3413988Z * [new tag] trunk/c32111149921b48bfef909293f1049e21619ed76 -> trunk/c32111149921b48bfef909293f1049e21619ed76 2025-09-07T06:39:15.3414118Z * [new tag] trunk/c37103234afc832dcad307e9016230810957c9d5 -> trunk/c37103234afc832dcad307e9016230810957c9d5 2025-09-07T06:39:15.3414250Z * [new tag] trunk/c3ceca2995cd35e1376c4b0704669bff1a81e836 -> trunk/c3ceca2995cd35e1376c4b0704669bff1a81e836 2025-09-07T06:39:15.3414386Z * [new tag] trunk/c3d54dea9febb1236d48d19e5d4876a63f2e20fd -> trunk/c3d54dea9febb1236d48d19e5d4876a63f2e20fd 2025-09-07T06:39:15.3414514Z * [new tag] trunk/c465b3d52c5687fe910d35a5c75341b77f821741 -> trunk/c465b3d52c5687fe910d35a5c75341b77f821741 2025-09-07T06:39:15.3414646Z * [new tag] trunk/c5b8a10be5e89396da916d1069ffcb7135f0372b -> trunk/c5b8a10be5e89396da916d1069ffcb7135f0372b 2025-09-07T06:39:15.3414776Z * [new tag] trunk/c7e41071a08f4045bc11ab60ec366d7357d56e30 -> trunk/c7e41071a08f4045bc11ab60ec366d7357d56e30 2025-09-07T06:39:15.3414912Z * [new tag] trunk/c98ddaca6d2e19ca37aff00c4ff0cda1e9a6ff65 -> trunk/c98ddaca6d2e19ca37aff00c4ff0cda1e9a6ff65 2025-09-07T06:39:15.3415047Z * [new tag] trunk/cb1e31362c7b53acf4ac95b9f8878064c184f03b -> trunk/cb1e31362c7b53acf4ac95b9f8878064c184f03b 2025-09-07T06:39:15.3415178Z * [new tag] trunk/cbfb005f7cce79974795b148e265f594f59477c8 -> trunk/cbfb005f7cce79974795b148e265f594f59477c8 2025-09-07T06:39:15.3415311Z * [new tag] trunk/cc5bdd12401bda835291d2f3cb297132ebdbf358 -> trunk/cc5bdd12401bda835291d2f3cb297132ebdbf358 2025-09-07T06:39:15.3415441Z * [new tag] trunk/cd529b686d54bbaa443f5b310140de48422d96c7 -> trunk/cd529b686d54bbaa443f5b310140de48422d96c7 2025-09-07T06:39:15.3415570Z * [new tag] trunk/cec0ff122815582af5302360aff03676558c5c87 -> trunk/cec0ff122815582af5302360aff03676558c5c87 2025-09-07T06:39:15.3416727Z * [new tag] trunk/d11720efdb563d02cf4f7d324311fb15a755268e -> trunk/d11720efdb563d02cf4f7d324311fb15a755268e 2025-09-07T06:39:15.3416864Z * [new tag] trunk/d1706d9128ae24d9048167e80d3fe5196d19035e -> trunk/d1706d9128ae24d9048167e80d3fe5196d19035e 2025-09-07T06:39:15.3417000Z * [new tag] trunk/d1a15abfdcaef138f2d9e93a9f46be44f30b766d -> trunk/d1a15abfdcaef138f2d9e93a9f46be44f30b766d 2025-09-07T06:39:15.3417196Z * [new tag] trunk/d232a95d4a79404ca05c1f52d37fde7339dcdf49 -> trunk/d232a95d4a79404ca05c1f52d37fde7339dcdf49 2025-09-07T06:39:15.3417329Z * [new tag] trunk/d2d4c8e9b2371c9aacfb771d9402ac7427b9778e -> trunk/d2d4c8e9b2371c9aacfb771d9402ac7427b9778e 2025-09-07T06:39:15.3417458Z * [new tag] trunk/d33840c542b387ab08ba49aa6c45aa9567fd9be7 -> trunk/d33840c542b387ab08ba49aa6c45aa9567fd9be7 2025-09-07T06:39:15.3417588Z * [new tag] trunk/d5643e8f3a648a99636bfa1f2a41d54bd3c0d0f1 -> trunk/d5643e8f3a648a99636bfa1f2a41d54bd3c0d0f1 2025-09-07T06:39:15.3417716Z * [new tag] trunk/d5b38410b5b6cf75c7a7389972777a6497926ee7 -> trunk/d5b38410b5b6cf75c7a7389972777a6497926ee7 2025-09-07T06:39:15.3417899Z * [new tag] trunk/d5e0f4202ba14632e4d14862ace096609e763462 -> trunk/d5e0f4202ba14632e4d14862ace096609e763462 2025-09-07T06:39:15.3418028Z * [new tag] trunk/d636c181f9140a7b59be10b36eae23039fc2bb72 -> trunk/d636c181f9140a7b59be10b36eae23039fc2bb72 2025-09-07T06:39:15.3418156Z * [new tag] trunk/d64718503728001a1e78168fd7f2d4ff23e57285 -> trunk/d64718503728001a1e78168fd7f2d4ff23e57285 2025-09-07T06:39:15.3418283Z * [new tag] trunk/d67c29ad22670320d676b02e394274af34e8e643 -> trunk/d67c29ad22670320d676b02e394274af34e8e643 2025-09-07T06:39:15.3418415Z * [new tag] trunk/d6b74568e2c98ce58ecc145b72ac66d4caf7ce95 -> trunk/d6b74568e2c98ce58ecc145b72ac66d4caf7ce95 2025-09-07T06:39:15.3418545Z * [new tag] trunk/d711f27845abd45007ccab6076649ebd896c2661 -> trunk/d711f27845abd45007ccab6076649ebd896c2661 2025-09-07T06:39:15.3418678Z * [new tag] trunk/d9d6dde0f42d4bcc8c97671ac50d5096c7e500ab -> trunk/d9d6dde0f42d4bcc8c97671ac50d5096c7e500ab 2025-09-07T06:39:15.3418813Z * [new tag] trunk/da4db4b33d1fdd046650cf19fdbac581a19bf2f9 -> trunk/da4db4b33d1fdd046650cf19fdbac581a19bf2f9 2025-09-07T06:39:15.3418949Z * [new tag] trunk/dac8a4b91c01c3bbc96f54e621b1ea4ffdbd29d1 -> trunk/dac8a4b91c01c3bbc96f54e621b1ea4ffdbd29d1 2025-09-07T06:39:15.3419078Z * [new tag] trunk/dbec08729fb9848bebed6048c63831b87170d061 -> trunk/dbec08729fb9848bebed6048c63831b87170d061 2025-09-07T06:39:15.3419204Z * [new tag] trunk/dcf385395d838f38c8dca25913578230dd43099a -> trunk/dcf385395d838f38c8dca25913578230dd43099a 2025-09-07T06:39:15.3419333Z * [new tag] trunk/dd2519abe83ec3c40d4797492434e41fe3b47e17 -> trunk/dd2519abe83ec3c40d4797492434e41fe3b47e17 2025-09-07T06:39:15.3419468Z * [new tag] trunk/dec72ea4b006dd0fbcaaaa106ad273d73807ab9d -> trunk/dec72ea4b006dd0fbcaaaa106ad273d73807ab9d 2025-09-07T06:39:15.3419599Z * [new tag] trunk/e0a62b266c021b910ce6dc02a6c9429210487717 -> trunk/e0a62b266c021b910ce6dc02a6c9429210487717 2025-09-07T06:39:15.3419729Z * [new tag] trunk/e19e02c84c9dcc408375e5cae3b0709c18b99228 -> trunk/e19e02c84c9dcc408375e5cae3b0709c18b99228 2025-09-07T06:39:15.3419860Z * [new tag] trunk/e304ea4e69d3a7deeb7e48c7450c214a4c953937 -> trunk/e304ea4e69d3a7deeb7e48c7450c214a4c953937 2025-09-07T06:39:15.3420993Z * [new tag] trunk/e3068cdb446adefb5a875616ba37a60235391439 -> trunk/e3068cdb446adefb5a875616ba37a60235391439 2025-09-07T06:39:15.3421128Z * [new tag] trunk/e381d4b0205d5f126c1de534f867ba776f7c3ee6 -> trunk/e381d4b0205d5f126c1de534f867ba776f7c3ee6 2025-09-07T06:39:15.3421259Z * [new tag] trunk/e4bd0ff4f8981b805df32ea5b3550621965ea4f2 -> trunk/e4bd0ff4f8981b805df32ea5b3550621965ea4f2 2025-09-07T06:39:15.3421394Z * [new tag] trunk/e532c9d4f1cdcbc1ea9628f55b9813e77847bdc7 -> trunk/e532c9d4f1cdcbc1ea9628f55b9813e77847bdc7 2025-09-07T06:39:15.3421521Z * [new tag] trunk/e92cd9415377403b6e90585e764639e2e0b5973b -> trunk/e92cd9415377403b6e90585e764639e2e0b5973b 2025-09-07T06:39:15.3421684Z * [new tag] trunk/e9481b6617b5576b099d8ca5798111592e9ad090 -> trunk/e9481b6617b5576b099d8ca5798111592e9ad090 2025-09-07T06:39:15.3421818Z * [new tag] trunk/ea1883dfd3e42defe37b11202b878bb76defa087 -> trunk/ea1883dfd3e42defe37b11202b878bb76defa087 2025-09-07T06:39:15.3421955Z * [new tag] trunk/eac3d6f04cfbbebe3d470dacd216da7d4b1f95a8 -> trunk/eac3d6f04cfbbebe3d470dacd216da7d4b1f95a8 2025-09-07T06:39:15.3422086Z * [new tag] trunk/eb18d32bda75189494d955aa001ade15f10333de -> trunk/eb18d32bda75189494d955aa001ade15f10333de 2025-09-07T06:39:15.3422219Z * [new tag] trunk/ef3be6726f7ff4b77c22db10cec5b686f9107ea9 -> trunk/ef3be6726f7ff4b77c22db10cec5b686f9107ea9 2025-09-07T06:39:15.3422388Z * [new tag] trunk/ef8aabd42422725026cb4dbf48aafa9efa226a04 -> trunk/ef8aabd42422725026cb4dbf48aafa9efa226a04 2025-09-07T06:39:15.3422518Z * [new tag] trunk/f00445b43eee57e20bb9316fa796ca23bf73373b -> trunk/f00445b43eee57e20bb9316fa796ca23bf73373b 2025-09-07T06:39:15.3422648Z * [new tag] trunk/f0c391102b754e3b145e8c59231d2df563487e37 -> trunk/f0c391102b754e3b145e8c59231d2df563487e37 2025-09-07T06:39:15.3422777Z * [new tag] trunk/f27985b7e796fb66a1b476284ba42d8cb360a751 -> trunk/f27985b7e796fb66a1b476284ba42d8cb360a751 2025-09-07T06:39:15.3422903Z * [new tag] trunk/f36f285953700f971552083a5da9d0ceacb63bbd -> trunk/f36f285953700f971552083a5da9d0ceacb63bbd 2025-09-07T06:39:15.3423036Z * [new tag] trunk/f3cebec39ebc110e1c8b06e741896585f7892dbb -> trunk/f3cebec39ebc110e1c8b06e741896585f7892dbb 2025-09-07T06:39:15.3423254Z * [new tag] trunk/f4c33cd44acac92c0b451a04da20ebe9370e5b0c -> trunk/f4c33cd44acac92c0b451a04da20ebe9370e5b0c 2025-09-07T06:39:15.3423388Z * [new tag] trunk/f612045ce105f008b2b675e2fc870163babeb2e8 -> trunk/f612045ce105f008b2b675e2fc870163babeb2e8 2025-09-07T06:39:15.3423520Z * [new tag] trunk/f8746b878dfc1e9639d42cbde832e9b9e792c86c -> trunk/f8746b878dfc1e9639d42cbde832e9b9e792c86c 2025-09-07T06:39:15.3423650Z * [new tag] trunk/f8ffa9194e26523e5f976d4a824d5cc58922727c -> trunk/f8ffa9194e26523e5f976d4a824d5cc58922727c 2025-09-07T06:39:15.3423780Z * [new tag] trunk/f981a7fa5230b98974291fdde32fe8488bc5d469 -> trunk/f981a7fa5230b98974291fdde32fe8488bc5d469 2025-09-07T06:39:15.3423919Z * [new tag] trunk/fbf3d2027daabbcb44d0af274b139be2a248a4f7 -> trunk/fbf3d2027daabbcb44d0af274b139be2a248a4f7 2025-09-07T06:39:15.3424050Z * [new tag] trunk/fca2601c9d628e1bd2d75c7318cd22c4e8c832aa -> trunk/fca2601c9d628e1bd2d75c7318cd22c4e8c832aa 2025-09-07T06:39:15.3424181Z * [new tag] trunk/fea20775ad96bdca972a1811d7d3372f368614ab -> trunk/fea20775ad96bdca972a1811d7d3372f368614ab 2025-09-07T06:39:15.3425322Z * [new tag] trunk/fefee081642f87419a21dc852f7167d4640443cd -> trunk/fefee081642f87419a21dc852f7167d4640443cd 2025-09-07T06:39:15.3425385Z * [new tag] v0.1.1 -> v0.1.1 2025-09-07T06:39:15.3425445Z * [new tag] v0.1.10 -> v0.1.10 2025-09-07T06:39:15.3425499Z * [new tag] v0.1.11 -> v0.1.11 2025-09-07T06:39:15.3425549Z * [new tag] v0.1.12 -> v0.1.12 2025-09-07T06:39:15.3425602Z * [new tag] v0.1.2 -> v0.1.2 2025-09-07T06:39:15.3425655Z * [new tag] v0.1.3 -> v0.1.3 2025-09-07T06:39:15.3425705Z * [new tag] v0.1.4 -> v0.1.4 2025-09-07T06:39:15.3425755Z * [new tag] v0.1.5 -> v0.1.5 2025-09-07T06:39:15.3425807Z * [new tag] v0.1.6 -> v0.1.6 2025-09-07T06:39:15.3425856Z * [new tag] v0.1.7 -> v0.1.7 2025-09-07T06:39:15.3425904Z * [new tag] v0.1.8 -> v0.1.8 2025-09-07T06:39:15.3426014Z * [new tag] v0.1.9 -> v0.1.9 2025-09-07T06:39:15.3426065Z * [new tag] v0.2.0 -> v0.2.0 2025-09-07T06:39:15.3426114Z * [new tag] v0.3.0 -> v0.3.0 2025-09-07T06:39:15.3426162Z * [new tag] v0.3.1 -> v0.3.1 2025-09-07T06:39:15.3426212Z * [new tag] v0.4.0 -> v0.4.0 2025-09-07T06:39:15.3426260Z * [new tag] v0.4.1 -> v0.4.1 2025-09-07T06:39:15.3426311Z * [new tag] v1.0.0 -> v1.0.0 2025-09-07T06:39:15.3426368Z * [new tag] v1.0.0a0 -> v1.0.0a0 2025-09-07T06:39:15.3426494Z * [new tag] v1.0.1 -> v1.0.1 2025-09-07T06:39:15.3426546Z * [new tag] v1.0rc0 -> v1.0rc0 2025-09-07T06:39:15.3426599Z * [new tag] v1.0rc1 -> v1.0rc1 2025-09-07T06:39:15.3426650Z * [new tag] v1.1.0 -> v1.1.0 2025-09-07T06:39:15.3427706Z * [new tag] v1.1.0a0 -> v1.1.0a0 2025-09-07T06:39:15.3427764Z * [new tag] v1.10.0 -> v1.10.0 2025-09-07T06:39:15.3427825Z * [new tag] v1.10.0-rc1 -> v1.10.0-rc1 2025-09-07T06:39:15.3427882Z * [new tag] v1.10.0-rc2 -> v1.10.0-rc2 2025-09-07T06:39:15.3427937Z * [new tag] v1.10.0-rc3 -> v1.10.0-rc3 2025-09-07T06:39:15.3427990Z * [new tag] v1.10.1 -> v1.10.1 2025-09-07T06:39:15.3428049Z * [new tag] v1.10.1-rc1 -> v1.10.1-rc1 2025-09-07T06:39:15.3428101Z * [new tag] v1.10.2 -> v1.10.2 2025-09-07T06:39:15.3428155Z * [new tag] v1.10.2-rc1 -> v1.10.2-rc1 2025-09-07T06:39:15.3428208Z * [new tag] v1.11.0 -> v1.11.0 2025-09-07T06:39:15.3428261Z * [new tag] v1.11.0-rc1 -> v1.11.0-rc1 2025-09-07T06:39:15.3428314Z * [new tag] v1.11.0-rc2 -> v1.11.0-rc2 2025-09-07T06:39:15.3428366Z * [new tag] v1.11.0-rc3 -> v1.11.0-rc3 2025-09-07T06:39:15.3428418Z * [new tag] v1.11.0-rc4 -> v1.11.0-rc4 2025-09-07T06:39:15.3428471Z * [new tag] v1.11.0-rc5 -> v1.11.0-rc5 2025-09-07T06:39:15.3428523Z * [new tag] v1.11.0-rc6 -> v1.11.0-rc6 2025-09-07T06:39:15.3428579Z * [new tag] v1.11.0-rc7 -> v1.11.0-rc7 2025-09-07T06:39:15.3428631Z * [new tag] v1.12.0 -> v1.12.0 2025-09-07T06:39:15.3428683Z * [new tag] v1.12.0-rc1 -> v1.12.0-rc1 2025-09-07T06:39:15.3428737Z * [new tag] v1.12.0-rc2 -> v1.12.0-rc2 2025-09-07T06:39:15.3428790Z * [new tag] v1.12.0-rc3 -> v1.12.0-rc3 2025-09-07T06:39:15.3428843Z * [new tag] v1.12.0-rc4 -> v1.12.0-rc4 2025-09-07T06:39:15.3428895Z * [new tag] v1.12.0-rc5 -> v1.12.0-rc5 2025-09-07T06:39:15.3428947Z * [new tag] v1.12.0-rc6 -> v1.12.0-rc6 2025-09-07T06:39:15.3429999Z * [new tag] v1.12.0-rc7 -> v1.12.0-rc7 2025-09-07T06:39:15.3430058Z * [new tag] v1.12.0-rc8 -> v1.12.0-rc8 2025-09-07T06:39:15.3430109Z * [new tag] v1.12.1 -> v1.12.1 2025-09-07T06:39:15.3430166Z * [new tag] v1.12.1-rc1 -> v1.12.1-rc1 2025-09-07T06:39:15.3430219Z * [new tag] v1.12.1-rc2 -> v1.12.1-rc2 2025-09-07T06:39:15.3430273Z * [new tag] v1.12.1-rc3 -> v1.12.1-rc3 2025-09-07T06:39:15.3430368Z * [new tag] v1.12.1-rc4 -> v1.12.1-rc4 2025-09-07T06:39:15.3430422Z * [new tag] v1.12.1-rc5 -> v1.12.1-rc5 2025-09-07T06:39:15.3430473Z * [new tag] v1.13.0 -> v1.13.0 2025-09-07T06:39:15.3430526Z * [new tag] v1.13.0-rc1 -> v1.13.0-rc1 2025-09-07T06:39:15.3430579Z * [new tag] v1.13.0-rc2 -> v1.13.0-rc2 2025-09-07T06:39:15.3430631Z * [new tag] v1.13.0-rc3 -> v1.13.0-rc3 2025-09-07T06:39:15.3430684Z * [new tag] v1.13.0-rc4 -> v1.13.0-rc4 2025-09-07T06:39:15.3430780Z * [new tag] v1.13.0-rc5 -> v1.13.0-rc5 2025-09-07T06:39:15.3430833Z * [new tag] v1.13.0-rc6 -> v1.13.0-rc6 2025-09-07T06:39:15.3430884Z * [new tag] v1.13.1 -> v1.13.1 2025-09-07T06:39:15.3430939Z * [new tag] v1.13.1-rc1 -> v1.13.1-rc1 2025-09-07T06:39:15.3430991Z * [new tag] v1.2.0 -> v1.2.0 2025-09-07T06:39:15.3431044Z * [new tag] v1.2.0a0 -> v1.2.0a0 2025-09-07T06:39:15.3431097Z * [new tag] v1.3.0 -> v1.3.0 2025-09-07T06:39:15.3431149Z * [new tag] v1.3.0a0 -> v1.3.0a0 2025-09-07T06:39:15.3431200Z * [new tag] v1.3.1 -> v1.3.1 2025-09-07T06:39:15.3431251Z * [new tag] v1.4.0 -> v1.4.0 2025-09-07T06:39:15.3431304Z * [new tag] v1.4.0a0 -> v1.4.0a0 2025-09-07T06:39:15.3431355Z * [new tag] v1.4.1 -> v1.4.1 2025-09-07T06:39:15.3432395Z * [new tag] v1.5.0 -> v1.5.0 2025-09-07T06:39:15.3432457Z * [new tag] v1.5.0-rc1 -> v1.5.0-rc1 2025-09-07T06:39:15.3432513Z * [new tag] v1.5.0-rc2 -> v1.5.0-rc2 2025-09-07T06:39:15.3432569Z * [new tag] v1.5.0-rc3 -> v1.5.0-rc3 2025-09-07T06:39:15.3432622Z * [new tag] v1.5.0-rc4 -> v1.5.0-rc4 2025-09-07T06:39:15.3432675Z * [new tag] v1.5.0-rc5 -> v1.5.0-rc5 2025-09-07T06:39:15.3432727Z * [new tag] v1.5.1 -> v1.5.1 2025-09-07T06:39:15.3432779Z * [new tag] v1.5.1-rc1 -> v1.5.1-rc1 2025-09-07T06:39:15.3432830Z * [new tag] v1.6.0 -> v1.6.0 2025-09-07T06:39:15.3432889Z * [new tag] v1.6.0-rc1 -> v1.6.0-rc1 2025-09-07T06:39:15.3432943Z * [new tag] v1.6.0-rc2 -> v1.6.0-rc2 2025-09-07T06:39:15.3432996Z * [new tag] v1.6.0-rc3 -> v1.6.0-rc3 2025-09-07T06:39:15.3433050Z * [new tag] v1.6.0-rc4 -> v1.6.0-rc4 2025-09-07T06:39:15.3433187Z * [new tag] v1.6.0-rc5 -> v1.6.0-rc5 2025-09-07T06:39:15.3433240Z * [new tag] v1.6.0-rc6 -> v1.6.0-rc6 2025-09-07T06:39:15.3433292Z * [new tag] v1.6.0-rc7 -> v1.6.0-rc7 2025-09-07T06:39:15.3433344Z * [new tag] v1.7.0 -> v1.7.0 2025-09-07T06:39:15.3433397Z * [new tag] v1.7.0-rc1 -> v1.7.0-rc1 2025-09-07T06:39:15.3433450Z * [new tag] v1.7.0-rc2 -> v1.7.0-rc2 2025-09-07T06:39:15.3433504Z * [new tag] v1.7.0-rc3 -> v1.7.0-rc3 2025-09-07T06:39:15.3433557Z * [new tag] v1.7.0-rc4 -> v1.7.0-rc4 2025-09-07T06:39:15.3433608Z * [new tag] v1.7.1 -> v1.7.1 2025-09-07T06:39:15.3433727Z * [new tag] v1.7.1-rc1 -> v1.7.1-rc1 2025-09-07T06:39:15.3433781Z * [new tag] v1.7.1-rc2 -> v1.7.1-rc2 2025-09-07T06:39:15.3434829Z * [new tag] v1.7.1-rc3 -> v1.7.1-rc3 2025-09-07T06:39:15.3434886Z * [new tag] v1.8.0 -> v1.8.0 2025-09-07T06:39:15.3434939Z * [new tag] v1.8.0-rc1 -> v1.8.0-rc1 2025-09-07T06:39:15.3434992Z * [new tag] v1.8.0-rc2 -> v1.8.0-rc2 2025-09-07T06:39:15.3435044Z * [new tag] v1.8.0-rc3 -> v1.8.0-rc3 2025-09-07T06:39:15.3435170Z * [new tag] v1.8.0-rc4 -> v1.8.0-rc4 2025-09-07T06:39:15.3435222Z * [new tag] v1.8.0-rc5 -> v1.8.0-rc5 2025-09-07T06:39:15.3435273Z * [new tag] v1.8.1 -> v1.8.1 2025-09-07T06:39:15.3435329Z * [new tag] v1.8.1-rc1 -> v1.8.1-rc1 2025-09-07T06:39:15.3435383Z * [new tag] v1.8.1-rc2 -> v1.8.1-rc2 2025-09-07T06:39:15.3435435Z * [new tag] v1.8.1-rc3 -> v1.8.1-rc3 2025-09-07T06:39:15.3435487Z * [new tag] v1.8.2 -> v1.8.2 2025-09-07T06:39:15.3435539Z * [new tag] v1.8.2-rc1 -> v1.8.2-rc1 2025-09-07T06:39:15.3435590Z * [new tag] v1.9.0 -> v1.9.0 2025-09-07T06:39:15.3435643Z * [new tag] v1.9.0-rc1 -> v1.9.0-rc1 2025-09-07T06:39:15.3435696Z * [new tag] v1.9.0-rc2 -> v1.9.0-rc2 2025-09-07T06:39:15.3435749Z * [new tag] v1.9.0-rc3 -> v1.9.0-rc3 2025-09-07T06:39:15.3435802Z * [new tag] v1.9.0-rc4 -> v1.9.0-rc4 2025-09-07T06:39:15.3435853Z * [new tag] v1.9.1 -> v1.9.1 2025-09-07T06:39:15.3435907Z * [new tag] v1.9.1-rc1 -> v1.9.1-rc1 2025-09-07T06:39:15.3435959Z * [new tag] v1.9.1-rc2 -> v1.9.1-rc2 2025-09-07T06:39:15.3436011Z * [new tag] v2.0.0 -> v2.0.0 2025-09-07T06:39:15.3436063Z * [new tag] v2.0.0-rc1 -> v2.0.0-rc1 2025-09-07T06:39:15.3436116Z * [new tag] v2.0.0-rc2 -> v2.0.0-rc2 2025-09-07T06:39:15.3437155Z * [new tag] v2.0.0-rc3 -> v2.0.0-rc3 2025-09-07T06:39:15.3437212Z * [new tag] v2.0.0-rc4 -> v2.0.0-rc4 2025-09-07T06:39:15.3437270Z * [new tag] v2.0.0-rc5 -> v2.0.0-rc5 2025-09-07T06:39:15.3437323Z * [new tag] v2.0.0-rc6 -> v2.0.0-rc6 2025-09-07T06:39:15.3437374Z * [new tag] v2.0.1 -> v2.0.1 2025-09-07T06:39:15.3437430Z * [new tag] v2.0.1-rc1 -> v2.0.1-rc1 2025-09-07T06:39:15.3437483Z * [new tag] v2.0.1-rc2 -> v2.0.1-rc2 2025-09-07T06:39:15.3437536Z * [new tag] v2.0.1-rc3 -> v2.0.1-rc3 2025-09-07T06:39:15.3437588Z * [new tag] v2.0.1-rc4 -> v2.0.1-rc4 2025-09-07T06:39:15.3437640Z * [new tag] v2.1.0 -> v2.1.0 2025-09-07T06:39:15.3437693Z * [new tag] v2.1.0-rc1 -> v2.1.0-rc1 2025-09-07T06:39:15.3437745Z * [new tag] v2.1.0-rc2 -> v2.1.0-rc2 2025-09-07T06:39:15.3437801Z * [new tag] v2.1.0-rc3 -> v2.1.0-rc3 2025-09-07T06:39:15.3437854Z * [new tag] v2.1.0-rc4 -> v2.1.0-rc4 2025-09-07T06:39:15.3437907Z * [new tag] v2.1.0-rc5 -> v2.1.0-rc5 2025-09-07T06:39:15.3438001Z * [new tag] v2.1.0-rc6 -> v2.1.0-rc6 2025-09-07T06:39:15.3438054Z * [new tag] v2.1.1 -> v2.1.1 2025-09-07T06:39:15.3438107Z * [new tag] v2.1.1-rc1 -> v2.1.1-rc1 2025-09-07T06:39:15.3438159Z * [new tag] v2.1.1-rc2 -> v2.1.1-rc2 2025-09-07T06:39:15.3438212Z * [new tag] v2.1.1-rc3 -> v2.1.1-rc3 2025-09-07T06:39:15.3438264Z * [new tag] v2.1.1-rc4 -> v2.1.1-rc4 2025-09-07T06:39:15.3438317Z * [new tag] v2.1.1-rc5 -> v2.1.1-rc5 2025-09-07T06:39:15.3438370Z * [new tag] v2.1.1-rc6 -> v2.1.1-rc6 2025-09-07T06:39:15.3438456Z * [new tag] v2.1.2 -> v2.1.2 2025-09-07T06:39:15.3438509Z * [new tag] v2.1.2-rc1 -> v2.1.2-rc1 2025-09-07T06:39:15.3439557Z * [new tag] v2.1.2-rc2 -> v2.1.2-rc2 2025-09-07T06:39:15.3439616Z * [new tag] v2.1.2-rc3 -> v2.1.2-rc3 2025-09-07T06:39:15.3439668Z * [new tag] v2.2.0 -> v2.2.0 2025-09-07T06:39:15.3439722Z * [new tag] v2.2.0-rc1 -> v2.2.0-rc1 2025-09-07T06:39:15.3439774Z * [new tag] v2.2.0-rc2 -> v2.2.0-rc2 2025-09-07T06:39:15.3439826Z * [new tag] v2.2.0-rc3 -> v2.2.0-rc3 2025-09-07T06:39:15.3439878Z * [new tag] v2.2.0-rc4 -> v2.2.0-rc4 2025-09-07T06:39:15.3439931Z * [new tag] v2.2.0-rc5 -> v2.2.0-rc5 2025-09-07T06:39:15.3439988Z * [new tag] v2.2.0-rc6 -> v2.2.0-rc6 2025-09-07T06:39:15.3440039Z * [new tag] v2.2.0-rc7 -> v2.2.0-rc7 2025-09-07T06:39:15.3440092Z * [new tag] v2.2.0-rc8 -> v2.2.0-rc8 2025-09-07T06:39:15.3440145Z * [new tag] v2.2.1 -> v2.2.1 2025-09-07T06:39:15.3440198Z * [new tag] v2.2.1-rc1 -> v2.2.1-rc1 2025-09-07T06:39:15.3440252Z * [new tag] v2.2.1-rc2 -> v2.2.1-rc2 2025-09-07T06:39:15.3440303Z * [new tag] v2.2.1-rc3 -> v2.2.1-rc3 2025-09-07T06:39:15.3440354Z * [new tag] v2.2.2 -> v2.2.2 2025-09-07T06:39:15.3440407Z * [new tag] v2.2.2-rc1 -> v2.2.2-rc1 2025-09-07T06:39:15.3440460Z * [new tag] v2.2.2-rc2 -> v2.2.2-rc2 2025-09-07T06:39:15.3440514Z * [new tag] v2.2.2-rc3 -> v2.2.2-rc3 2025-09-07T06:39:15.3440566Z * [new tag] v2.3.0 -> v2.3.0 2025-09-07T06:39:15.3440619Z * [new tag] v2.3.0-rc1 -> v2.3.0-rc1 2025-09-07T06:39:15.3440676Z * [new tag] v2.3.0-rc10 -> v2.3.0-rc10 2025-09-07T06:39:15.3440731Z * [new tag] v2.3.0-rc11 -> v2.3.0-rc11 2025-09-07T06:39:15.3440785Z * [new tag] v2.3.0-rc12 -> v2.3.0-rc12 2025-09-07T06:39:15.3441828Z * [new tag] v2.3.0-rc2 -> v2.3.0-rc2 2025-09-07T06:39:15.3441888Z * [new tag] v2.3.0-rc3 -> v2.3.0-rc3 2025-09-07T06:39:15.3441941Z * [new tag] v2.3.0-rc4 -> v2.3.0-rc4 2025-09-07T06:39:15.3441994Z * [new tag] v2.3.0-rc5 -> v2.3.0-rc5 2025-09-07T06:39:15.3442050Z * [new tag] v2.3.0-rc6 -> v2.3.0-rc6 2025-09-07T06:39:15.3442104Z * [new tag] v2.3.0-rc7 -> v2.3.0-rc7 2025-09-07T06:39:15.3442155Z * [new tag] v2.3.0-rc8 -> v2.3.0-rc8 2025-09-07T06:39:15.3442252Z * [new tag] v2.3.0-rc9 -> v2.3.0-rc9 2025-09-07T06:39:15.3442305Z * [new tag] v2.3.1 -> v2.3.1 2025-09-07T06:39:15.3442357Z * [new tag] v2.3.1-rc1 -> v2.3.1-rc1 2025-09-07T06:39:15.3442410Z * [new tag] v2.3.1-rc2 -> v2.3.1-rc2 2025-09-07T06:39:15.3442463Z * [new tag] v2.3.1-rc3 -> v2.3.1-rc3 2025-09-07T06:39:15.3442513Z * [new tag] v2.4.0 -> v2.4.0 2025-09-07T06:39:15.3442565Z * [new tag] v2.4.0-rc1 -> v2.4.0-rc1 2025-09-07T06:39:15.3442619Z * [new tag] v2.4.0-rc2 -> v2.4.0-rc2 2025-09-07T06:39:15.3442712Z * [new tag] v2.4.0-rc3 -> v2.4.0-rc3 2025-09-07T06:39:15.3442764Z * [new tag] v2.4.0-rc4 -> v2.4.0-rc4 2025-09-07T06:39:15.3442815Z * [new tag] v2.4.0-rc5 -> v2.4.0-rc5 2025-09-07T06:39:15.3442870Z * [new tag] v2.4.0-rc6 -> v2.4.0-rc6 2025-09-07T06:39:15.3442922Z * [new tag] v2.4.0-rc7 -> v2.4.0-rc7 2025-09-07T06:39:15.3442974Z * [new tag] v2.4.0-rc8 -> v2.4.0-rc8 2025-09-07T06:39:15.3443027Z * [new tag] v2.4.0-rc9 -> v2.4.0-rc9 2025-09-07T06:39:15.3443142Z * [new tag] v2.4.1 -> v2.4.1 2025-09-07T06:39:15.3443197Z * [new tag] v2.4.1-rc1 -> v2.4.1-rc1 2025-09-07T06:39:15.3444244Z * [new tag] v2.4.1-rc2 -> v2.4.1-rc2 2025-09-07T06:39:15.3444305Z * [new tag] v2.4.1-rc3 -> v2.4.1-rc3 2025-09-07T06:39:15.3444357Z * [new tag] v2.5.0 -> v2.5.0 2025-09-07T06:39:15.3444411Z * [new tag] v2.5.0-rc1 -> v2.5.0-rc1 2025-09-07T06:39:15.3444468Z * [new tag] v2.5.0-rc10 -> v2.5.0-rc10 2025-09-07T06:39:15.3444521Z * [new tag] v2.5.0-rc2 -> v2.5.0-rc2 2025-09-07T06:39:15.3444574Z * [new tag] v2.5.0-rc3 -> v2.5.0-rc3 2025-09-07T06:39:15.3444626Z * [new tag] v2.5.0-rc4 -> v2.5.0-rc4 2025-09-07T06:39:15.3444679Z * [new tag] v2.5.0-rc5 -> v2.5.0-rc5 2025-09-07T06:39:15.3444732Z * [new tag] v2.5.0-rc6 -> v2.5.0-rc6 2025-09-07T06:39:15.3444784Z * [new tag] v2.5.0-rc7 -> v2.5.0-rc7 2025-09-07T06:39:15.3444839Z * [new tag] v2.5.0-rc8 -> v2.5.0-rc8 2025-09-07T06:39:15.3444891Z * [new tag] v2.5.0-rc9 -> v2.5.0-rc9 2025-09-07T06:39:15.3444943Z * [new tag] v2.5.1 -> v2.5.1 2025-09-07T06:39:15.3444997Z * [new tag] v2.5.1-rc1 -> v2.5.1-rc1 2025-09-07T06:39:15.3445048Z * [new tag] v2.6.0 -> v2.6.0 2025-09-07T06:39:15.3445103Z * [new tag] v2.6.0-rc1 -> v2.6.0-rc1 2025-09-07T06:39:15.3445155Z * [new tag] v2.6.0-rc2 -> v2.6.0-rc2 2025-09-07T06:39:15.3445207Z * [new tag] v2.6.0-rc3 -> v2.6.0-rc3 2025-09-07T06:39:15.3445260Z * [new tag] v2.6.0-rc4 -> v2.6.0-rc4 2025-09-07T06:39:15.3445312Z * [new tag] v2.6.0-rc5 -> v2.6.0-rc5 2025-09-07T06:39:15.3445364Z * [new tag] v2.6.0-rc6 -> v2.6.0-rc6 2025-09-07T06:39:15.3445419Z * [new tag] v2.6.0-rc7 -> v2.6.0-rc7 2025-09-07T06:39:15.3445471Z * [new tag] v2.6.0-rc8 -> v2.6.0-rc8 2025-09-07T06:39:15.3445523Z * [new tag] v2.6.0-rc9 -> v2.6.0-rc9 2025-09-07T06:39:15.3446656Z * [new tag] v2.7.0 -> v2.7.0 2025-09-07T06:39:15.3446715Z * [new tag] v2.7.0-rc1 -> v2.7.0-rc1 2025-09-07T06:39:15.3446769Z * [new tag] v2.7.0-rc10 -> v2.7.0-rc10 2025-09-07T06:39:15.3446821Z * [new tag] v2.7.0-rc2 -> v2.7.0-rc2 2025-09-07T06:39:15.3446874Z * [new tag] v2.7.0-rc3 -> v2.7.0-rc3 2025-09-07T06:39:15.3446926Z * [new tag] v2.7.0-rc4 -> v2.7.0-rc4 2025-09-07T06:39:15.3446978Z * [new tag] v2.7.0-rc5 -> v2.7.0-rc5 2025-09-07T06:39:15.3447096Z * [new tag] v2.7.0-rc6 -> v2.7.0-rc6 2025-09-07T06:39:15.3447148Z * [new tag] v2.7.0-rc7 -> v2.7.0-rc7 2025-09-07T06:39:15.3447200Z * [new tag] v2.7.0-rc8 -> v2.7.0-rc8 2025-09-07T06:39:15.3447255Z * [new tag] v2.7.0-rc9 -> v2.7.0-rc9 2025-09-07T06:39:15.3447305Z * [new tag] v2.7.1 -> v2.7.1 2025-09-07T06:39:15.3447358Z * [new tag] v2.7.1-rc1 -> v2.7.1-rc1 2025-09-07T06:39:15.3447411Z * [new tag] v2.7.1-rc2 -> v2.7.1-rc2 2025-09-07T06:39:15.3447464Z * [new tag] v2.7.1-rc3 -> v2.7.1-rc3 2025-09-07T06:39:15.3447516Z * [new tag] v2.7.1-rc4 -> v2.7.1-rc4 2025-09-07T06:39:15.3447569Z * [new tag] v2.7.1-rc5 -> v2.7.1-rc5 2025-09-07T06:39:15.3447621Z * [new tag] v2.8.0 -> v2.8.0 2025-09-07T06:39:15.3447673Z * [new tag] v2.8.0-rc1 -> v2.8.0-rc1 2025-09-07T06:39:15.3447726Z * [new tag] v2.8.0-rc2 -> v2.8.0-rc2 2025-09-07T06:39:15.3447780Z * [new tag] v2.8.0-rc3 -> v2.8.0-rc3 2025-09-07T06:39:15.3447832Z * [new tag] v2.8.0-rc4 -> v2.8.0-rc4 2025-09-07T06:39:15.3447884Z * [new tag] v2.8.0-rc5 -> v2.8.0-rc5 2025-09-07T06:39:15.3447937Z * [new tag] v2.8.0-rc6 -> v2.8.0-rc6 2025-09-07T06:39:15.3449086Z * [new tag] v2.8.0-rc7 -> v2.8.0-rc7 2025-09-07T06:39:15.3449144Z * [new tag] v2.8.0-rc8 -> v2.8.0-rc8 2025-09-07T06:39:15.3449205Z * [new tag] whc_flight_1 -> whc_flight_1 2025-09-07T06:39:15.3449268Z * [new tag] whc_flight_2 -> whc_flight_2 2025-09-07T06:39:15.3449325Z * [new tag] whc_flight_4 -> whc_flight_4 2025-09-07T06:39:15.5971047Z [command]/usr/bin/git rev-parse --verify --quiet 93fb23d6fae7c4e82c4239a1033e522088742634^{object} 2025-09-07T06:39:15.6004113Z 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:39:15.6004826Z ##[endgroup] 2025-09-07T06:39:15.6004986Z ##[group]Determining the checkout info 2025-09-07T06:39:15.6005554Z ##[endgroup] 2025-09-07T06:39:15.6008821Z [command]/usr/bin/git sparse-checkout disable 2025-09-07T06:39:15.6033618Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig 2025-09-07T06:39:15.6057509Z ##[group]Checking out the ref 2025-09-07T06:39:15.6059530Z [command]/usr/bin/git checkout --progress --force 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:39:16.2643210Z Note: switching to '93fb23d6fae7c4e82c4239a1033e522088742634'. 2025-09-07T06:39:16.2643615Z 2025-09-07T06:39:16.2643994Z You are in 'detached HEAD' state. You can look around, make experimental 2025-09-07T06:39:16.2644531Z changes and commit them, and you can discard any commits you make in this 2025-09-07T06:39:16.2645082Z state without impacting any branches by switching back to a branch. 2025-09-07T06:39:16.2645394Z 2025-09-07T06:39:16.2646099Z If you want to create a new branch to retain commits you create, you may 2025-09-07T06:39:16.2646599Z do so (now or later) by using -c with the switch command. Example: 2025-09-07T06:39:16.2646886Z 2025-09-07T06:39:16.2647023Z git switch -c 2025-09-07T06:39:16.2647235Z 2025-09-07T06:39:16.2647359Z Or undo this operation with: 2025-09-07T06:39:16.2647631Z 2025-09-07T06:39:16.2647733Z git switch - 2025-09-07T06:39:16.2647873Z 2025-09-07T06:39:16.2648125Z Turn off this advice by setting config variable advice.detachedHead to false 2025-09-07T06:39:16.2648623Z 2025-09-07T06:39:16.2648818Z HEAD is now at 93fb23d6fae Build vLLM nightly wheels (#162000) 2025-09-07T06:39:16.2692850Z ##[endgroup] 2025-09-07T06:39:16.2693162Z ##[group]Setting up auth for fetching submodules 2025-09-07T06:39:16.2698930Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-09-07T06:39:16.2738891Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2025-09-07T06:39:16.2767198Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2025-09-07T06:39:16.2794638Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2025-09-07T06:39:16.2817092Z ##[endgroup] 2025-09-07T06:39:16.2817257Z ##[group]Fetching submodules 2025-09-07T06:39:16.2819308Z [command]/usr/bin/git submodule sync --recursive 2025-09-07T06:39:16.3076702Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2025-09-07T06:39:16.3290349Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2025-09-07T06:39:16.3293858Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2025-09-07T06:39:16.3295684Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2025-09-07T06:39:16.3297663Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2025-09-07T06:39:16.3303532Z Submodule 'third_party/NVTX' (https://github.com/NVIDIA/NVTX.git) registered for path 'third_party/NVTX' 2025-09-07T06:39:16.3303990Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2025-09-07T06:39:16.3304410Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2025-09-07T06:39:16.3305405Z Submodule 'third_party/aiter' (https://github.com/ROCm/aiter.git) registered for path 'third_party/aiter' 2025-09-07T06:39:16.3307459Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2025-09-07T06:39:16.3311188Z Submodule 'third_party/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/composable_kernel' 2025-09-07T06:39:16.3312411Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2025-09-07T06:39:16.3313530Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2025-09-07T06:39:16.3315383Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2025-09-07T06:39:16.3317235Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2025-09-07T06:39:16.3319071Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2025-09-07T06:39:16.3321131Z Submodule 'third_party/flash-attention' (https://github.com/Dao-AILab/flash-attention.git) registered for path 'third_party/flash-attention' 2025-09-07T06:39:16.3327975Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2025-09-07T06:39:16.3328451Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2025-09-07T06:39:16.3328804Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2025-09-07T06:39:16.3329166Z Submodule 'third_party/gloo' (https://github.com/pytorch/gloo) registered for path 'third_party/gloo' 2025-09-07T06:39:16.3331383Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2025-09-07T06:39:16.3333342Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2025-09-07T06:39:16.3335496Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2025-09-07T06:39:16.3337550Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2025-09-07T06:39:16.3339580Z Submodule 'third_party/kleidiai' (https://github.com/ARM-software/kleidiai.git) registered for path 'third_party/kleidiai' 2025-09-07T06:39:16.3341657Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2025-09-07T06:39:16.3343906Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2025-09-07T06:39:16.3345941Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2025-09-07T06:39:16.3348228Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2025-09-07T06:39:16.3350357Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2025-09-07T06:39:16.3352538Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2025-09-07T06:39:16.3356875Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2025-09-07T06:39:16.3357295Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2025-09-07T06:39:16.3359584Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2025-09-07T06:39:16.3361996Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2025-09-07T06:39:16.3364593Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2025-09-07T06:39:16.3366898Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2025-09-07T06:39:16.3385771Z Cloning into '/home/runner/_work/pytorch/pytorch/android/libs/fbjni'... 2025-09-07T06:39:17.9955056Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/FXdiv'... 2025-09-07T06:39:17.9955678Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/psimd'... 2025-09-07T06:39:17.9966072Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/FP16'... 2025-09-07T06:39:17.9966284Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2025-09-07T06:39:17.9966503Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/pocketfft'... 2025-09-07T06:39:17.9966713Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/NNPACK'... 2025-09-07T06:39:17.9966966Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2025-09-07T06:39:17.9967177Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/ideep'... 2025-09-07T06:39:17.9967466Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2025-09-07T06:39:17.9968028Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/gloo'... 2025-09-07T06:39:17.9968218Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/NVTX'... 2025-09-07T06:39:17.9968614Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/benchmark'... 2025-09-07T06:39:17.9968814Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2025-09-07T06:39:17.9969015Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/ittapi'... 2025-09-07T06:39:17.9971543Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kleidiai'... 2025-09-07T06:39:17.9971760Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2025-09-07T06:39:17.9972208Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/flash-attention'... 2025-09-07T06:39:17.9972489Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2025-09-07T06:39:17.9972692Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/sleef'... 2025-09-07T06:39:17.9972890Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/googletest'... 2025-09-07T06:39:17.9973268Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/mimalloc'... 2025-09-07T06:39:17.9973462Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fmt'... 2025-09-07T06:39:17.9994981Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2025-09-07T06:39:18.1489949Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/pybind11'... 2025-09-07T06:39:18.1490218Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2025-09-07T06:39:18.1974648Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2025-09-07T06:39:25.4475345Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto'... 2025-09-07T06:39:25.4475620Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2025-09-07T06:39:25.4475870Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm'... 2025-09-07T06:39:25.4476067Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/cutlass'... 2025-09-07T06:39:25.4476288Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/onnx'... 2025-09-07T06:39:25.4476493Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/composable_kernel'... 2025-09-07T06:39:25.4487900Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/aiter'... 2025-09-07T06:39:25.4488178Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2025-09-07T06:39:25.4488559Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/nlohmann'... 2025-09-07T06:39:25.4488784Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/protobuf'... 2025-09-07T06:39:25.4572114Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2025-09-07T06:39:25.4652452Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2025-09-07T06:39:25.4720716Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2025-09-07T06:39:25.4851206Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2025-09-07T06:39:25.5279546Z Submodule path 'third_party/NVTX': checked out '2942f167cc30c5e3a44a2aecd5b0d9c07ff61a07' 2025-09-07T06:39:25.5531704Z Submodule path 'third_party/VulkanMemoryAllocator': checked out '1d8f600fd424278486eade7ed3e877c99f0846b1' 2025-09-07T06:39:25.8779508Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883' 2025-09-07T06:39:25.9557684Z Submodule path 'third_party/aiter': checked out '01aae101b9e5e94d6c16a9514c9fb8df99c93150' 2025-09-07T06:39:25.9580795Z Submodule '3rdparty/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T06:39:25.9612789Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/aiter/3rdparty/composable_kernel'... 2025-09-07T06:39:28.6526343Z Submodule path 'third_party/aiter/3rdparty/composable_kernel': checked out 'cffe8fa2a442ac8e80dd236a1a5d24fe3d7e0cbf' 2025-09-07T06:39:28.6681454Z Submodule path 'third_party/benchmark': checked out '299e5928955cc62af9968370293b916f5130916f' 2025-09-07T06:39:28.8156955Z Submodule path 'third_party/composable_kernel': checked out '7fe50dc3da2069d6645d9deb8c017a876472a977' 2025-09-07T06:39:28.8447058Z Submodule path 'third_party/cpp-httplib': checked out '89c932f313c6437c38f2982869beacc89c2f2246' 2025-09-07T06:39:28.8998043Z Submodule path 'third_party/cpuinfo': checked out '5e3d2445e6a84d9599bee2bf78edbb4d80865e1d' 2025-09-07T06:39:28.9269976Z Submodule path 'third_party/cudnn_frontend': checked out 'f937055efc6d414d11f4c6577e3977fe74f35fb6' 2025-09-07T06:39:29.2314202Z Submodule path 'third_party/cutlass': checked out 'e51efbfe18fe4f4cbb66ab814c55bf4aa0185491' 2025-09-07T06:39:29.3065612Z Submodule path 'third_party/fbgemm': checked out '4b39c551efe15e6bbade20565b0ceb2d8ce3352d' 2025-09-07T06:39:29.3077046Z Submodule 'external/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/external/asmjit' 2025-09-07T06:39:29.3079021Z Submodule 'external/composable_kernel' (https://github.com/jwfromm/composable_kernel.git) registered for path 'third_party/fbgemm/external/composable_kernel' 2025-09-07T06:39:29.3080963Z Submodule 'external/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/external/cpuinfo' 2025-09-07T06:39:29.3082773Z Submodule 'external/cutlass' (https://github.com/jwfromm/cutlass) registered for path 'third_party/fbgemm/external/cutlass' 2025-09-07T06:39:29.3084753Z Submodule 'external/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/external/googletest' 2025-09-07T06:39:29.3086389Z Submodule 'external/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/external/hipify_torch' 2025-09-07T06:39:29.3088260Z Submodule 'external/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/fbgemm/external/json' 2025-09-07T06:39:29.3109623Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm/external/asmjit'... 2025-09-07T06:39:30.3920491Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm/external/hipify_torch'... 2025-09-07T06:39:30.3921267Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm/external/cpuinfo'... 2025-09-07T06:39:30.3921960Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm/external/googletest'... 2025-09-07T06:39:30.4921107Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm/external/composable_kernel'... 2025-09-07T06:39:30.4921912Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm/external/cutlass'... 2025-09-07T06:39:30.7410953Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/fbgemm/external/json'... 2025-09-07T06:39:32.6312078Z Submodule path 'third_party/fbgemm/external/asmjit': checked out 'a3199e8857792cd10b7589ff5d58343d2c9008ea' 2025-09-07T06:39:32.7493642Z Submodule path 'third_party/fbgemm/external/composable_kernel': checked out 'b1281b8b08d973a7064f864f47eeb30f3e2596e9' 2025-09-07T06:39:32.8060662Z Submodule path 'third_party/fbgemm/external/cpuinfo': checked out '6543fec09b2f04ac4a666882998b534afc9c1349' 2025-09-07T06:39:33.1167854Z Submodule path 'third_party/fbgemm/external/cutlass': checked out '311f3c8e51dc0eb56310cfc6980bf63d0fbd7917' 2025-09-07T06:39:33.1408130Z Submodule path 'third_party/fbgemm/external/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-09-07T06:39:33.1488886Z Submodule path 'third_party/fbgemm/external/hipify_torch': checked out '63b6a7b541fa7f08f8475ca7d74054db36ff2691' 2025-09-07T06:39:33.2035994Z Submodule path 'third_party/fbgemm/external/json': checked out '9cca280a4d0ccf0c08f47a99aa71d1b0e52f8d03' 2025-09-07T06:39:33.2396012Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5' 2025-09-07T06:39:33.2411374Z Submodule 'csrc/composable_kernel' (https://github.com/ROCm/composable_kernel.git) registered for path 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T06:39:33.2413939Z Submodule 'csrc/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/flash-attention/csrc/cutlass' 2025-09-07T06:39:33.2430862Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/flash-attention/csrc/composable_kernel'... 2025-09-07T06:39:35.8273362Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/flash-attention/csrc/cutlass'... 2025-09-07T06:39:35.9444220Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33' 2025-09-07T06:39:36.2519019Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420' 2025-09-07T06:39:36.3565278Z Submodule path 'third_party/flatbuffers': checked out 'a2cd1ea3b6d3fee220106b5fed3f7ce8da9eb757' 2025-09-07T06:39:36.3938352Z Submodule path 'third_party/fmt': checked out '40626af88bd7df9a5fb80be7b25ac85b122d6c21' 2025-09-07T06:39:36.4221764Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2025-09-07T06:39:36.4563455Z Submodule path 'third_party/gloo': checked out 'c7b7b022c124d9643957d9bd55f57ac59fce8fa2' 2025-09-07T06:39:36.4814635Z Submodule path 'third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-09-07T06:39:36.4887475Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3' 2025-09-07T06:39:36.4896008Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2025-09-07T06:39:36.4918236Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2025-09-07T06:39:44.8648046Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d' 2025-09-07T06:39:44.8786393Z Submodule path 'third_party/ittapi': checked out 'dec1d23ca65ab069d225dfe40dea14f455170959' 2025-09-07T06:39:44.9311307Z Submodule path 'third_party/kineto': checked out '5e7501833f1021ce6f618572d3baf657b6319658' 2025-09-07T06:39:44.9330651Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T06:39:44.9331473Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T06:39:44.9339556Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T06:39:44.9358419Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2025-09-07T06:39:45.6120636Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2025-09-07T06:39:45.7770307Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2025-09-07T06:39:45.8233830Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2025-09-07T06:39:45.8247771Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T06:39:45.8249060Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T06:39:45.8251439Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T06:39:45.8252699Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T06:39:45.8255097Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T06:39:45.8262583Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T06:39:45.8263331Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T06:39:45.8263860Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T06:39:45.8287571Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2025-09-07T06:39:46.9557463Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2025-09-07T06:39:46.9558507Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2025-09-07T06:39:46.9559428Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2025-09-07T06:39:46.9560322Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2025-09-07T06:39:46.9561244Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2025-09-07T06:39:46.9562173Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2025-09-07T06:39:47.0557199Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2025-09-07T06:39:49.2195292Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2025-09-07T06:39:49.2329506Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2025-09-07T06:39:49.2590464Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2025-09-07T06:39:49.2682706Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2025-09-07T06:39:49.2702587Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T06:39:49.2725003Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2025-09-07T06:39:49.6859651Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2025-09-07T06:39:49.6980499Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2025-09-07T06:39:49.7216365Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2025-09-07T06:39:49.7726178Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2025-09-07T06:39:49.7827032Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2025-09-07T06:39:49.8056312Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2025-09-07T06:39:49.8377750Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2025-09-07T06:39:49.8615260Z Submodule path 'third_party/kleidiai': checked out 'cca02c2f69dd18e1f12647c1c0bdc8cf90e680c7' 2025-09-07T06:39:49.8827136Z Submodule path 'third_party/mimalloc': checked out 'fbd8b99c2b828428947d70fdc046bb55609be93e' 2025-09-07T06:39:49.9412710Z Submodule path 'third_party/nlohmann': checked out '55f93686c01528224f448c19128836e7df245f72' 2025-09-07T06:39:50.1593446Z Submodule path 'third_party/onnx': checked out 'e709452ef2bbc1d113faf678c24e6d3467696e83' 2025-09-07T06:39:50.1620173Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2025-09-07T06:39:50.1654117Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2025-09-07T06:39:51.0330089Z Submodule path 'third_party/onnx/third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2025-09-07T06:39:51.0709699Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2025-09-07T06:39:51.0731495Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T06:39:51.0731936Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T06:39:51.0733470Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T06:39:51.0735211Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T06:39:51.0737066Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T06:39:51.0738788Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T06:39:51.0745992Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T06:39:51.0746449Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T06:39:51.0771576Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2025-09-07T06:39:51.5804548Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2025-09-07T06:39:51.5804973Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2025-09-07T06:39:51.5805277Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2025-09-07T06:39:51.6804084Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2025-09-07T06:39:51.6804601Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2025-09-07T06:39:51.9776688Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2025-09-07T06:39:54.5303925Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2025-09-07T06:39:56.7324667Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2025-09-07T06:39:56.7555099Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2025-09-07T06:39:56.7656487Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2025-09-07T06:39:56.8198144Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2025-09-07T06:39:56.8312025Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2025-09-07T06:39:56.8397299Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2025-09-07T06:39:56.8498194Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2025-09-07T06:39:56.8509563Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T06:39:56.8511266Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T06:39:56.8534618Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2025-09-07T06:39:58.1987937Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2025-09-07T06:39:58.3337789Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2025-09-07T06:39:58.3604363Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-09-07T06:39:58.5650929Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2025-09-07T06:39:58.5750750Z Submodule path 'third_party/pocketfft': checked out '0fa0ef591e38c2758e3184c6c23e497b9f732ffa' 2025-09-07T06:39:58.7228618Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2025-09-07T06:39:58.7253950Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2025-09-07T06:39:58.7254377Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2025-09-07T06:39:58.7285798Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2025-09-07T06:39:59.3279163Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2025-09-07T06:39:59.4742876Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2025-09-07T06:39:59.5229939Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2025-09-07T06:39:59.5641087Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2025-09-07T06:39:59.5817765Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2025-09-07T06:39:59.6089639Z Submodule path 'third_party/pybind11': checked out 'f5fbe867d2d26e4a0a9177a51f6e568868ad3dc8' 2025-09-07T06:39:59.6279922Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2025-09-07T06:39:59.6567536Z Submodule path 'third_party/sleef': checked out '5a1d179df9cf652951b59010a2d2075372d67f68' 2025-09-07T06:39:59.6789363Z Submodule path 'third_party/tensorpipe': checked out 'af0118d13e52f5a08841464a768e01a0bf3e3075' 2025-09-07T06:39:59.6936576Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2025-09-07T06:39:59.6945113Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2025-09-07T06:39:59.7016252Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2025-09-07T06:39:59.7081339Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T06:39:59.7114645Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2025-09-07T06:40:00.5170121Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2025-09-07T06:40:00.5829587Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2025-09-07T06:40:00.7603603Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2025-09-07T06:40:00.7944304Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2025-09-07T06:40:00.8039520Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2025-09-07T06:40:00.8421685Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '5152db2cbfeb5582e9c27c5ea1dba2cd9e10759b' 2025-09-07T06:40:00.8575558Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2025-09-07T06:40:00.8589761Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T06:40:00.8608169Z Cloning into '/home/runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2025-09-07T06:40:01.1749209Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2025-09-07T06:40:01.1792245Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2025-09-07T06:40:01.1994173Z Entering 'android/libs/fbjni' 2025-09-07T06:40:01.2029113Z Entering 'third_party/FP16' 2025-09-07T06:40:01.2054566Z Entering 'third_party/FXdiv' 2025-09-07T06:40:01.2089325Z Entering 'third_party/NNPACK' 2025-09-07T06:40:01.2122942Z Entering 'third_party/NVTX' 2025-09-07T06:40:01.2154897Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T06:40:01.2192129Z Entering 'third_party/XNNPACK' 2025-09-07T06:40:01.2230843Z Entering 'third_party/aiter' 2025-09-07T06:40:01.2252659Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T06:40:01.2280890Z Entering 'third_party/benchmark' 2025-09-07T06:40:01.2310789Z Entering 'third_party/composable_kernel' 2025-09-07T06:40:01.2341949Z Entering 'third_party/cpp-httplib' 2025-09-07T06:40:01.2364774Z Entering 'third_party/cpuinfo' 2025-09-07T06:40:01.2388944Z Entering 'third_party/cudnn_frontend' 2025-09-07T06:40:01.2418072Z Entering 'third_party/cutlass' 2025-09-07T06:40:01.2453413Z Entering 'third_party/fbgemm' 2025-09-07T06:40:01.2487159Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T06:40:01.2509248Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T06:40:01.2550247Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T06:40:01.2577707Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T06:40:01.2617130Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T06:40:01.2647457Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T06:40:01.2673159Z Entering 'third_party/fbgemm/external/json' 2025-09-07T06:40:01.2699305Z Entering 'third_party/flash-attention' 2025-09-07T06:40:01.2721086Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T06:40:01.2747121Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T06:40:01.2779663Z Entering 'third_party/flatbuffers' 2025-09-07T06:40:01.2809713Z Entering 'third_party/fmt' 2025-09-07T06:40:01.2839861Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T06:40:01.2863440Z Entering 'third_party/gloo' 2025-09-07T06:40:01.2884712Z Entering 'third_party/googletest' 2025-09-07T06:40:01.2919530Z Entering 'third_party/ideep' 2025-09-07T06:40:01.2943528Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T06:40:01.2977026Z Entering 'third_party/ittapi' 2025-09-07T06:40:01.3003554Z Entering 'third_party/kineto' 2025-09-07T06:40:01.3025635Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T06:40:01.3055598Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T06:40:01.3078210Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T06:40:01.3109369Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T06:40:01.3139457Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T06:40:01.3160376Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T06:40:01.3183723Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T06:40:01.3206334Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T06:40:01.3228026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T06:40:01.3258640Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T06:40:01.3283869Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T06:40:01.3306610Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T06:40:01.3329979Z Entering 'third_party/kleidiai' 2025-09-07T06:40:01.3359863Z Entering 'third_party/mimalloc' 2025-09-07T06:40:01.3391382Z Entering 'third_party/nlohmann' 2025-09-07T06:40:01.3420507Z Entering 'third_party/onnx' 2025-09-07T06:40:01.3452010Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T06:40:01.3477211Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T06:40:01.3501485Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T06:40:01.3530458Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T06:40:01.3558775Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T06:40:01.3580708Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T06:40:01.3609177Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T06:40:01.3636203Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T06:40:01.3657595Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T06:40:01.3681242Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T06:40:01.3705006Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T06:40:01.3733883Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T06:40:01.3770649Z Entering 'third_party/pocketfft' 2025-09-07T06:40:01.3797568Z Entering 'third_party/protobuf' 2025-09-07T06:40:01.3826905Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T06:40:01.3857450Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T06:40:01.3883549Z Entering 'third_party/psimd' 2025-09-07T06:40:01.3907055Z Entering 'third_party/pthreadpool' 2025-09-07T06:40:01.3945295Z Entering 'third_party/pybind11' 2025-09-07T06:40:01.3975252Z Entering 'third_party/python-peachpy' 2025-09-07T06:40:01.4008432Z Entering 'third_party/sleef' 2025-09-07T06:40:01.4034310Z Entering 'third_party/tensorpipe' 2025-09-07T06:40:01.4060413Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T06:40:01.4088462Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T06:40:01.4110263Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T06:40:01.4145625Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T06:40:01.4167847Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T06:40:01.4201802Z ##[endgroup] 2025-09-07T06:40:01.4202176Z ##[group]Persisting credentials for submodules 2025-09-07T06:40:01.4211477Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2025-09-07T06:40:01.4384547Z Entering 'android/libs/fbjni' 2025-09-07T06:40:01.4415049Z Entering 'third_party/FP16' 2025-09-07T06:40:01.4445787Z Entering 'third_party/FXdiv' 2025-09-07T06:40:01.4475684Z Entering 'third_party/NNPACK' 2025-09-07T06:40:01.4501870Z Entering 'third_party/NVTX' 2025-09-07T06:40:01.4535275Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T06:40:01.4561192Z Entering 'third_party/XNNPACK' 2025-09-07T06:40:01.4593948Z Entering 'third_party/aiter' 2025-09-07T06:40:01.4627086Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T06:40:01.4663273Z Entering 'third_party/benchmark' 2025-09-07T06:40:01.4696693Z Entering 'third_party/composable_kernel' 2025-09-07T06:40:01.4729622Z Entering 'third_party/cpp-httplib' 2025-09-07T06:40:01.4757081Z Entering 'third_party/cpuinfo' 2025-09-07T06:40:01.4784599Z Entering 'third_party/cudnn_frontend' 2025-09-07T06:40:01.4809337Z Entering 'third_party/cutlass' 2025-09-07T06:40:01.4858536Z Entering 'third_party/fbgemm' 2025-09-07T06:40:01.4895746Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T06:40:01.4931645Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T06:40:01.4961512Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T06:40:01.4999648Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T06:40:01.5038927Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T06:40:01.5064222Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T06:40:01.5089789Z Entering 'third_party/fbgemm/external/json' 2025-09-07T06:40:01.5126863Z Entering 'third_party/flash-attention' 2025-09-07T06:40:01.5155914Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T06:40:01.5192191Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T06:40:01.5221425Z Entering 'third_party/flatbuffers' 2025-09-07T06:40:01.5250786Z Entering 'third_party/fmt' 2025-09-07T06:40:01.5289270Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T06:40:01.5326941Z Entering 'third_party/gloo' 2025-09-07T06:40:01.5360377Z Entering 'third_party/googletest' 2025-09-07T06:40:01.5389962Z Entering 'third_party/ideep' 2025-09-07T06:40:01.5417292Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T06:40:01.5448131Z Entering 'third_party/ittapi' 2025-09-07T06:40:01.5475420Z Entering 'third_party/kineto' 2025-09-07T06:40:01.5500920Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T06:40:01.5526437Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T06:40:01.5553934Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T06:40:01.5586760Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T06:40:01.5615726Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T06:40:01.5644534Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T06:40:01.5670638Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T06:40:01.5705216Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T06:40:01.5733776Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T06:40:01.5762656Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T06:40:01.5791619Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T06:40:01.5828857Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T06:40:01.5856930Z Entering 'third_party/kleidiai' 2025-09-07T06:40:01.5884920Z Entering 'third_party/mimalloc' 2025-09-07T06:40:01.5910746Z Entering 'third_party/nlohmann' 2025-09-07T06:40:01.5943926Z Entering 'third_party/onnx' 2025-09-07T06:40:01.5975187Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T06:40:01.6005298Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T06:40:01.6033291Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T06:40:01.6057091Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T06:40:01.6090072Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T06:40:01.6122560Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T06:40:01.6149112Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T06:40:01.6177996Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T06:40:01.6201838Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T06:40:01.6230342Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T06:40:01.6264728Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T06:40:01.6301898Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T06:40:01.6339044Z Entering 'third_party/pocketfft' 2025-09-07T06:40:01.6365786Z Entering 'third_party/protobuf' 2025-09-07T06:40:01.6408903Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T06:40:01.6440715Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T06:40:01.6477783Z Entering 'third_party/psimd' 2025-09-07T06:40:01.6512365Z Entering 'third_party/pthreadpool' 2025-09-07T06:40:01.6541162Z Entering 'third_party/pybind11' 2025-09-07T06:40:01.6570935Z Entering 'third_party/python-peachpy' 2025-09-07T06:40:01.6598275Z Entering 'third_party/sleef' 2025-09-07T06:40:01.6624617Z Entering 'third_party/tensorpipe' 2025-09-07T06:40:01.6656093Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T06:40:01.6685895Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T06:40:01.6716226Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T06:40:01.6740598Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T06:40:01.6772008Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T06:40:01.6821051Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2025-09-07T06:40:01.6997927Z Entering 'android/libs/fbjni' 2025-09-07T06:40:01.7033342Z file:/home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-09-07T06:40:01.7045004Z Entering 'third_party/FP16' 2025-09-07T06:40:01.7072410Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-09-07T06:40:01.7084316Z Entering 'third_party/FXdiv' 2025-09-07T06:40:01.7107116Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-09-07T06:40:01.7118916Z Entering 'third_party/NNPACK' 2025-09-07T06:40:01.7146338Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-09-07T06:40:01.7156525Z Entering 'third_party/NVTX' 2025-09-07T06:40:01.7190010Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-09-07T06:40:01.7202110Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T06:40:01.7231851Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-09-07T06:40:01.7244840Z Entering 'third_party/XNNPACK' 2025-09-07T06:40:01.7275631Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-09-07T06:40:01.7293291Z Entering 'third_party/aiter' 2025-09-07T06:40:01.7322443Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-09-07T06:40:01.7333856Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T06:40:01.7357579Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-09-07T06:40:01.7373703Z Entering 'third_party/benchmark' 2025-09-07T06:40:01.7400542Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-09-07T06:40:01.7411522Z Entering 'third_party/composable_kernel' 2025-09-07T06:40:01.7440946Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-09-07T06:40:01.7456484Z Entering 'third_party/cpp-httplib' 2025-09-07T06:40:01.7484793Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-09-07T06:40:01.7495996Z Entering 'third_party/cpuinfo' 2025-09-07T06:40:01.7521685Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-09-07T06:40:01.7533594Z Entering 'third_party/cudnn_frontend' 2025-09-07T06:40:01.7564460Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-09-07T06:40:01.7576321Z Entering 'third_party/cutlass' 2025-09-07T06:40:01.7604234Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-09-07T06:40:01.7624051Z Entering 'third_party/fbgemm' 2025-09-07T06:40:01.7653976Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-09-07T06:40:01.7665521Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T06:40:01.7691475Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-09-07T06:40:01.7706602Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T06:40:01.7735433Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-09-07T06:40:01.7749236Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T06:40:01.7775152Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-09-07T06:40:01.7790183Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T06:40:01.7814636Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-09-07T06:40:01.7829026Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T06:40:01.7860928Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-09-07T06:40:01.7876027Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T06:40:01.7899642Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-09-07T06:40:01.7910343Z Entering 'third_party/fbgemm/external/json' 2025-09-07T06:40:01.7935709Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-09-07T06:40:01.7950063Z Entering 'third_party/flash-attention' 2025-09-07T06:40:01.7974876Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-09-07T06:40:01.7988150Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T06:40:01.8011536Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-09-07T06:40:01.8029477Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T06:40:01.8053386Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-09-07T06:40:01.8071239Z Entering 'third_party/flatbuffers' 2025-09-07T06:40:01.8102498Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-09-07T06:40:01.8117273Z Entering 'third_party/fmt' 2025-09-07T06:40:01.8140214Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-09-07T06:40:01.8150044Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T06:40:01.8173606Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-09-07T06:40:01.8185122Z Entering 'third_party/gloo' 2025-09-07T06:40:01.8216189Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-09-07T06:40:01.8227530Z Entering 'third_party/googletest' 2025-09-07T06:40:01.8256040Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-09-07T06:40:01.8274672Z Entering 'third_party/ideep' 2025-09-07T06:40:01.8298543Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-09-07T06:40:01.8309249Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T06:40:01.8337835Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-09-07T06:40:01.8353740Z Entering 'third_party/ittapi' 2025-09-07T06:40:01.8377417Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-09-07T06:40:01.8389023Z Entering 'third_party/kineto' 2025-09-07T06:40:01.8416650Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-09-07T06:40:01.8427918Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T06:40:01.8449180Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-09-07T06:40:01.8459692Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T06:40:01.8484941Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-09-07T06:40:01.8499652Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T06:40:01.8522152Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-09-07T06:40:01.8533539Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T06:40:01.8558472Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-09-07T06:40:01.8575770Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T06:40:01.8603959Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-09-07T06:40:01.8614889Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T06:40:01.8642525Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-09-07T06:40:01.8660031Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T06:40:01.8683255Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-09-07T06:40:01.8695056Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T06:40:01.8723291Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-09-07T06:40:01.8733895Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T06:40:01.8756288Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-09-07T06:40:01.8767390Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T06:40:01.8790046Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-09-07T06:40:01.8801322Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T06:40:01.8831552Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-09-07T06:40:01.8846764Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T06:40:01.8869114Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-09-07T06:40:01.8887220Z Entering 'third_party/kleidiai' 2025-09-07T06:40:01.8916116Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-09-07T06:40:01.8927830Z Entering 'third_party/mimalloc' 2025-09-07T06:40:01.8954749Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-09-07T06:40:01.8966558Z Entering 'third_party/nlohmann' 2025-09-07T06:40:01.8994693Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-09-07T06:40:01.9007683Z Entering 'third_party/onnx' 2025-09-07T06:40:01.9033618Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-09-07T06:40:01.9051273Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T06:40:01.9074205Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-09-07T06:40:01.9088209Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T06:40:01.9114108Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-09-07T06:40:01.9122218Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T06:40:01.9145915Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-09-07T06:40:01.9157414Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T06:40:01.9179515Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-09-07T06:40:01.9191196Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T06:40:01.9214978Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-09-07T06:40:01.9226474Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T06:40:01.9252874Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-09-07T06:40:01.9265040Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T06:40:01.9289222Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-09-07T06:40:01.9305750Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T06:40:01.9341104Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-09-07T06:40:01.9353176Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T06:40:01.9375770Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-09-07T06:40:01.9386167Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T06:40:01.9411559Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-09-07T06:40:01.9425286Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T06:40:01.9451849Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-09-07T06:40:01.9470656Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T06:40:01.9494523Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-09-07T06:40:01.9514480Z Entering 'third_party/pocketfft' 2025-09-07T06:40:01.9537591Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-09-07T06:40:01.9549616Z Entering 'third_party/protobuf' 2025-09-07T06:40:01.9575627Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-09-07T06:40:01.9589335Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T06:40:01.9631148Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-09-07T06:40:01.9642553Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T06:40:01.9665090Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-09-07T06:40:01.9678622Z Entering 'third_party/psimd' 2025-09-07T06:40:01.9702062Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-09-07T06:40:01.9713673Z Entering 'third_party/pthreadpool' 2025-09-07T06:40:01.9734836Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-09-07T06:40:01.9746141Z Entering 'third_party/pybind11' 2025-09-07T06:40:01.9768228Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-09-07T06:40:01.9780884Z Entering 'third_party/python-peachpy' 2025-09-07T06:40:01.9806857Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-09-07T06:40:01.9819210Z Entering 'third_party/sleef' 2025-09-07T06:40:01.9843309Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-09-07T06:40:01.9855877Z Entering 'third_party/tensorpipe' 2025-09-07T06:40:01.9880812Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-09-07T06:40:01.9889651Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T06:40:01.9912222Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-09-07T06:40:01.9921842Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T06:40:01.9961123Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-09-07T06:40:01.9975016Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T06:40:02.0012527Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-09-07T06:40:02.0026261Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T06:40:02.0066221Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-09-07T06:40:02.0076966Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T06:40:02.0106526Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-09-07T06:40:02.0319067Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2025-09-07T06:40:02.0501641Z Entering 'android/libs/fbjni' 2025-09-07T06:40:02.0539468Z Entering 'third_party/FP16' 2025-09-07T06:40:02.0559566Z Entering 'third_party/FXdiv' 2025-09-07T06:40:02.0584756Z Entering 'third_party/NNPACK' 2025-09-07T06:40:02.0607616Z Entering 'third_party/NVTX' 2025-09-07T06:40:02.0633763Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T06:40:02.0658888Z Entering 'third_party/XNNPACK' 2025-09-07T06:40:02.0692955Z Entering 'third_party/aiter' 2025-09-07T06:40:02.0720248Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T06:40:02.0749758Z Entering 'third_party/benchmark' 2025-09-07T06:40:02.0773753Z Entering 'third_party/composable_kernel' 2025-09-07T06:40:02.0803755Z Entering 'third_party/cpp-httplib' 2025-09-07T06:40:02.0827934Z Entering 'third_party/cpuinfo' 2025-09-07T06:40:02.0856781Z Entering 'third_party/cudnn_frontend' 2025-09-07T06:40:02.0877358Z Entering 'third_party/cutlass' 2025-09-07T06:40:02.0905580Z Entering 'third_party/fbgemm' 2025-09-07T06:40:02.0932357Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T06:40:02.0957025Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T06:40:02.0985035Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T06:40:02.1008570Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T06:40:02.1035200Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T06:40:02.1060053Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T06:40:02.1082146Z Entering 'third_party/fbgemm/external/json' 2025-09-07T06:40:02.1110499Z Entering 'third_party/flash-attention' 2025-09-07T06:40:02.1134633Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T06:40:02.1161496Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T06:40:02.1190212Z Entering 'third_party/flatbuffers' 2025-09-07T06:40:02.1218572Z Entering 'third_party/fmt' 2025-09-07T06:40:02.1245164Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T06:40:02.1268885Z Entering 'third_party/gloo' 2025-09-07T06:40:02.1292759Z Entering 'third_party/googletest' 2025-09-07T06:40:02.1316341Z Entering 'third_party/ideep' 2025-09-07T06:40:02.1340914Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T06:40:02.1372465Z Entering 'third_party/ittapi' 2025-09-07T06:40:02.1395729Z Entering 'third_party/kineto' 2025-09-07T06:40:02.1419937Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T06:40:02.1445156Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T06:40:02.1469068Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T06:40:02.1492261Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T06:40:02.1516865Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T06:40:02.1545288Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T06:40:02.1570792Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T06:40:02.1596577Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T06:40:02.1620156Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T06:40:02.1643310Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T06:40:02.1669022Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T06:40:02.1692577Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T06:40:02.1721608Z Entering 'third_party/kleidiai' 2025-09-07T06:40:02.1753938Z Entering 'third_party/mimalloc' 2025-09-07T06:40:02.1778109Z Entering 'third_party/nlohmann' 2025-09-07T06:40:02.1801266Z Entering 'third_party/onnx' 2025-09-07T06:40:02.1832048Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T06:40:02.1865707Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T06:40:02.1890606Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T06:40:02.1922171Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T06:40:02.1943878Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T06:40:02.1970608Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T06:40:02.1997162Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T06:40:02.2026128Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T06:40:02.2057484Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T06:40:02.2077060Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T06:40:02.2105956Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T06:40:02.2133281Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T06:40:02.2174716Z Entering 'third_party/pocketfft' 2025-09-07T06:40:02.2199474Z Entering 'third_party/protobuf' 2025-09-07T06:40:02.2225172Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T06:40:02.2246932Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T06:40:02.2274352Z Entering 'third_party/psimd' 2025-09-07T06:40:02.2298736Z Entering 'third_party/pthreadpool' 2025-09-07T06:40:02.2323147Z Entering 'third_party/pybind11' 2025-09-07T06:40:02.2349181Z Entering 'third_party/python-peachpy' 2025-09-07T06:40:02.2373392Z Entering 'third_party/sleef' 2025-09-07T06:40:02.2404223Z Entering 'third_party/tensorpipe' 2025-09-07T06:40:02.2428083Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T06:40:02.2454748Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T06:40:02.2477685Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T06:40:02.2501335Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T06:40:02.2524878Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T06:40:02.2572285Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2025-09-07T06:40:02.2749533Z Entering 'android/libs/fbjni' 2025-09-07T06:40:02.2773315Z Entering 'third_party/FP16' 2025-09-07T06:40:02.2798048Z Entering 'third_party/FXdiv' 2025-09-07T06:40:02.2819975Z Entering 'third_party/NNPACK' 2025-09-07T06:40:02.2845305Z Entering 'third_party/NVTX' 2025-09-07T06:40:02.2869380Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T06:40:02.2894273Z Entering 'third_party/XNNPACK' 2025-09-07T06:40:02.2924748Z Entering 'third_party/aiter' 2025-09-07T06:40:02.2943353Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T06:40:02.2970129Z Entering 'third_party/benchmark' 2025-09-07T06:40:02.2994004Z Entering 'third_party/composable_kernel' 2025-09-07T06:40:02.3020519Z Entering 'third_party/cpp-httplib' 2025-09-07T06:40:02.3044813Z Entering 'third_party/cpuinfo' 2025-09-07T06:40:02.3069560Z Entering 'third_party/cudnn_frontend' 2025-09-07T06:40:02.3092446Z Entering 'third_party/cutlass' 2025-09-07T06:40:02.3119885Z Entering 'third_party/fbgemm' 2025-09-07T06:40:02.3142217Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T06:40:02.3165361Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T06:40:02.3191988Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T06:40:02.3214718Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T06:40:02.3238608Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T06:40:02.3262687Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T06:40:02.3287530Z Entering 'third_party/fbgemm/external/json' 2025-09-07T06:40:02.3313958Z Entering 'third_party/flash-attention' 2025-09-07T06:40:02.3341724Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T06:40:02.3367918Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T06:40:02.3394739Z Entering 'third_party/flatbuffers' 2025-09-07T06:40:02.3421523Z Entering 'third_party/fmt' 2025-09-07T06:40:02.3445956Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T06:40:02.3470333Z Entering 'third_party/gloo' 2025-09-07T06:40:02.3494378Z Entering 'third_party/googletest' 2025-09-07T06:40:02.3523192Z Entering 'third_party/ideep' 2025-09-07T06:40:02.3547458Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T06:40:02.3573453Z Entering 'third_party/ittapi' 2025-09-07T06:40:02.3599949Z Entering 'third_party/kineto' 2025-09-07T06:40:02.3624640Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T06:40:02.3651639Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T06:40:02.3674177Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T06:40:02.3696546Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T06:40:02.3718148Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T06:40:02.3739980Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T06:40:02.3764978Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T06:40:02.3784260Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T06:40:02.3804525Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T06:40:02.3829289Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T06:40:02.3853709Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T06:40:02.3875232Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T06:40:02.3899534Z Entering 'third_party/kleidiai' 2025-09-07T06:40:02.3925820Z Entering 'third_party/mimalloc' 2025-09-07T06:40:02.3949408Z Entering 'third_party/nlohmann' 2025-09-07T06:40:02.3972489Z Entering 'third_party/onnx' 2025-09-07T06:40:02.4003007Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T06:40:02.4027325Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T06:40:02.4055109Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T06:40:02.4074896Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T06:40:02.4097108Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T06:40:02.4119423Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T06:40:02.4145864Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T06:40:02.4172526Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T06:40:02.4199102Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T06:40:02.4222376Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T06:40:02.4251594Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T06:40:02.4272388Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T06:40:02.4312860Z Entering 'third_party/pocketfft' 2025-09-07T06:40:02.4338547Z Entering 'third_party/protobuf' 2025-09-07T06:40:02.4367814Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T06:40:02.4398057Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T06:40:02.4427794Z Entering 'third_party/psimd' 2025-09-07T06:40:02.4451796Z Entering 'third_party/pthreadpool' 2025-09-07T06:40:02.4475077Z Entering 'third_party/pybind11' 2025-09-07T06:40:02.4505779Z Entering 'third_party/python-peachpy' 2025-09-07T06:40:02.4535635Z Entering 'third_party/sleef' 2025-09-07T06:40:02.4566843Z Entering 'third_party/tensorpipe' 2025-09-07T06:40:02.4592647Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T06:40:02.4619470Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T06:40:02.4644747Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T06:40:02.4664702Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T06:40:02.4687974Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T06:40:02.4737308Z ##[endgroup] 2025-09-07T06:40:02.4772801Z [command]/usr/bin/git log -1 --format=%H 2025-09-07T06:40:02.4789970Z 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:40:02.4910537Z ##[group]Run cd "${GITHUB_WORKSPACE}" 2025-09-07T06:40:02.4910894Z cd "${GITHUB_WORKSPACE}" 2025-09-07T06:40:02.4911011Z # Clean stale submodule dirs 2025-09-07T06:40:02.4911136Z if [ -z "${NO_SUDO}" ]; then 2025-09-07T06:40:02.4911275Z  sudo git submodule foreach --recursive git clean -ffdx 2025-09-07T06:40:02.4911418Z else 2025-09-07T06:40:02.4911534Z  git submodule foreach --recursive git clean -ffdx 2025-09-07T06:40:02.4911665Z fi 2025-09-07T06:40:02.4917414Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:02.4917556Z env: 2025-09-07T06:40:02.4917646Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:02.4917744Z NO_SUDO: true 2025-09-07T06:40:02.4917995Z ##[endgroup] 2025-09-07T06:40:02.5098809Z Entering 'android/libs/fbjni' 2025-09-07T06:40:02.5119289Z Entering 'third_party/FP16' 2025-09-07T06:40:02.5137996Z Entering 'third_party/FXdiv' 2025-09-07T06:40:02.5157889Z Entering 'third_party/NNPACK' 2025-09-07T06:40:02.5179287Z Entering 'third_party/NVTX' 2025-09-07T06:40:02.5202756Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T06:40:02.5222435Z Entering 'third_party/XNNPACK' 2025-09-07T06:40:02.5308597Z Entering 'third_party/aiter' 2025-09-07T06:40:02.5335797Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T06:40:02.5400536Z Entering 'third_party/benchmark' 2025-09-07T06:40:02.5423340Z Entering 'third_party/composable_kernel' 2025-09-07T06:40:02.5499071Z Entering 'third_party/cpp-httplib' 2025-09-07T06:40:02.5521945Z Entering 'third_party/cpuinfo' 2025-09-07T06:40:02.5551492Z Entering 'third_party/cudnn_frontend' 2025-09-07T06:40:02.5578807Z Entering 'third_party/cutlass' 2025-09-07T06:40:02.5649605Z Entering 'third_party/fbgemm' 2025-09-07T06:40:02.5686207Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T06:40:02.5708283Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T06:40:02.5772064Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T06:40:02.5794638Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T06:40:02.5862312Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T06:40:02.5887122Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T06:40:02.5907300Z Entering 'third_party/fbgemm/external/json' 2025-09-07T06:40:02.5934184Z Entering 'third_party/flash-attention' 2025-09-07T06:40:02.5966342Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T06:40:02.6028868Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T06:40:02.6081160Z Entering 'third_party/flatbuffers' 2025-09-07T06:40:02.6120403Z Entering 'third_party/fmt' 2025-09-07T06:40:02.6143680Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T06:40:02.6163019Z Entering 'third_party/gloo' 2025-09-07T06:40:02.6184780Z Entering 'third_party/googletest' 2025-09-07T06:40:02.6209685Z Entering 'third_party/ideep' 2025-09-07T06:40:02.6222319Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T06:40:02.6284352Z Entering 'third_party/ittapi' 2025-09-07T06:40:02.6307836Z Entering 'third_party/kineto' 2025-09-07T06:40:02.6334678Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T06:40:02.6356057Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T06:40:02.6383930Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T06:40:02.6409541Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T06:40:02.6429748Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T06:40:02.6457283Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T06:40:02.6477721Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T06:40:02.6494783Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T06:40:02.6516231Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T06:40:02.6546444Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T06:40:02.6566414Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T06:40:02.6585068Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T06:40:02.6606408Z Entering 'third_party/kleidiai' 2025-09-07T06:40:02.6631447Z Entering 'third_party/mimalloc' 2025-09-07T06:40:02.6658053Z Entering 'third_party/nlohmann' 2025-09-07T06:40:02.6686188Z Entering 'third_party/onnx' 2025-09-07T06:40:02.6876579Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T06:40:02.6898410Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T06:40:02.6936161Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T06:40:02.6952955Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T06:40:02.6972576Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T06:40:02.6996172Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T06:40:02.7022525Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T06:40:02.7044577Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T06:40:02.7070184Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T06:40:02.7088811Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T06:40:02.7116575Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T06:40:02.7138160Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T06:40:02.7304258Z Entering 'third_party/pocketfft' 2025-09-07T06:40:02.7323566Z Entering 'third_party/protobuf' 2025-09-07T06:40:02.7375532Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T06:40:02.7386192Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T06:40:02.7409353Z Entering 'third_party/psimd' 2025-09-07T06:40:02.7429505Z Entering 'third_party/pthreadpool' 2025-09-07T06:40:02.7449174Z Entering 'third_party/pybind11' 2025-09-07T06:40:02.7472637Z Entering 'third_party/python-peachpy' 2025-09-07T06:40:02.7496342Z Entering 'third_party/sleef' 2025-09-07T06:40:02.7516673Z Entering 'third_party/tensorpipe' 2025-09-07T06:40:02.7538300Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T06:40:02.7566301Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T06:40:02.7588092Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T06:40:02.7613534Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T06:40:02.7639830Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T06:40:02.7750609Z Prepare all required actions 2025-09-07T06:40:02.7750889Z Getting action download info 2025-09-07T06:40:02.9517887Z ##[group]Run ./.github/actions/setup-rocm 2025-09-07T06:40:02.9518026Z env: 2025-09-07T06:40:02.9518109Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:02.9518203Z ##[endgroup] 2025-09-07T06:40:02.9534977Z ##[group]Run dpkg -l | grep -E " rocm" 2025-09-07T06:40:02.9535108Z dpkg -l | grep -E " rocm" 2025-09-07T06:40:02.9540564Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:02.9540697Z env: 2025-09-07T06:40:02.9540778Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:02.9540872Z ##[endgroup] 2025-09-07T06:40:02.9605050Z ii rocm-cmake 0.14.0.60401-83~22.04 amd64 rocm-cmake built using CMake 2025-09-07T06:40:02.9605286Z ii rocm-core 6.4.1.60401-83~22.04 amd64 ROCm Runtime software stack 2025-09-07T06:40:02.9605580Z ii rocm-dbgapi 0.77.2.60401-83~22.04 amd64 Library to provide AMD GPU debugger API 2025-09-07T06:40:02.9605861Z ii rocm-debug-agent 2.0.4.60401-83~22.04 amd64 Radeon Open Compute Debug Agent (ROCdebug-agent) 2025-09-07T06:40:02.9606111Z ii rocm-dev 6.4.1.60401-83~22.04 amd64 Radeon Open Compute (ROCm) Runtime software stack 2025-09-07T06:40:02.9606357Z ii rocm-device-libs 1.0.0.60401-83~22.04 amd64 Radeon Open Compute - device libraries 2025-09-07T06:40:02.9606570Z ii rocm-gdb 15.2.60401-83~22.04 amd64 ROCgdb 2025-09-07T06:40:02.9606770Z ii rocm-llvm 19.0.0.25184.60401-83~22.04 amd64 ROCm core compiler 2025-09-07T06:40:02.9606976Z ii rocm-opencl 2.0.0.60401-83~22.04 amd64 clr built using CMake 2025-09-07T06:40:02.9607189Z ii rocm-opencl-dev 2.0.0.60401-83~22.04 amd64 clr built using CMake 2025-09-07T06:40:02.9607643Z ii rocm-smi-lib 7.5.0.60401-83~22.04 amd64 AMD System Management libraries 2025-09-07T06:40:02.9607949Z ii rocm-utils 6.4.1.60401-83~22.04 amd64 Radeon Open Compute (ROCm) Runtime software stack 2025-09-07T06:40:02.9608289Z ii rocminfo 1.0.0.60401-83~22.04 amd64 Radeon Open Compute (ROCm) Runtime rocminfo tool 2025-09-07T06:40:02.9623019Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-09-07T06:40:02.9623387Z # ignore expansion of "docker ps -q" since it could be empty 2025-09-07T06:40:02.9623594Z # shellcheck disable=SC2046 2025-09-07T06:40:02.9623747Z docker stop $(docker ps -q) || true 2025-09-07T06:40:02.9623912Z # Prune all stopped containers. 2025-09-07T06:40:02.9624088Z docker container prune -f 2025-09-07T06:40:02.9634999Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:02.9635153Z env: 2025-09-07T06:40:02.9635250Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:02.9635355Z ##[endgroup] 2025-09-07T06:40:02.9871332Z docker: 'docker stop' requires at least 1 argument 2025-09-07T06:40:02.9871466Z 2025-09-07T06:40:02.9871539Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2025-09-07T06:40:02.9871656Z 2025-09-07T06:40:02.9871722Z See 'docker stop --help' for more information 2025-09-07T06:40:02.9970220Z Total reclaimed space: 0B 2025-09-07T06:40:03.0003545Z ##[group]Run cat /etc/os-release || true 2025-09-07T06:40:03.0003773Z cat /etc/os-release || true 2025-09-07T06:40:03.0003956Z cat /etc/apt/sources.list.d/rocm.list || true 2025-09-07T06:40:03.0004151Z cat /opt/rocm/.info/version || true 2025-09-07T06:40:03.0004308Z whoami 2025-09-07T06:40:03.0010388Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.0010534Z env: 2025-09-07T06:40:03.0010627Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.0010746Z ##[endgroup] 2025-09-07T06:40:03.0032999Z PRETTY_NAME="Ubuntu 22.04.5 LTS" 2025-09-07T06:40:03.0033229Z NAME="Ubuntu" 2025-09-07T06:40:03.0033327Z VERSION_ID="22.04" 2025-09-07T06:40:03.0033465Z VERSION="22.04.5 LTS (Jammy Jellyfish)" 2025-09-07T06:40:03.0033590Z VERSION_CODENAME=jammy 2025-09-07T06:40:03.0033731Z ID=ubuntu 2025-09-07T06:40:03.0033816Z ID_LIKE=debian 2025-09-07T06:40:03.0033930Z HOME_URL="https://www.ubuntu.com/" 2025-09-07T06:40:03.0034057Z SUPPORT_URL="https://help.ubuntu.com/" 2025-09-07T06:40:03.0034200Z BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2025-09-07T06:40:03.0034398Z PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2025-09-07T06:40:03.0034584Z UBUNTU_CODENAME=jammy 2025-09-07T06:40:03.0044657Z deb [arch=amd64 signed-by=/etc/apt/keyrings/rocm.gpg] https://repo.radeon.com/rocm/apt/6.4.1 jammy main 2025-09-07T06:40:03.0051088Z 6.4.1-83 2025-09-07T06:40:03.0062254Z runner 2025-09-07T06:40:03.0084422Z ##[group]Run dpkg -l | grep -E " amdgpu" 2025-09-07T06:40:03.0084590Z dpkg -l | grep -E " amdgpu" 2025-09-07T06:40:03.0090205Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.0090354Z env: 2025-09-07T06:40:03.0090444Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.0090553Z ##[endgroup] 2025-09-07T06:40:03.0154585Z ii amdgpu-core 1:6.4.60401-2164967.22.04 all Core meta package for unified amdgpu driver. 2025-09-07T06:40:03.0154852Z ii amdgpu-install 6.4.60401-2164967.22.04 all AMDGPU driver repository and installer 2025-09-07T06:40:03.0172838Z ##[group]Run rocm-smi 2025-09-07T06:40:03.0172940Z rocm-smi 2025-09-07T06:40:03.0179099Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.0179237Z env: 2025-09-07T06:40:03.0179319Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.0179425Z ##[endgroup] 2025-09-07T06:40:03.0640237Z 2025-09-07T06:40:03.0640242Z 2025-09-07T06:40:03.0640554Z ============================================ ROCm System Management Interface ============================================ 2025-09-07T06:40:03.0640763Z ====================================================== Concise Info ====================================================== 2025-09-07T06:40:03.0640978Z Device Node IDs Temp Power Partitions SCLK MCLK Fan Perf PwrCap VRAM% GPU% 2025-09-07T06:40:03.0641450Z  (DID, GUID) (Junction) (Socket) (Mem, Compute, ID)  2025-09-07T06:40:03.0641629Z ========================================================================================================================== 2025-09-07T06:40:03.0642108Z 0 9 0x74b9, 43855 45.0°C 137.0W NPS1, SPX, 0 152Mhz 900Mhz 0% auto 1000.0W 0% 0% 2025-09-07T06:40:03.0642323Z ========================================================================================================================== 2025-09-07T06:40:03.0642501Z ================================================== End of ROCm SMI Log =================================================== 2025-09-07T06:40:03.0704650Z ##[group]Run rocminfo 2025-09-07T06:40:03.0704776Z rocminfo 2025-09-07T06:40:03.0709250Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.0709395Z env: 2025-09-07T06:40:03.0709483Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.0709579Z ##[endgroup] 2025-09-07T06:40:03.1388745Z ROCk module version 6.12.12 is loaded 2025-09-07T06:40:03.1389771Z ===================== 2025-09-07T06:40:03.1389997Z HSA System Attributes 2025-09-07T06:40:03.1390331Z ===================== 2025-09-07T06:40:03.1390567Z Runtime Version: 1.15 2025-09-07T06:40:03.1390726Z Runtime Ext Version: 1.7 2025-09-07T06:40:03.1391047Z System Timestamp Freq.: 1000.000000MHz 2025-09-07T06:40:03.1391233Z Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) 2025-09-07T06:40:03.1391438Z Machine Model: LARGE 2025-09-07T06:40:03.1391605Z System Endianness: LITTLE 2025-09-07T06:40:03.1391741Z Mwaitx: DISABLED 2025-09-07T06:40:03.1391861Z XNACK enabled: NO 2025-09-07T06:40:03.1391967Z DMAbuf Support: YES 2025-09-07T06:40:03.1392076Z VMM Support: YES 2025-09-07T06:40:03.1392142Z 2025-09-07T06:40:03.1392187Z ========== 2025-09-07T06:40:03.1392371Z HSA Agents 2025-09-07T06:40:03.1392487Z ========== 2025-09-07T06:40:03.1392578Z ******* 2025-09-07T06:40:03.1392762Z Agent 1 2025-09-07T06:40:03.1392963Z ******* 2025-09-07T06:40:03.1393270Z Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:40:03.1393451Z Uuid: CPU-XX 2025-09-07T06:40:03.1393678Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:40:03.1393904Z Vendor Name: CPU 2025-09-07T06:40:03.1394053Z Feature: None specified 2025-09-07T06:40:03.1394205Z Profile: FULL_PROFILE 2025-09-07T06:40:03.1394354Z Float Round Mode: NEAR 2025-09-07T06:40:03.1394509Z Max Queue Number: 0(0x0) 2025-09-07T06:40:03.1394653Z Queue Min Size: 0(0x0) 2025-09-07T06:40:03.1394796Z Queue Max Size: 0(0x0) 2025-09-07T06:40:03.1394939Z Queue Type: MULTI 2025-09-07T06:40:03.1395073Z Node: 0 2025-09-07T06:40:03.1395210Z Device Type: CPU 2025-09-07T06:40:03.1395331Z Cache Info: 2025-09-07T06:40:03.1395643Z L1: 65536(0x10000) KB 2025-09-07T06:40:03.1395780Z Chip ID: 0(0x0) 2025-09-07T06:40:03.1395918Z ASIC Revision: 0(0x0) 2025-09-07T06:40:03.1396073Z Cacheline Size: 64(0x40) 2025-09-07T06:40:03.1396253Z Max Clock Freq. (MHz): 0 2025-09-07T06:40:03.1396394Z BDFID: 0 2025-09-07T06:40:03.1396529Z Internal Node ID: 0 2025-09-07T06:40:03.1396673Z Compute Unit: 80 2025-09-07T06:40:03.1396814Z SIMDs per CU: 0 2025-09-07T06:40:03.1396955Z Shader Engines: 0 2025-09-07T06:40:03.1397156Z Shader Arrs. per Eng.: 0 2025-09-07T06:40:03.1397313Z WatchPts on Addr. Ranges:1 2025-09-07T06:40:03.1397444Z Memory Properties: 2025-09-07T06:40:03.1397549Z Features: None 2025-09-07T06:40:03.1397646Z Pool Info: 2025-09-07T06:40:03.1397744Z Pool 1 2025-09-07T06:40:03.1397869Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-09-07T06:40:03.1398019Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:40:03.1398163Z Allocatable: TRUE 2025-09-07T06:40:03.1398308Z Alloc Granule: 4KB 2025-09-07T06:40:03.1398468Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1398622Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1398824Z Accessible by all: TRUE 2025-09-07T06:40:03.1398956Z Pool 2 2025-09-07T06:40:03.1399083Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-09-07T06:40:03.1399230Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:40:03.1399369Z Allocatable: TRUE 2025-09-07T06:40:03.1399518Z Alloc Granule: 4KB 2025-09-07T06:40:03.1399669Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1402944Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1403209Z Accessible by all: TRUE 2025-09-07T06:40:03.1403339Z Pool 3 2025-09-07T06:40:03.1403462Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-09-07T06:40:03.1403608Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:40:03.1403750Z Allocatable: TRUE 2025-09-07T06:40:03.1403909Z Alloc Granule: 4KB 2025-09-07T06:40:03.1404062Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1404215Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1404366Z Accessible by all: TRUE 2025-09-07T06:40:03.1404488Z Pool 4 2025-09-07T06:40:03.1404606Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-09-07T06:40:03.1404743Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:40:03.1404882Z Allocatable: TRUE 2025-09-07T06:40:03.1405021Z Alloc Granule: 4KB 2025-09-07T06:40:03.1405174Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1405327Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1405556Z Accessible by all: TRUE 2025-09-07T06:40:03.1405684Z ISA Info: 2025-09-07T06:40:03.1405777Z ******* 2025-09-07T06:40:03.1405872Z Agent 2 2025-09-07T06:40:03.1405957Z ******* 2025-09-07T06:40:03.1406069Z Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:40:03.1406210Z Uuid: CPU-XX 2025-09-07T06:40:03.1406351Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:40:03.1406506Z Vendor Name: CPU 2025-09-07T06:40:03.1406653Z Feature: None specified 2025-09-07T06:40:03.1406806Z Profile: FULL_PROFILE 2025-09-07T06:40:03.1406954Z Float Round Mode: NEAR 2025-09-07T06:40:03.1407103Z Max Queue Number: 0(0x0) 2025-09-07T06:40:03.1407238Z Queue Min Size: 0(0x0) 2025-09-07T06:40:03.1407375Z Queue Max Size: 0(0x0) 2025-09-07T06:40:03.1407509Z Queue Type: MULTI 2025-09-07T06:40:03.1407638Z Node: 1 2025-09-07T06:40:03.1407767Z Device Type: CPU 2025-09-07T06:40:03.1407889Z Cache Info: 2025-09-07T06:40:03.1407992Z L1: 65536(0x10000) KB 2025-09-07T06:40:03.1408117Z Chip ID: 0(0x0) 2025-09-07T06:40:03.1408248Z ASIC Revision: 0(0x0) 2025-09-07T06:40:03.1408528Z Cacheline Size: 64(0x40) 2025-09-07T06:40:03.1410165Z Max Clock Freq. (MHz): 0 2025-09-07T06:40:03.1410312Z BDFID: 0 2025-09-07T06:40:03.1410446Z Internal Node ID: 1 2025-09-07T06:40:03.1410583Z Compute Unit: 80 2025-09-07T06:40:03.1410714Z SIMDs per CU: 0 2025-09-07T06:40:03.1410850Z Shader Engines: 0 2025-09-07T06:40:03.1410993Z Shader Arrs. per Eng.: 0 2025-09-07T06:40:03.1411137Z WatchPts on Addr. Ranges:1 2025-09-07T06:40:03.1411264Z Memory Properties: 2025-09-07T06:40:03.1411359Z Features: None 2025-09-07T06:40:03.1411455Z Pool Info: 2025-09-07T06:40:03.1411546Z Pool 1 2025-09-07T06:40:03.1411667Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-09-07T06:40:03.1413216Z Size: 656328584(0x271ec788) KB 2025-09-07T06:40:03.1413356Z Allocatable: TRUE 2025-09-07T06:40:03.1413496Z Alloc Granule: 4KB 2025-09-07T06:40:03.1413642Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1413788Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1413930Z Accessible by all: TRUE 2025-09-07T06:40:03.1414054Z Pool 2 2025-09-07T06:40:03.1414169Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-09-07T06:40:03.1414305Z Size: 656328584(0x271ec788) KB 2025-09-07T06:40:03.1414436Z Allocatable: TRUE 2025-09-07T06:40:03.1414580Z Alloc Granule: 4KB 2025-09-07T06:40:03.1414725Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1416175Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1416328Z Accessible by all: TRUE 2025-09-07T06:40:03.1416452Z Pool 3 2025-09-07T06:40:03.1416566Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-09-07T06:40:03.1416698Z Size: 656328584(0x271ec788) KB 2025-09-07T06:40:03.1416829Z Allocatable: TRUE 2025-09-07T06:40:03.1416970Z Alloc Granule: 4KB 2025-09-07T06:40:03.1417114Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1417259Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1417404Z Accessible by all: TRUE 2025-09-07T06:40:03.1417527Z Pool 4 2025-09-07T06:40:03.1417645Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-09-07T06:40:03.1417776Z Size: 656328584(0x271ec788) KB 2025-09-07T06:40:03.1419098Z Allocatable: TRUE 2025-09-07T06:40:03.1419239Z Alloc Granule: 4KB 2025-09-07T06:40:03.1419384Z Alloc Recommended Granule:4KB 2025-09-07T06:40:03.1419530Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1419672Z Accessible by all: TRUE 2025-09-07T06:40:03.1419795Z ISA Info: 2025-09-07T06:40:03.1419884Z ******* 2025-09-07T06:40:03.1419971Z Agent 3 2025-09-07T06:40:03.1420054Z ******* 2025-09-07T06:40:03.1420216Z Name: gfx942 2025-09-07T06:40:03.1420352Z Uuid: GPU-bec9e12a4472d3aa 2025-09-07T06:40:03.1420494Z Marketing Name: AMD Instinct Mi325X VF 2025-09-07T06:40:03.1421810Z Vendor Name: AMD 2025-09-07T06:40:03.1421946Z Feature: KERNEL_DISPATCH 2025-09-07T06:40:03.1422082Z Profile: BASE_PROFILE 2025-09-07T06:40:03.1422222Z Float Round Mode: NEAR 2025-09-07T06:40:03.1422360Z Max Queue Number: 128(0x80) 2025-09-07T06:40:03.1422496Z Queue Min Size: 64(0x40) 2025-09-07T06:40:03.1422628Z Queue Max Size: 131072(0x20000) 2025-09-07T06:40:03.1422762Z Queue Type: MULTI 2025-09-07T06:40:03.1422890Z Node: 2 2025-09-07T06:40:03.1423020Z Device Type: GPU 2025-09-07T06:40:03.1423224Z Cache Info: 2025-09-07T06:40:03.1423325Z L1: 32(0x20) KB 2025-09-07T06:40:03.1424606Z L2: 4096(0x1000) KB 2025-09-07T06:40:03.1424731Z L3: 262144(0x40000) KB 2025-09-07T06:40:03.1424854Z Chip ID: 29881(0x74b9) 2025-09-07T06:40:03.1424986Z ASIC Revision: 1(0x1) 2025-09-07T06:40:03.1425126Z Cacheline Size: 128(0x80) 2025-09-07T06:40:03.1425265Z Max Clock Freq. (MHz): 2100 2025-09-07T06:40:03.1425394Z BDFID: 33536 2025-09-07T06:40:03.1425528Z Internal Node ID: 2 2025-09-07T06:40:03.1425664Z Compute Unit: 304 2025-09-07T06:40:03.1425872Z SIMDs per CU: 4 2025-09-07T06:40:03.1426006Z Shader Engines: 32 2025-09-07T06:40:03.1426147Z Shader Arrs. per Eng.: 1 2025-09-07T06:40:03.1426292Z WatchPts on Addr. Ranges:4 2025-09-07T06:40:03.1427610Z Coherent Host Access: FALSE 2025-09-07T06:40:03.1427738Z Memory Properties: 2025-09-07T06:40:03.1427841Z Features: KERNEL_DISPATCH 2025-09-07T06:40:03.1427971Z Fast F16 Operation: TRUE 2025-09-07T06:40:03.1428111Z Wavefront Size: 64(0x40) 2025-09-07T06:40:03.1428253Z Workgroup Max Size: 1024(0x400) 2025-09-07T06:40:03.1428386Z Workgroup Max Size per Dimension: 2025-09-07T06:40:03.1428498Z x 1024(0x400) 2025-09-07T06:40:03.1428618Z y 1024(0x400) 2025-09-07T06:40:03.1428729Z z 1024(0x400) 2025-09-07T06:40:03.1428855Z Max Waves Per CU: 32(0x20) 2025-09-07T06:40:03.1428996Z Max Work-item Per CU: 2048(0x800) 2025-09-07T06:40:03.1430289Z Grid Max Size: 4294967295(0xffffffff) 2025-09-07T06:40:03.1430420Z Grid Max Size per Dimension: 2025-09-07T06:40:03.1430523Z x 4294967295(0xffffffff) 2025-09-07T06:40:03.1430640Z y 4294967295(0xffffffff) 2025-09-07T06:40:03.1430754Z z 4294967295(0xffffffff) 2025-09-07T06:40:03.1430887Z Max fbarriers/Workgrp: 32 2025-09-07T06:40:03.1435816Z Packet Processor uCode:: 177 2025-09-07T06:40:03.1435983Z SDMA engine uCode:: 24 2025-09-07T06:40:03.1436127Z IOMMU Support:: None 2025-09-07T06:40:03.1436249Z Pool Info: 2025-09-07T06:40:03.1436345Z Pool 1 2025-09-07T06:40:03.1436464Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-09-07T06:40:03.1436604Z Size: 268107776(0xffb0000) KB 2025-09-07T06:40:03.1438423Z Allocatable: TRUE 2025-09-07T06:40:03.1438565Z Alloc Granule: 4KB 2025-09-07T06:40:03.1438712Z Alloc Recommended Granule:2048KB 2025-09-07T06:40:03.1438858Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1439006Z Accessible by all: FALSE 2025-09-07T06:40:03.1439129Z Pool 2 2025-09-07T06:40:03.1439251Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-09-07T06:40:03.1439388Z Size: 268107776(0xffb0000) KB 2025-09-07T06:40:03.1439519Z Allocatable: TRUE 2025-09-07T06:40:03.1439659Z Alloc Granule: 4KB 2025-09-07T06:40:03.1439858Z Alloc Recommended Granule:2048KB 2025-09-07T06:40:03.1440090Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1441892Z Accessible by all: FALSE 2025-09-07T06:40:03.1442022Z Pool 3 2025-09-07T06:40:03.1442140Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-09-07T06:40:03.1442280Z Size: 268107776(0xffb0000) KB 2025-09-07T06:40:03.1442417Z Allocatable: TRUE 2025-09-07T06:40:03.1442636Z Alloc Granule: 4KB 2025-09-07T06:40:03.1442785Z Alloc Recommended Granule:2048KB 2025-09-07T06:40:03.1442930Z Alloc Alignment: 4KB 2025-09-07T06:40:03.1443211Z Accessible by all: FALSE 2025-09-07T06:40:03.1443341Z Pool 4 2025-09-07T06:40:03.1443458Z Segment: GROUP 2025-09-07T06:40:03.1444779Z Size: 64(0x40) KB 2025-09-07T06:40:03.1444919Z Allocatable: FALSE 2025-09-07T06:40:03.1445062Z Alloc Granule: 0KB 2025-09-07T06:40:03.1445211Z Alloc Recommended Granule:0KB 2025-09-07T06:40:03.1445360Z Alloc Alignment: 0KB 2025-09-07T06:40:03.1445511Z Accessible by all: FALSE 2025-09-07T06:40:03.1445639Z ISA Info: 2025-09-07T06:40:03.1445729Z ISA 1 2025-09-07T06:40:03.1445850Z Name: amdgcn-amd-amdhsa--gfx942:sramecc+:xnack- 2025-09-07T06:40:03.1446001Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-09-07T06:40:03.1446147Z Profiles: HSA_PROFILE_BASE 2025-09-07T06:40:03.1446293Z Default Rounding Mode: NEAR 2025-09-07T06:40:03.1446441Z Default Rounding Mode: NEAR 2025-09-07T06:40:03.1447582Z Fast f16: TRUE 2025-09-07T06:40:03.1447722Z Workgroup Max Size: 1024(0x400) 2025-09-07T06:40:03.1447924Z Workgroup Max Size per Dimension: 2025-09-07T06:40:03.1448044Z x 1024(0x400) 2025-09-07T06:40:03.1448166Z y 1024(0x400) 2025-09-07T06:40:03.1448281Z z 1024(0x400) 2025-09-07T06:40:03.1448491Z Grid Max Size: 4294967295(0xffffffff) 2025-09-07T06:40:03.1448618Z Grid Max Size per Dimension: 2025-09-07T06:40:03.1448724Z x 4294967295(0xffffffff) 2025-09-07T06:40:03.1448842Z y 4294967295(0xffffffff) 2025-09-07T06:40:03.1448958Z z 4294967295(0xffffffff) 2025-09-07T06:40:03.1449087Z FBarrier Max Size: 32 2025-09-07T06:40:03.1450204Z ISA 2 2025-09-07T06:40:03.1450338Z Name: amdgcn-amd-amdhsa--gfx9-4-generic:sramecc+:xnack- 2025-09-07T06:40:03.1450501Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-09-07T06:40:03.1450652Z Profiles: HSA_PROFILE_BASE 2025-09-07T06:40:03.1450795Z Default Rounding Mode: NEAR 2025-09-07T06:40:03.1450943Z Default Rounding Mode: NEAR 2025-09-07T06:40:03.1451080Z Fast f16: TRUE 2025-09-07T06:40:03.1451217Z Workgroup Max Size: 1024(0x400) 2025-09-07T06:40:03.1451347Z Workgroup Max Size per Dimension: 2025-09-07T06:40:03.1451461Z x 1024(0x400) 2025-09-07T06:40:03.1451574Z y 1024(0x400) 2025-09-07T06:40:03.1451688Z z 1024(0x400) 2025-09-07T06:40:03.1452781Z Grid Max Size: 4294967295(0xffffffff) 2025-09-07T06:40:03.1452913Z Grid Max Size per Dimension: 2025-09-07T06:40:03.1453196Z x 4294967295(0xffffffff) 2025-09-07T06:40:03.1453312Z y 4294967295(0xffffffff) 2025-09-07T06:40:03.1453428Z z 4294967295(0xffffffff) 2025-09-07T06:40:03.1453559Z FBarrier Max Size: 32 2025-09-07T06:40:03.1453681Z *** Done *** 2025-09-07T06:40:03.1467015Z ##[group]Run ngpu=$(rocminfo | grep -c -E 'Name:.*\sgfx') 2025-09-07T06:40:03.1467185Z ngpu=$(rocminfo | grep -c -E 'Name:.*\sgfx') 2025-09-07T06:40:03.1467450Z msg="Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified" 2025-09-07T06:40:03.1467696Z if [[ $ngpu -eq 0 ]]; then 2025-09-07T06:40:03.1467838Z  echo "Error: Failed to detect any GPUs on the runner" 2025-09-07T06:40:03.1467971Z  echo "$msg" 2025-09-07T06:40:03.1469723Z  exit 1 2025-09-07T06:40:03.1469808Z fi 2025-09-07T06:40:03.1474071Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.1474202Z env: 2025-09-07T06:40:03.1474282Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.1474374Z ##[endgroup] 2025-09-07T06:40:03.2146462Z ##[group]Run pytorch/pytorch/.github/actions/diskspace-cleanup@main 2025-09-07T06:40:03.2146613Z with: 2025-09-07T06:40:03.2149831Z diskspace-cutoff: 70 2025-09-07T06:40:03.2149938Z env: 2025-09-07T06:40:03.2150026Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.2150120Z ##[endgroup] 2025-09-07T06:40:03.2173970Z ##[group]Run set -ex 2025-09-07T06:40:03.2174085Z set -ex 2025-09-07T06:40:03.2174172Z diskspace_cutoff=70 2025-09-07T06:40:03.2174307Z docker_root_dir=$(docker info -f '{{.DockerRootDir}}') 2025-09-07T06:40:03.2174545Z if [ ! -d "$docker_root_dir" ]; then 2025-09-07T06:40:03.2177071Z  echo "Docker root directory ($docker_root_dir) does not exist. Skipping disk space check." 2025-09-07T06:40:03.2177260Z  exit 0 2025-09-07T06:40:03.2177345Z fi 2025-09-07T06:40:03.2177497Z diskspace=$(df -H --output=pcent ${docker_root_dir} | sed -n 2p | sed 's/%//' | sed 's/ //') 2025-09-07T06:40:03.2177807Z msg="Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified" 2025-09-07T06:40:03.2178072Z if [[ "$diskspace" -ge "$diskspace_cutoff" ]] ; then 2025-09-07T06:40:03.2178208Z  docker system prune -af 2025-09-07T06:40:03.2178383Z  diskspace_new=$(df -H --output=pcent ${docker_root_dir} | sed -n 2p | sed 's/%//' | sed 's/ //') 2025-09-07T06:40:03.2178581Z  if [[ "$diskspace_new" -gt "$diskspace_cutoff" ]] ; then 2025-09-07T06:40:03.2178804Z  echo "Error: Available diskspace is less than $diskspace_cutoff percent. Not enough diskspace." 2025-09-07T06:40:03.2178990Z  echo "$msg" 2025-09-07T06:40:03.2179085Z  exit 1 2025-09-07T06:40:03.2180821Z  else 2025-09-07T06:40:03.2180933Z  difference=$((diskspace - diskspace_new)) 2025-09-07T06:40:03.2181078Z  echo "Diskspace saved: $difference percent" 2025-09-07T06:40:03.2181195Z  fi 2025-09-07T06:40:03.2181271Z fi 2025-09-07T06:40:03.2185179Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.2185307Z env: 2025-09-07T06:40:03.2185386Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.2185478Z ##[endgroup] 2025-09-07T06:40:03.2203516Z + diskspace_cutoff=70 2025-09-07T06:40:03.2208165Z ++ docker info -f '{{.DockerRootDir}}' 2025-09-07T06:40:03.2546283Z + docker_root_dir=/home/runner/docker-data 2025-09-07T06:40:03.2546679Z + '[' '!' -d /home/runner/docker-data ']' 2025-09-07T06:40:03.2553404Z ++ df -H --output=pcent /home/runner/docker-data 2025-09-07T06:40:03.2553640Z ++ sed -n 2p 2025-09-07T06:40:03.2554032Z ++ sed s/%// 2025-09-07T06:40:03.2554574Z ++ sed 's/ //' 2025-09-07T06:40:03.2566786Z + diskspace=18 2025-09-07T06:40:03.2567225Z + msg='Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified' 2025-09-07T06:40:03.2567629Z + [[ 18 -ge 70 ]] 2025-09-07T06:40:03.2583864Z ##[group]Run RUNNER_ARTIFACT_DIR="${RUNNER_TEMP}/artifacts" 2025-09-07T06:40:03.2584054Z RUNNER_ARTIFACT_DIR="${RUNNER_TEMP}/artifacts" 2025-09-07T06:40:03.2588159Z rm -rf "${RUNNER_ARTIFACT_DIR}" 2025-09-07T06:40:03.2588296Z mkdir -p "${RUNNER_ARTIFACT_DIR}" 2025-09-07T06:40:03.2588469Z echo "RUNNER_ARTIFACT_DIR=${RUNNER_ARTIFACT_DIR}" >> "${GITHUB_ENV}" 2025-09-07T06:40:03.2588633Z  2025-09-07T06:40:03.2588756Z RUNNER_TEST_RESULTS_DIR="${RUNNER_TEMP}/test-results" 2025-09-07T06:40:03.2588930Z rm -rf "${RUNNER_TEST_RESULTS_DIR}" 2025-09-07T06:40:03.2589068Z mkdir -p "${RUNNER_TEST_RESULTS_DIR}" 2025-09-07T06:40:03.2589267Z echo "RUNNER_TEST_RESULTS_DIR=${RUNNER_TEST_RESULTS_DIR}" >> "${GITHUB_ENV}" 2025-09-07T06:40:03.2589437Z  2025-09-07T06:40:03.2589532Z RUNNER_DOCS_DIR="${RUNNER_TEMP}/docs" 2025-09-07T06:40:03.2589665Z rm -rf "${RUNNER_DOCS_DIR}" 2025-09-07T06:40:03.2589786Z mkdir -p "${RUNNER_DOCS_DIR}" 2025-09-07T06:40:03.2591880Z echo "RUNNER_DOCS_DIR=${RUNNER_DOCS_DIR}" >> "${GITHUB_ENV}" 2025-09-07T06:40:03.2595846Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.2595978Z env: 2025-09-07T06:40:03.2596060Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.2596156Z ##[endgroup] 2025-09-07T06:40:03.2684095Z ##[group]Run env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-09-07T06:40:03.2684495Z env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-09-07T06:40:03.2684679Z env | grep '^CI' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-09-07T06:40:03.2690339Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.2690488Z env: 2025-09-07T06:40:03.2690585Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.2690713Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:03.2690886Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:03.2691046Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:03.2691169Z ##[endgroup] 2025-09-07T06:40:03.2753194Z ##[group]Run # All GPUs are visible to the runner; visibility, if needed, will be set by run_test.py. 2025-09-07T06:40:03.2753477Z # All GPUs are visible to the runner; visibility, if needed, will be set by run_test.py. 2025-09-07T06:40:03.2753662Z # Add render group for container creation. 2025-09-07T06:40:03.2753831Z render_gid=`cat /etc/group | grep render | cut -d: -f3` 2025-09-07T06:40:03.2754020Z # Ensure GPU isolation if pod is part of kubernetes setup with DEVICE_FLAG. 2025-09-07T06:40:03.2754224Z if [ -f "/etc/podinfo/gha-render-devices" ]; then 2025-09-07T06:40:03.2754383Z  DEVICE_FLAG=$(cat /etc/podinfo/gha-render-devices) 2025-09-07T06:40:03.2754515Z else 2025-09-07T06:40:03.2754607Z  DEVICE_FLAG="--device /dev/dri" 2025-09-07T06:40:03.2754721Z fi 2025-09-07T06:40:03.2754889Z # The --group-add daemon and --group-add bin are needed in the Ubuntu 24.04 and Almalinux OSs respectively. 2025-09-07T06:40:03.2755150Z # This is due to the device files (/dev/kfd & /dev/dri) being owned by video group on bare metal. 2025-09-07T06:40:03.2755389Z # This video group ID maps to subgid 1 inside the docker image due to the /etc/subgid entries. 2025-09-07T06:40:03.2755641Z # The group name corresponding to group ID 1 can change depending on the OS, so both are necessary. 2025-09-07T06:40:03.2756065Z echo "GPU_FLAG=--device=/dev/mem --device=/dev/kfd $DEVICE_FLAG --group-add video --group-add $render_gid --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host" >> "${GITHUB_ENV}" 2025-09-07T06:40:03.2760340Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:03.2760470Z env: 2025-09-07T06:40:03.2760553Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.2760673Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:03.2760834Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:03.2760981Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:03.2761098Z ##[endgroup] 2025-09-07T06:40:03.2874917Z ##[group]Run aws-actions/configure-aws-credentials@ececac1a45f3b08a01d2dd070d28d111c5fe6722 2025-09-07T06:40:03.2875111Z with: 2025-09-07T06:40:03.2875247Z role-to-assume: arn:aws:iam::308535385114:role/gha_workflow_s3_and_ecr_read_only 2025-09-07T06:40:03.2875408Z aws-region: us-east-1 2025-09-07T06:40:03.2875515Z role-duration-seconds: 18000 2025-09-07T06:40:03.2875623Z audience: sts.amazonaws.com 2025-09-07T06:40:03.2875715Z env: 2025-09-07T06:40:03.2875794Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.2875914Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:03.2876073Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:03.2878264Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:03.2878646Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:03.2878994Z ##[endgroup] 2025-09-07T06:40:03.4516675Z Assuming role with OIDC 2025-09-07T06:40:03.6623224Z Authenticated as assumedRoleId AROAUPVRELQNLLCOPFEJR:GitHubActions 2025-09-07T06:40:03.7098153Z ##[group]Run aws-actions/amazon-ecr-login@062b18b96a7aff071d4dc91bc00c4c1a7945b076 2025-09-07T06:40:03.7098349Z with: 2025-09-07T06:40:03.7098440Z mask-password: true 2025-09-07T06:40:03.7098543Z registry-type: private 2025-09-07T06:40:03.7098648Z skip-logout: false 2025-09-07T06:40:03.7098739Z env: 2025-09-07T06:40:03.7098824Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:03.7098956Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:03.7099126Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:03.7099282Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:03.7099659Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:03.7100021Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:40:03.7100146Z AWS_REGION: us-east-1 2025-09-07T06:40:03.7100514Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:40:03.7100669Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:40:03.7103149Z AWS_SESSION_TOKEN: *** 2025-09-07T06:40:03.7103251Z ##[endgroup] 2025-09-07T06:40:03.9663283Z Logging into registry 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:04.2959720Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2025-09-07T06:40:04.2959905Z with: 2025-09-07T06:40:04.2960185Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.2960489Z use-custom-docker-registry: true 2025-09-07T06:40:04.2960616Z docker-build-dir: .ci/docker 2025-09-07T06:40:04.2960740Z docker-build-script: ./build.sh 2025-09-07T06:40:04.2960865Z working-directory: . 2025-09-07T06:40:04.2961007Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:04.2961162Z force-push: false 2025-09-07T06:40:04.2961262Z env: 2025-09-07T06:40:04.2961358Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:04.2961498Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:04.2961784Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:04.2961966Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:04.2962349Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:04.2962712Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:40:04.2962820Z AWS_REGION: us-east-1 2025-09-07T06:40:04.2963041Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:40:04.2963279Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:40:04.2965698Z AWS_SESSION_TOKEN: *** 2025-09-07T06:40:04.2965805Z ##[endgroup] 2025-09-07T06:40:04.2974621Z ##[group]Run set -ex 2025-09-07T06:40:04.2974741Z set -ex 2025-09-07T06:40:04.2974828Z  2025-09-07T06:40:04.2974978Z # If the docker build directory or the build script doesn't exist, the action will 2025-09-07T06:40:04.2975220Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2025-09-07T06:40:04.2975429Z # job could then download the pre-built image as usual 2025-09-07T06:40:04.2975680Z if [[ -d "${DOCKER_BUILD_DIR}" ]] && [[ -f "${DOCKER_BUILD_DIR}/${DOCKER_BUILD_SCRIPT}" ]] && [[ "${USE_CUSTOM_DOCKER_REGISTRY}" == "true" ]]; then 2025-09-07T06:40:04.2975909Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2976033Z else 2025-09-07T06:40:04.2976137Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2976301Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2976477Z  2025-09-07T06:40:04.2976671Z  echo "Not using custom ECR registry. Either it was not requested or there is no Docker build script in the ${REPO_NAME} repo..." 2025-09-07T06:40:04.2976894Z  exit 0 2025-09-07T06:40:04.2976982Z fi 2025-09-07T06:40:04.2977063Z  2025-09-07T06:40:04.2977193Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2025-09-07T06:40:04.2977410Z  # The docker image name already includes the ECR prefix and tag, so we can just 2025-09-07T06:40:04.2977601Z  # use it as it is, but first let's extract the tag 2025-09-07T06:40:04.2977777Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2025-09-07T06:40:04.2977961Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2978140Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2978283Z else 2025-09-07T06:40:04.2978388Z  if [[ "${DOCKER_IMAGE_NAME}" == *:* ]]; then 2025-09-07T06:40:04.2978532Z  CUSTOM_TAG_PREFIX=${DOCKER_IMAGE_NAME#*:} 2025-09-07T06:40:04.2978674Z  DOCKER_IMAGE_NAME=${DOCKER_IMAGE_NAME%%:*} 2025-09-07T06:40:04.2978798Z  fi 2025-09-07T06:40:04.2979069Z  DOCKER_TAG=${CUSTOM_TAG_PREFIX:+${CUSTOM_TAG_PREFIX}-}$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2025-09-07T06:40:04.2979286Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2979514Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2979763Z  echo "custom-tag-prefix=${CUSTOM_TAG_PREFIX}" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.2979914Z fi 2025-09-07T06:40:04.2985315Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:04.2985459Z env: 2025-09-07T06:40:04.2985546Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:04.2985675Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:04.2985842Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:04.2986001Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:04.2986436Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:04.2986794Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:40:04.2986904Z AWS_REGION: us-east-1 2025-09-07T06:40:04.2987069Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:40:04.2987213Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:40:04.2989621Z AWS_SESSION_TOKEN: *** 2025-09-07T06:40:04.2989719Z REPO_NAME: pytorch 2025-09-07T06:40:04.2989987Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.2990272Z DOCKER_BUILD_DIR: .ci/docker 2025-09-07T06:40:04.2990383Z DOCKER_BUILD_SCRIPT: ./build.sh 2025-09-07T06:40:04.2990525Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:04.2990673Z USE_CUSTOM_DOCKER_REGISTRY: true 2025-09-07T06:40:04.2990789Z CUSTOM_TAG_PREFIX: 2025-09-07T06:40:04.2990885Z ##[endgroup] 2025-09-07T06:40:04.3013566Z + [[ -d .ci/docker ]] 2025-09-07T06:40:04.3013782Z + [[ -f .ci/docker/./build.sh ]] 2025-09-07T06:40:04.3013918Z + [[ true == \t\r\u\e ]] 2025-09-07T06:40:04.3014051Z + echo skip=false 2025-09-07T06:40:04.3014479Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2025-09-07T06:40:04.3021388Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.3022963Z ++ awk -F '[:,]' '{print $2}' 2025-09-07T06:40:04.3035192Z + DOCKER_TAG=pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.3035516Z + echo docker-tag=pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.3035973Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.3060820Z ##[group]Run set +e 2025-09-07T06:40:04.3061045Z set +e 2025-09-07T06:40:04.3061183Z set -x 2025-09-07T06:40:04.3061312Z  2025-09-07T06:40:04.3061436Z login() { 2025-09-07T06:40:04.3061672Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-09-07T06:40:04.3061900Z } 2025-09-07T06:40:04.3062023Z  2025-09-07T06:40:04.3062163Z retry () { 2025-09-07T06:40:04.3062304Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-09-07T06:40:04.3062466Z } 2025-09-07T06:40:04.3070771Z  2025-09-07T06:40:04.3070890Z retry login "${DOCKER_REGISTRY}" 2025-09-07T06:40:04.3071021Z  2025-09-07T06:40:04.3071150Z START_TIME=$(date +%s) 2025-09-07T06:40:04.3071279Z # Wait up to 120 minutes 2025-09-07T06:40:04.3071638Z while [[ $(( $(date +%s) - 7200 )) -lt $START_TIME ]]; do 2025-09-07T06:40:04.3071833Z  # Check if image already exists, if it does then skip building it 2025-09-07T06:40:04.3072182Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2025-09-07T06:40:04.3072330Z  exit 0 2025-09-07T06:40:04.3072428Z  fi 2025-09-07T06:40:04.3072526Z  2025-09-07T06:40:04.3072681Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2025-09-07T06:40:04.3072931Z  # use this to differentiate between the Docker build and regular build jobs. For the 2025-09-07T06:40:04.3073268Z  # latter, it will wait for the Docker images to become available before continuing 2025-09-07T06:40:04.3073471Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2025-09-07T06:40:04.3073783Z  # It's a Docker build job, let's build the image 2025-09-07T06:40:04.3073923Z  break 2025-09-07T06:40:04.3074033Z  else 2025-09-07T06:40:04.3074173Z  # It's a regular build job, wait for the image to become available 2025-09-07T06:40:04.3074335Z  sleep 300 2025-09-07T06:40:04.3074437Z  fi 2025-09-07T06:40:04.3074532Z done 2025-09-07T06:40:04.3074626Z  2025-09-07T06:40:04.3074769Z # NB: This part requires a full checkout. Otherwise, the merge base will 2025-09-07T06:40:04.3074983Z # be empty. The default action would be to continue rebuild the image 2025-09-07T06:40:04.3075182Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2025-09-07T06:40:04.3075361Z  # if we're on the base branch then use the parent commit 2025-09-07T06:40:04.3075522Z  MERGE_BASE=$(git rev-parse HEAD~) 2025-09-07T06:40:04.3075651Z else 2025-09-07T06:40:04.3075792Z  # otherwise we're on a PR, so use the most recent base commit 2025-09-07T06:40:04.3075981Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2025-09-07T06:40:04.3076123Z fi 2025-09-07T06:40:04.3076209Z  2025-09-07T06:40:04.3076312Z if [[ -z "${MERGE_BASE}" ]]; then 2025-09-07T06:40:04.3076458Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.3076592Z  2025-09-07T06:40:04.3076768Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2025-09-07T06:40:04.3076972Z  exit 0 2025-09-07T06:40:04.3077067Z fi 2025-09-07T06:40:04.3077158Z  2025-09-07T06:40:04.3077283Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2025-09-07T06:40:04.3077536Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2025-09-07T06:40:04.3077759Z  exit 1 2025-09-07T06:40:04.3077851Z fi 2025-09-07T06:40:04.3077942Z  2025-09-07T06:40:04.3078091Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2025-09-07T06:40:04.3078334Z # If no image exists but the hash is the same as the previous hash then we should error out here 2025-09-07T06:40:04.3078552Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2025-09-07T06:40:04.3078804Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2025-09-07T06:40:04.3079084Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2025-09-07T06:40:04.3079258Z fi 2025-09-07T06:40:04.3079349Z  2025-09-07T06:40:04.3079460Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-09-07T06:40:04.3085367Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:04.3085529Z env: 2025-09-07T06:40:04.3085632Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:04.3085777Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:04.3086045Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:04.3086211Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:04.3086600Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:04.3086979Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:40:04.3087099Z AWS_REGION: us-east-1 2025-09-07T06:40:04.3087380Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:40:04.3087554Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:40:04.3090044Z AWS_SESSION_TOKEN: *** 2025-09-07T06:40:04.3090164Z DOCKER_BUILD_DIR: .ci/docker 2025-09-07T06:40:04.3090305Z BASE_REVISION: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:40:04.3094080Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.3094467Z DOCKER_TAG: pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:04.3094693Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:04.3094841Z DOCKER_PUSH: 2025-09-07T06:40:04.3094936Z ##[endgroup] 2025-09-07T06:40:04.3116843Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:04.3117019Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:04.3119661Z + aws ecr get-login-password --region us-east-1 2025-09-07T06:40:04.3120746Z /home/runner/_work/_temp/c531d690-3d0b-477e-ada1-85186b75eee9.sh: line 5: aws: command not found 2025-09-07T06:40:04.3121356Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:04.3219469Z Error: Cannot perform an interactive login from a non TTY device 2025-09-07T06:40:04.3229067Z + sleep 1 2025-09-07T06:40:05.3241013Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:05.3245656Z + aws ecr get-login-password --region us-east-1 2025-09-07T06:40:05.3246323Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:05.3247054Z /home/runner/_work/_temp/c531d690-3d0b-477e-ada1-85186b75eee9.sh: line 5: aws: command not found 2025-09-07T06:40:05.3357901Z Error: Cannot perform an interactive login from a non TTY device 2025-09-07T06:40:05.3369254Z + sleep 2 2025-09-07T06:40:07.3381161Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:07.3383925Z + aws ecr get-login-password --region us-east-1 2025-09-07T06:40:07.3384552Z /home/runner/_work/_temp/c531d690-3d0b-477e-ada1-85186b75eee9.sh: line 5: aws: command not found 2025-09-07T06:40:07.3397102Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:07.3484323Z Error: Cannot perform an interactive login from a non TTY device 2025-09-07T06:40:07.3505978Z ++ date +%s 2025-09-07T06:40:07.3515224Z + START_TIME=1757227207 2025-09-07T06:40:07.3519939Z ++ date +%s 2025-09-07T06:40:07.3529870Z + [[ 1757220007 -lt 1757227207 ]] 2025-09-07T06:40:07.3530872Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:07.9336732Z { 2025-09-07T06:40:07.9337072Z "schemaVersion": 2, 2025-09-07T06:40:07.9345822Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2025-09-07T06:40:07.9346088Z "config": { 2025-09-07T06:40:07.9346285Z "mediaType": "application/vnd.docker.container.image.v1+json", 2025-09-07T06:40:07.9346525Z "size": 28673, 2025-09-07T06:40:07.9346766Z "digest": "sha256:75a9a3098f66b0be74794dd2bc3dbb7161d42e50706a0abd073b4e2e9b01a0df" 2025-09-07T06:40:07.9347030Z }, 2025-09-07T06:40:07.9347155Z "layers": [ 2025-09-07T06:40:07.9347306Z { 2025-09-07T06:40:07.9347499Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9347722Z "size": 30592514, 2025-09-07T06:40:07.9348352Z "digest": "sha256:de66fc90c55d156d6760975acf0904d151017e48c9cfc68beedb51af31dc792e" 2025-09-07T06:40:07.9348611Z }, 2025-09-07T06:40:07.9348735Z { 2025-09-07T06:40:07.9348911Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9349146Z "size": 1554, 2025-09-07T06:40:07.9349366Z "digest": "sha256:efc45b9044a6cbae9d1981fa8f749b3b24e14bf1e2227b92e3e19d9f6f73f452" 2025-09-07T06:40:07.9349620Z }, 2025-09-07T06:40:07.9349736Z { 2025-09-07T06:40:07.9349918Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9350140Z "size": 335761518, 2025-09-07T06:40:07.9352894Z "digest": "sha256:06ce422a41d1c7cf432f8974e1d58813ddd8b819e07f30b0fb9e4b60a59cae0f" 2025-09-07T06:40:07.9353230Z }, 2025-09-07T06:40:07.9353313Z { 2025-09-07T06:40:07.9353584Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9353756Z "size": 703, 2025-09-07T06:40:07.9353934Z "digest": "sha256:673cf5ffa968806cdb68202cfe5926a9aec2cf5d3767ae0ff0da0ec13944178b" 2025-09-07T06:40:07.9354125Z }, 2025-09-07T06:40:07.9354205Z { 2025-09-07T06:40:07.9354337Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9354501Z "size": 1767, 2025-09-07T06:40:07.9354678Z "digest": "sha256:3042b077c06a48f78067f51e7ff8452d751af6ee0fbed1b4b316f96cc5e57e43" 2025-09-07T06:40:07.9354862Z }, 2025-09-07T06:40:07.9354952Z { 2025-09-07T06:40:07.9355086Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9355247Z "size": 486, 2025-09-07T06:40:07.9355414Z "digest": "sha256:ed25a020f194dda6e6ab0877fd48493d87d9f9c32f4080506829d4e1466654da" 2025-09-07T06:40:07.9355599Z }, 2025-09-07T06:40:07.9355676Z { 2025-09-07T06:40:07.9355809Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9357388Z "size": 120654516, 2025-09-07T06:40:07.9357573Z "digest": "sha256:a5876169851fc36e12eee569ea9b8bc8148ca43a0154e2890abf9e7b4313d42f" 2025-09-07T06:40:07.9357761Z }, 2025-09-07T06:40:07.9357836Z { 2025-09-07T06:40:07.9357982Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9358151Z "size": 4211, 2025-09-07T06:40:07.9358322Z "digest": "sha256:4971bfcf31c16df24b1203a98f4441cffb29a6802fd2e2e72524ad3c72648257" 2025-09-07T06:40:07.9358560Z + exit 0 2025-09-07T06:40:07.9358644Z }, 2025-09-07T06:40:07.9358726Z { 2025-09-07T06:40:07.9358854Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9360356Z "size": 1709, 2025-09-07T06:40:07.9360679Z "digest": "sha256:4d141034e9db8b1efd107fd8b817c312ebbfb12750bb3d105c969fc395cdb30f" 2025-09-07T06:40:07.9360919Z }, 2025-09-07T06:40:07.9360997Z { 2025-09-07T06:40:07.9361140Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9361313Z "size": 724, 2025-09-07T06:40:07.9361494Z "digest": "sha256:11edb6ea0bca3be307ef836b0bd07999ff562bcb7a807f5e6c9f7d4d5f976b5d" 2025-09-07T06:40:07.9361685Z }, 2025-09-07T06:40:07.9361764Z { 2025-09-07T06:40:07.9363316Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9363479Z "size": 3413656367, 2025-09-07T06:40:07.9363645Z "digest": "sha256:dc4852f72739939e80f47cc3e9ca55450851f269cad1f92f0727db6034824034" 2025-09-07T06:40:07.9363811Z }, 2025-09-07T06:40:07.9363880Z { 2025-09-07T06:40:07.9364000Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9364151Z "size": 381, 2025-09-07T06:40:07.9364302Z "digest": "sha256:829c85269cfc15438c511c0c1653d636a5028595b003f37e6a1a7f7bc8a41e13" 2025-09-07T06:40:07.9364464Z }, 2025-09-07T06:40:07.9364534Z { 2025-09-07T06:40:07.9364653Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9365808Z "size": 65173690, 2025-09-07T06:40:07.9365968Z "digest": "sha256:77ab4e659dd80460fd49a6261b6f368f2c70f74564b0f42dda6754c258191401" 2025-09-07T06:40:07.9366204Z }, 2025-09-07T06:40:07.9366274Z { 2025-09-07T06:40:07.9366394Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9366543Z "size": 792, 2025-09-07T06:40:07.9366689Z "digest": "sha256:c0da146487b65750b761c379246382215960693f02f4d35da4123d108fa13e2c" 2025-09-07T06:40:07.9366849Z }, 2025-09-07T06:40:07.9366919Z { 2025-09-07T06:40:07.9367037Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9367185Z "size": 106, 2025-09-07T06:40:07.9368261Z "digest": "sha256:a61c8111f4664262286755a8d5cfbae93144f18983033686df72956f655fd8da" 2025-09-07T06:40:07.9368538Z }, 2025-09-07T06:40:07.9368608Z { 2025-09-07T06:40:07.9368725Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9368872Z "size": 1495, 2025-09-07T06:40:07.9369074Z "digest": "sha256:720fb67e397fe91e4223cbbcd9dc794509a831119befac538606189a03cfec2a" 2025-09-07T06:40:07.9369240Z }, 2025-09-07T06:40:07.9369313Z { 2025-09-07T06:40:07.9369432Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9369581Z "size": 544075804, 2025-09-07T06:40:07.9369741Z "digest": "sha256:fa7524284edda12fb597eff06ec9d91998a88c828ea68d17de3acd97c5c013a2" 2025-09-07T06:40:07.9370849Z }, 2025-09-07T06:40:07.9370920Z { 2025-09-07T06:40:07.9371038Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9371187Z "size": 163, 2025-09-07T06:40:07.9371342Z "digest": "sha256:57cfc9fee363cabe5cb12ea4bf911816673ac774454cab777c9c56de243e5d11" 2025-09-07T06:40:07.9371511Z }, 2025-09-07T06:40:07.9371580Z { 2025-09-07T06:40:07.9371698Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9371845Z "size": 2484, 2025-09-07T06:40:07.9372011Z "digest": "sha256:c9e2c9bad36d9f9352a75c2fbfe035a0afc8dfdccd0b3e90b24416c6ba2a7752" 2025-09-07T06:40:07.9372183Z }, 2025-09-07T06:40:07.9373255Z { 2025-09-07T06:40:07.9373377Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9373529Z "size": 8101153352, 2025-09-07T06:40:07.9373693Z "digest": "sha256:8257abce8e9b64cd390c42a72eadc914605f609b05bd66b7bdd8dcd3c69762e6" 2025-09-07T06:40:07.9373863Z }, 2025-09-07T06:40:07.9373933Z { 2025-09-07T06:40:07.9374051Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9374199Z "size": 105, 2025-09-07T06:40:07.9374351Z "digest": "sha256:8b81352a9241e7e164f3914cdaddd7621691d5819a09d7bdd73d33dd6efb95b0" 2025-09-07T06:40:07.9374520Z }, 2025-09-07T06:40:07.9374590Z { 2025-09-07T06:40:07.9375641Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9375789Z "size": 612, 2025-09-07T06:40:07.9375939Z "digest": "sha256:5acab4245292ebd11967968c31dcfd205a062ba8d51cd5434d1769be24bac138" 2025-09-07T06:40:07.9376106Z }, 2025-09-07T06:40:07.9376176Z { 2025-09-07T06:40:07.9376297Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9376444Z "size": 677677428, 2025-09-07T06:40:07.9376602Z "digest": "sha256:93616f9ff93b1a86c403d552a522bd7f5e94087dfae8591a702cb8ff6093fae6" 2025-09-07T06:40:07.9376763Z }, 2025-09-07T06:40:07.9376833Z { 2025-09-07T06:40:07.9376948Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9377093Z "size": 111, 2025-09-07T06:40:07.9378134Z "digest": "sha256:89ff93a7db63b67e6ddd0b6e69eb9ffeab124cbf549858da43069963395d404d" 2025-09-07T06:40:07.9378299Z }, 2025-09-07T06:40:07.9378370Z { 2025-09-07T06:40:07.9378485Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9378629Z "size": 1556, 2025-09-07T06:40:07.9378777Z "digest": "sha256:adfe896bf742a7a6b30805ef505693d995588c103230a34431783a81ca85c077" 2025-09-07T06:40:07.9378941Z }, 2025-09-07T06:40:07.9379010Z { 2025-09-07T06:40:07.9379126Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9379329Z "size": 107, 2025-09-07T06:40:07.9379477Z "digest": "sha256:4fa7b9266ac51619223af08624f19dce4b7d1dc0a61bb8c2e5988b893c6d70a1" 2025-09-07T06:40:07.9380518Z }, 2025-09-07T06:40:07.9380591Z { 2025-09-07T06:40:07.9380706Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9380848Z "size": 166, 2025-09-07T06:40:07.9380993Z "digest": "sha256:96da3351f8428b796952af029c90aee281f004276ea90b18e218fff582bf409a" 2025-09-07T06:40:07.9381151Z }, 2025-09-07T06:40:07.9381220Z { 2025-09-07T06:40:07.9381334Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9381478Z "size": 2935895, 2025-09-07T06:40:07.9381625Z "digest": "sha256:6004d474c5463aa044b392956e9e88325038136a49c9169fba705e2a72148f35" 2025-09-07T06:40:07.9381782Z }, 2025-09-07T06:40:07.9382762Z { 2025-09-07T06:40:07.9382881Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9383026Z "size": 107, 2025-09-07T06:40:07.9383280Z "digest": "sha256:d52b1118c4f366c0f69f64208f225eba56749f199802befd21b36e4054819601" 2025-09-07T06:40:07.9383441Z }, 2025-09-07T06:40:07.9383510Z { 2025-09-07T06:40:07.9383626Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9383769Z "size": 828, 2025-09-07T06:40:07.9383916Z "digest": "sha256:90710e19b4303a37da4fde82eed1dc78966f7904419f77bee203caec68b38dc6" 2025-09-07T06:40:07.9384078Z }, 2025-09-07T06:40:07.9384147Z { 2025-09-07T06:40:07.9385147Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9385293Z "size": 25811776, 2025-09-07T06:40:07.9385448Z "digest": "sha256:e8f510972d1a9d2d7d58d5047bd16e0761df5ae89d0900cb3737a37ece65ba9c" 2025-09-07T06:40:07.9385608Z }, 2025-09-07T06:40:07.9385677Z { 2025-09-07T06:40:07.9385796Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9385939Z "size": 104, 2025-09-07T06:40:07.9386088Z "digest": "sha256:705289c9d65eb4dc74002683aeb6bf44a1fbb7a595d359b70132eced0a396222" 2025-09-07T06:40:07.9386250Z }, 2025-09-07T06:40:07.9386320Z { 2025-09-07T06:40:07.9386435Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9387443Z "size": 425, 2025-09-07T06:40:07.9387589Z "digest": "sha256:aa3590d8b0d480b1152679e07759b95d93710df177747ef8685d3c64dd968a80" 2025-09-07T06:40:07.9387749Z }, 2025-09-07T06:40:07.9387817Z { 2025-09-07T06:40:07.9387932Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9388076Z "size": 19279569, 2025-09-07T06:40:07.9388232Z "digest": "sha256:b790e385f849ac4fe803ffe765d93d9e52dfaf532dc3d7e77560d9361d25e4c4" 2025-09-07T06:40:07.9388395Z }, 2025-09-07T06:40:07.9388464Z { 2025-09-07T06:40:07.9388580Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9388725Z "size": 639, 2025-09-07T06:40:07.9389749Z "digest": "sha256:7f422bd7611be8b204f81a16d84217dc35125fb6ae4ab3912f7ac883afb9d143" 2025-09-07T06:40:07.9389910Z }, 2025-09-07T06:40:07.9389979Z { 2025-09-07T06:40:07.9390096Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9390239Z "size": 724, 2025-09-07T06:40:07.9390390Z "digest": "sha256:11edb6ea0bca3be307ef836b0bd07999ff562bcb7a807f5e6c9f7d4d5f976b5d" 2025-09-07T06:40:07.9390555Z }, 2025-09-07T06:40:07.9390623Z { 2025-09-07T06:40:07.9390738Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9390881Z "size": 148, 2025-09-07T06:40:07.9391030Z "digest": "sha256:8e1167399aca20f7e0ac2500fb735ae2974a9f062a74e024b8f1d5f8b4faf6bd" 2025-09-07T06:40:07.9392062Z }, 2025-09-07T06:40:07.9392132Z { 2025-09-07T06:40:07.9392246Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9392393Z "size": 136, 2025-09-07T06:40:07.9392540Z "digest": "sha256:d157c63b23dc8bf7981fbe850c79a1eb2960e26ebc0344757c7f98665b7d686d" 2025-09-07T06:40:07.9392757Z }, 2025-09-07T06:40:07.9392827Z { 2025-09-07T06:40:07.9392942Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9393177Z "size": 140, 2025-09-07T06:40:07.9393324Z "digest": "sha256:ec0c7fb1e2871ad72728e420724306dd5bd0c969056666bdb0cf8c299197ac60" 2025-09-07T06:40:07.9393485Z }, 2025-09-07T06:40:07.9394453Z { 2025-09-07T06:40:07.9394568Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9394710Z "size": 32, 2025-09-07T06:40:07.9394860Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T06:40:07.9395024Z }, 2025-09-07T06:40:07.9395094Z { 2025-09-07T06:40:07.9395208Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9395350Z "size": 223, 2025-09-07T06:40:07.9395564Z "digest": "sha256:1e33591be1b2caebfdb79544377eb56d04ffc3f9859ae7bff1d0d319078a9440" 2025-09-07T06:40:07.9395730Z }, 2025-09-07T06:40:07.9395802Z { 2025-09-07T06:40:07.9396809Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9396952Z "size": 347, 2025-09-07T06:40:07.9397099Z "digest": "sha256:7988968c85d36793ccaf1bf4382d8df2dced38c1c0eddab511d0d4770f1d4b0a" 2025-09-07T06:40:07.9397263Z }, 2025-09-07T06:40:07.9397332Z { 2025-09-07T06:40:07.9397446Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9397589Z "size": 88301, 2025-09-07T06:40:07.9397741Z "digest": "sha256:91a6ca8580eebcfcf0791ff40d3862a199ec745c737eee389bcd2988e2d8ade2" 2025-09-07T06:40:07.9397905Z }, 2025-09-07T06:40:07.9397974Z { 2025-09-07T06:40:07.9398087Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9399100Z "size": 106, 2025-09-07T06:40:07.9399249Z "digest": "sha256:b14b67d48e1dbd915a6da5b1d21a7b6eda25f453044993909b2f4843ab3fe279" 2025-09-07T06:40:07.9399416Z }, 2025-09-07T06:40:07.9399485Z { 2025-09-07T06:40:07.9399602Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9399745Z "size": 1665, 2025-09-07T06:40:07.9399893Z "digest": "sha256:b192db73bfe1da14e42a568d19255310ed73477fcc8608b344f4b5e6baf6d8ac" 2025-09-07T06:40:07.9400054Z }, 2025-09-07T06:40:07.9400124Z { 2025-09-07T06:40:07.9400237Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9400380Z "size": 724, 2025-09-07T06:40:07.9401397Z "digest": "sha256:11edb6ea0bca3be307ef836b0bd07999ff562bcb7a807f5e6c9f7d4d5f976b5d" 2025-09-07T06:40:07.9401563Z }, 2025-09-07T06:40:07.9401632Z { 2025-09-07T06:40:07.9401747Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9401889Z "size": 138, 2025-09-07T06:40:07.9402035Z "digest": "sha256:2150bf3310869a53ad8f3c61553cf421e8166d06bac5badf027d5a8c8c27293d" 2025-09-07T06:40:07.9402200Z }, 2025-09-07T06:40:07.9402270Z { 2025-09-07T06:40:07.9402386Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9402529Z "size": 120, 2025-09-07T06:40:07.9402674Z "digest": "sha256:733c737688573b91b5f7356eb0e1841ec926e30ea6dc7b6c947d3fe38037f4ba" 2025-09-07T06:40:07.9403805Z }, 2025-09-07T06:40:07.9403875Z { 2025-09-07T06:40:07.9403992Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9404139Z "size": 5387023681, 2025-09-07T06:40:07.9404295Z "digest": "sha256:b61655c9140ac745bb4ede98af919309736dfcf4205c1a8d8e741481940d93fd" 2025-09-07T06:40:07.9404458Z }, 2025-09-07T06:40:07.9404528Z { 2025-09-07T06:40:07.9404643Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9404785Z "size": 174, 2025-09-07T06:40:07.9404933Z "digest": "sha256:e86fed99150a751abc2fc621813b3c422f30ef2b69140ed8ecf6dac1d67a9e51" 2025-09-07T06:40:07.9405101Z }, 2025-09-07T06:40:07.9406059Z { 2025-09-07T06:40:07.9406175Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9406372Z "size": 1897, 2025-09-07T06:40:07.9406520Z "digest": "sha256:81d56f8c0e9e96289a7250e45d9cc29663b554c56251c1fee391de9bebf0c201" 2025-09-07T06:40:07.9406680Z }, 2025-09-07T06:40:07.9406749Z { 2025-09-07T06:40:07.9406864Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9407008Z "size": 162692045, 2025-09-07T06:40:07.9407158Z "digest": "sha256:c3379e965cca765342286c4f615b0ee640287447f7077d915d485ee09f5e0567" 2025-09-07T06:40:07.9407317Z }, 2025-09-07T06:40:07.9407386Z { 2025-09-07T06:40:07.9408463Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9408608Z "size": 302, 2025-09-07T06:40:07.9408752Z "digest": "sha256:ca8d286566c546411a1541f9e11d22786fae23a1d8004f8e69e283ce89ad2916" 2025-09-07T06:40:07.9408911Z }, 2025-09-07T06:40:07.9409024Z { 2025-09-07T06:40:07.9409139Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9409281Z "size": 32, 2025-09-07T06:40:07.9409435Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-09-07T06:40:07.9409599Z }, 2025-09-07T06:40:07.9409668Z { 2025-09-07T06:40:07.9409782Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9410838Z "size": 108, 2025-09-07T06:40:07.9410988Z "digest": "sha256:ac22ab96541095de08a583bdf8af502c383a8dd4f25afa1712460ffc31c81514" 2025-09-07T06:40:07.9411152Z }, 2025-09-07T06:40:07.9411222Z { 2025-09-07T06:40:07.9411337Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-09-07T06:40:07.9411482Z "size": 54145699, 2025-09-07T06:40:07.9411637Z "digest": "sha256:6fd45892b6e79a95321086f1d7842aeaf6fd2adaa82c3c8439efef9a5d79fb8d" 2025-09-07T06:40:07.9411799Z } 2025-09-07T06:40:07.9411869Z ] 2025-09-07T06:40:07.9411944Z } 2025-09-07T06:40:07.9435799Z ##[group]Run set -eux 2025-09-07T06:40:07.9435943Z set -eux 2025-09-07T06:40:07.9436101Z # It's ok if this steps fails, it would then be an anonymous user like what we used to have 2025-09-07T06:40:07.9436513Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin || true 2025-09-07T06:40:07.9442641Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:07.9442790Z env: 2025-09-07T06:40:07.9442889Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:07.9443028Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:07.9443395Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:07.9443564Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:07.9443950Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:07.9444325Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:40:07.9444446Z AWS_REGION: us-east-1 2025-09-07T06:40:07.9444660Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:40:07.9444816Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:40:07.9447183Z AWS_SESSION_TOKEN: *** 2025-09-07T06:40:07.9447295Z ##[endgroup] 2025-09-07T06:40:07.9471810Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2025-09-07T06:40:07.9472139Z /home/runner/_work/_temp/a3200b63-c891-4a8b-a317-c2e229bef394.sh: line 3: aws: command not found 2025-09-07T06:40:07.9473032Z + jq --raw-output .SecretString 2025-09-07T06:40:07.9473353Z + jq -r .docker_hub_readonly_token 2025-09-07T06:40:07.9473815Z + docker login --username pytorchbot --password-stdin 2025-09-07T06:40:07.9590673Z Error: Cannot perform an interactive login from a non TTY device 2025-09-07T06:40:07.9600258Z + true 2025-09-07T06:40:07.9675504Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2025-09-07T06:40:07.9675693Z with: 2025-09-07T06:40:07.9675964Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:07.9676290Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:07.9676451Z env: 2025-09-07T06:40:07.9676552Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:07.9676696Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:07.9676876Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:07.9677040Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:07.9677425Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:07.9677916Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:40:07.9678039Z AWS_REGION: us-east-1 2025-09-07T06:40:07.9680770Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:40:07.9680920Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:40:07.9683398Z AWS_SESSION_TOKEN: *** 2025-09-07T06:40:07.9683500Z ##[endgroup] 2025-09-07T06:40:07.9697861Z ##[group]Run set -x 2025-09-07T06:40:07.9697979Z set -x 2025-09-07T06:40:07.9698065Z set +e 2025-09-07T06:40:07.9698149Z  2025-09-07T06:40:07.9698229Z login() { 2025-09-07T06:40:07.9698412Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-09-07T06:40:07.9698597Z } 2025-09-07T06:40:07.9698677Z  2025-09-07T06:40:07.9698758Z retry () { 2025-09-07T06:40:07.9698866Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-09-07T06:40:07.9698982Z } 2025-09-07T06:40:07.9699061Z  2025-09-07T06:40:07.9699156Z retry login "${DOCKER_REGISTRY}" 2025-09-07T06:40:07.9699270Z  2025-09-07T06:40:07.9699447Z IMAGE_SIZE=$(docker manifest inspect "${DOCKER_IMAGE}" | jq '[.layers[].size, .config.size] | add / 1024 / 1024') 2025-09-07T06:40:07.9701626Z echo "Compressed size of image in MB: ${IMAGE_SIZE}" 2025-09-07T06:40:07.9701772Z  2025-09-07T06:40:07.9701851Z set -e 2025-09-07T06:40:07.9701979Z # ignore output since only exit code is used for conditional 2025-09-07T06:40:07.9702154Z # only pull docker image if it's not available locally 2025-09-07T06:40:07.9702348Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2025-09-07T06:40:07.9702528Z  retry docker pull "${DOCKER_IMAGE}" 2025-09-07T06:40:07.9702646Z fi 2025-09-07T06:40:07.9708351Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:40:07.9708489Z env: 2025-09-07T06:40:07.9710616Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:40:07.9710756Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:40:07.9710925Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:40:07.9711081Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:40:07.9711449Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:40:07.9711804Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:40:07.9711914Z AWS_REGION: us-east-1 2025-09-07T06:40:07.9712053Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:40:07.9712197Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:40:07.9714644Z AWS_SESSION_TOKEN: *** 2025-09-07T06:40:07.9714911Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:07.9717255Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:07.9717402Z ##[endgroup] 2025-09-07T06:40:07.9737420Z + set +e 2025-09-07T06:40:07.9737620Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:07.9737787Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:07.9741784Z + aws ecr get-login-password --region us-east-1 2025-09-07T06:40:07.9742402Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:07.9742814Z /home/runner/_work/_temp/115efa5b-beec-4903-b544-fb3e3e882a87.sh: line 5: aws: command not found 2025-09-07T06:40:07.9834043Z Error: Cannot perform an interactive login from a non TTY device 2025-09-07T06:40:07.9844168Z + sleep 1 2025-09-07T06:40:08.9858783Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:08.9861501Z + aws ecr get-login-password --region us-east-1 2025-09-07T06:40:08.9861868Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:08.9862627Z /home/runner/_work/_temp/115efa5b-beec-4903-b544-fb3e3e882a87.sh: line 5: aws: command not found 2025-09-07T06:40:08.9973062Z Error: Cannot perform an interactive login from a non TTY device 2025-09-07T06:40:08.9986584Z + sleep 2 2025-09-07T06:40:11.0002081Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:11.0003713Z + aws ecr get-login-password --region us-east-1 2025-09-07T06:40:11.0004276Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T06:40:11.0005009Z /home/runner/_work/_temp/115efa5b-beec-4903-b544-fb3e3e882a87.sh: line 5: aws: command not found 2025-09-07T06:40:11.0102964Z Error: Cannot perform an interactive login from a non TTY device 2025-09-07T06:40:11.0120850Z ++ jq '[.layers[].size, .config.size] | add / 1024 / 1024' 2025-09-07T06:40:11.0122167Z ++ docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:11.5410852Z + IMAGE_SIZE=18063.334635734558 2025-09-07T06:40:11.5411197Z Compressed size of image in MB: 18063.334635734558 2025-09-07T06:40:11.5421933Z + echo 'Compressed size of image in MB: 18063.334635734558' 2025-09-07T06:40:11.5422150Z + set -e 2025-09-07T06:40:11.5422550Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:11.5542222Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:11.5542763Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:40:13.5781133Z pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77: Pulling from pytorch/ci-image 2025-09-07T06:40:13.5781443Z de66fc90c55d: Pulling fs layer 2025-09-07T06:40:13.5781614Z efc45b9044a6: Pulling fs layer 2025-09-07T06:40:13.5781729Z 06ce422a41d1: Pulling fs layer 2025-09-07T06:40:13.5787775Z 673cf5ffa968: Pulling fs layer 2025-09-07T06:40:13.5787906Z 3042b077c06a: Pulling fs layer 2025-09-07T06:40:13.5788022Z ed25a020f194: Pulling fs layer 2025-09-07T06:40:13.5788136Z a5876169851f: Pulling fs layer 2025-09-07T06:40:13.5788250Z 4971bfcf31c1: Pulling fs layer 2025-09-07T06:40:13.5788364Z 4d141034e9db: Pulling fs layer 2025-09-07T06:40:13.5788475Z 11edb6ea0bca: Pulling fs layer 2025-09-07T06:40:13.5788584Z dc4852f72739: Pulling fs layer 2025-09-07T06:40:13.5788686Z 829c85269cfc: Pulling fs layer 2025-09-07T06:40:13.5788786Z 77ab4e659dd8: Pulling fs layer 2025-09-07T06:40:13.5788884Z ed25a020f194: Waiting 2025-09-07T06:40:13.5788991Z c0da146487b6: Pulling fs layer 2025-09-07T06:40:13.5789102Z a61c8111f466: Pulling fs layer 2025-09-07T06:40:13.5789208Z 673cf5ffa968: Waiting 2025-09-07T06:40:13.5789344Z a5876169851f: Waiting 2025-09-07T06:40:13.5789771Z 3042b077c06a: Waiting 2025-09-07T06:40:13.5789869Z 11edb6ea0bca: Waiting 2025-09-07T06:40:13.5789971Z 720fb67e397f: Pulling fs layer 2025-09-07T06:40:13.5790084Z fa7524284edd: Pulling fs layer 2025-09-07T06:40:13.5790193Z 4971bfcf31c1: Waiting 2025-09-07T06:40:13.5790295Z 57cfc9fee363: Pulling fs layer 2025-09-07T06:40:13.5790399Z dc4852f72739: Waiting 2025-09-07T06:40:13.5790501Z c9e2c9bad36d: Pulling fs layer 2025-09-07T06:40:13.5790610Z 829c85269cfc: Waiting 2025-09-07T06:40:13.5790707Z 77ab4e659dd8: Waiting 2025-09-07T06:40:13.5790808Z 8257abce8e9b: Pulling fs layer 2025-09-07T06:40:13.5790915Z 720fb67e397f: Waiting 2025-09-07T06:40:13.5791013Z c0da146487b6: Waiting 2025-09-07T06:40:13.5791114Z 8b81352a9241: Pulling fs layer 2025-09-07T06:40:13.5791221Z a61c8111f466: Waiting 2025-09-07T06:40:13.5791317Z 5acab4245292: Pulling fs layer 2025-09-07T06:40:13.5791428Z c9e2c9bad36d: Waiting 2025-09-07T06:40:13.5791529Z 93616f9ff93b: Pulling fs layer 2025-09-07T06:40:13.5791639Z fa7524284edd: Waiting 2025-09-07T06:40:13.5791851Z 4d141034e9db: Waiting 2025-09-07T06:40:13.5791954Z 89ff93a7db63: Pulling fs layer 2025-09-07T06:40:13.5792062Z 57cfc9fee363: Waiting 2025-09-07T06:40:13.5792164Z adfe896bf742: Pulling fs layer 2025-09-07T06:40:13.5792273Z 93616f9ff93b: Waiting 2025-09-07T06:40:13.5792364Z 5acab4245292: Waiting 2025-09-07T06:40:13.5792457Z 8257abce8e9b: Waiting 2025-09-07T06:40:13.5792559Z 4fa7b9266ac5: Pulling fs layer 2025-09-07T06:40:13.5792666Z 8b81352a9241: Waiting 2025-09-07T06:40:13.5792762Z adfe896bf742: Waiting 2025-09-07T06:40:13.5792863Z 96da3351f842: Pulling fs layer 2025-09-07T06:40:13.5792971Z 89ff93a7db63: Waiting 2025-09-07T06:40:13.5793164Z 4fa7b9266ac5: Waiting 2025-09-07T06:40:13.5793260Z 6004d474c546: Pulling fs layer 2025-09-07T06:40:13.5793371Z d52b1118c4f3: Pulling fs layer 2025-09-07T06:40:13.5793481Z 90710e19b430: Pulling fs layer 2025-09-07T06:40:13.5793586Z 6004d474c546: Waiting 2025-09-07T06:40:13.5793681Z d52b1118c4f3: Waiting 2025-09-07T06:40:13.5793783Z e8f510972d1a: Pulling fs layer 2025-09-07T06:40:13.5793898Z 90710e19b430: Waiting 2025-09-07T06:40:13.5793999Z 705289c9d65e: Pulling fs layer 2025-09-07T06:40:13.5794111Z aa3590d8b0d4: Pulling fs layer 2025-09-07T06:40:13.5794213Z e8f510972d1a: Waiting 2025-09-07T06:40:13.5794312Z b790e385f849: Pulling fs layer 2025-09-07T06:40:13.5794420Z 7f422bd7611b: Pulling fs layer 2025-09-07T06:40:13.5794526Z b790e385f849: Waiting 2025-09-07T06:40:13.5794625Z 8e1167399aca: Pulling fs layer 2025-09-07T06:40:13.5794735Z aa3590d8b0d4: Waiting 2025-09-07T06:40:13.5794838Z d157c63b23dc: Pulling fs layer 2025-09-07T06:40:13.5794946Z 705289c9d65e: Waiting 2025-09-07T06:40:13.5795047Z ec0c7fb1e287: Pulling fs layer 2025-09-07T06:40:13.5795151Z 8e1167399aca: Waiting 2025-09-07T06:40:13.5795253Z 4f4fb700ef54: Pulling fs layer 2025-09-07T06:40:13.5795359Z 7f422bd7611b: Waiting 2025-09-07T06:40:13.5795459Z 1e33591be1b2: Pulling fs layer 2025-09-07T06:40:13.5795569Z 7988968c85d3: Pulling fs layer 2025-09-07T06:40:13.5795678Z 91a6ca8580ee: Pulling fs layer 2025-09-07T06:40:13.5795792Z ec0c7fb1e287: Waiting 2025-09-07T06:40:13.5795888Z d157c63b23dc: Waiting 2025-09-07T06:40:13.5795989Z 4f4fb700ef54: Waiting 2025-09-07T06:40:13.5796091Z 1e33591be1b2: Waiting 2025-09-07T06:40:13.5796194Z b14b67d48e1d: Pulling fs layer 2025-09-07T06:40:13.5798290Z 7988968c85d3: Waiting 2025-09-07T06:40:13.5798410Z b192db73bfe1: Pulling fs layer 2025-09-07T06:40:13.5798510Z 91a6ca8580ee: Waiting 2025-09-07T06:40:13.5798604Z b14b67d48e1d: Waiting 2025-09-07T06:40:13.5798701Z 2150bf331086: Pulling fs layer 2025-09-07T06:40:13.5798802Z b192db73bfe1: Waiting 2025-09-07T06:40:13.5798895Z 733c73768857: Pulling fs layer 2025-09-07T06:40:13.5799001Z b61655c9140a: Pulling fs layer 2025-09-07T06:40:13.5799104Z e86fed99150a: Pulling fs layer 2025-09-07T06:40:13.5799206Z 81d56f8c0e9e: Pulling fs layer 2025-09-07T06:40:13.5799306Z c3379e965cca: Pulling fs layer 2025-09-07T06:40:13.5800685Z ca8d286566c5: Pulling fs layer 2025-09-07T06:40:13.5800794Z ac22ab965410: Pulling fs layer 2025-09-07T06:40:13.5800980Z 2150bf331086: Waiting 2025-09-07T06:40:13.5801073Z 6fd45892b6e7: Pulling fs layer 2025-09-07T06:40:13.5801169Z 733c73768857: Waiting 2025-09-07T06:40:13.5801256Z 81d56f8c0e9e: Waiting 2025-09-07T06:40:13.5801345Z b61655c9140a: Waiting 2025-09-07T06:40:13.5801431Z c3379e965cca: Waiting 2025-09-07T06:40:13.5801518Z e86fed99150a: Waiting 2025-09-07T06:40:13.5801603Z ac22ab965410: Waiting 2025-09-07T06:40:13.5801687Z 6fd45892b6e7: Waiting 2025-09-07T06:40:13.8017762Z efc45b9044a6: Download complete 2025-09-07T06:40:14.0402210Z 673cf5ffa968: Verifying Checksum 2025-09-07T06:40:14.0402686Z 673cf5ffa968: Download complete 2025-09-07T06:40:14.2510893Z 3042b077c06a: Verifying Checksum 2025-09-07T06:40:14.2511315Z 3042b077c06a: Download complete 2025-09-07T06:40:14.3391299Z de66fc90c55d: Verifying Checksum 2025-09-07T06:40:14.3391867Z de66fc90c55d: Download complete 2025-09-07T06:40:14.5677114Z ed25a020f194: Verifying Checksum 2025-09-07T06:40:14.5686432Z ed25a020f194: Download complete 2025-09-07T06:40:14.7647469Z 4971bfcf31c1: Download complete 2025-09-07T06:40:14.9688676Z 4d141034e9db: Verifying Checksum 2025-09-07T06:40:14.9688849Z 4d141034e9db: Download complete 2025-09-07T06:40:15.4202267Z 11edb6ea0bca: Verifying Checksum 2025-09-07T06:40:15.4202704Z 11edb6ea0bca: Download complete 2025-09-07T06:40:15.8741407Z de66fc90c55d: Pull complete 2025-09-07T06:40:17.1603794Z efc45b9044a6: Pull complete 2025-09-07T06:40:17.4472969Z 06ce422a41d1: Verifying Checksum 2025-09-07T06:40:17.4473396Z 06ce422a41d1: Download complete 2025-09-07T06:40:17.6981827Z 829c85269cfc: Verifying Checksum 2025-09-07T06:40:17.6982115Z 829c85269cfc: Download complete 2025-09-07T06:40:18.6123764Z 77ab4e659dd8: Verifying Checksum 2025-09-07T06:40:18.6124229Z 77ab4e659dd8: Download complete 2025-09-07T06:40:18.8400400Z c0da146487b6: Verifying Checksum 2025-09-07T06:40:18.8400784Z c0da146487b6: Download complete 2025-09-07T06:40:19.0755339Z a61c8111f466: Verifying Checksum 2025-09-07T06:40:19.0756061Z a61c8111f466: Download complete 2025-09-07T06:40:19.2718451Z 720fb67e397f: Verifying Checksum 2025-09-07T06:40:19.2718846Z 720fb67e397f: Download complete 2025-09-07T06:40:20.9016538Z a5876169851f: Verifying Checksum 2025-09-07T06:40:20.9016976Z a5876169851f: Download complete 2025-09-07T06:40:21.1534387Z 57cfc9fee363: Download complete 2025-09-07T06:40:21.3741924Z c9e2c9bad36d: Verifying Checksum 2025-09-07T06:40:21.3742996Z c9e2c9bad36d: Download complete 2025-09-07T06:40:23.5679766Z 06ce422a41d1: Pull complete 2025-09-07T06:40:23.5919911Z 673cf5ffa968: Pull complete 2025-09-07T06:40:23.6356685Z 3042b077c06a: Pull complete 2025-09-07T06:40:23.8470820Z ed25a020f194: Pull complete 2025-09-07T06:40:24.9319028Z fa7524284edd: Verifying Checksum 2025-09-07T06:40:24.9324982Z fa7524284edd: Download complete 2025-09-07T06:40:25.1240001Z a5876169851f: Pull complete 2025-09-07T06:40:25.1337130Z 4971bfcf31c1: Pull complete 2025-09-07T06:40:25.1444142Z 4d141034e9db: Pull complete 2025-09-07T06:40:25.1536646Z 11edb6ea0bca: Pull complete 2025-09-07T06:40:25.1675001Z 8b81352a9241: Download complete 2025-09-07T06:40:25.3820731Z 5acab4245292: Verifying Checksum 2025-09-07T06:40:25.3820940Z 5acab4245292: Download complete 2025-09-07T06:40:32.3593246Z 93616f9ff93b: Verifying Checksum 2025-09-07T06:40:32.3593556Z 93616f9ff93b: Download complete 2025-09-07T06:40:32.5820456Z 89ff93a7db63: Download complete 2025-09-07T06:40:32.7907795Z adfe896bf742: Download complete 2025-09-07T06:40:32.9997788Z 4fa7b9266ac5: Download complete 2025-09-07T06:40:33.2131551Z 96da3351f842: Verifying Checksum 2025-09-07T06:40:33.2131739Z 96da3351f842: Download complete 2025-09-07T06:40:33.5684732Z 6004d474c546: Verifying Checksum 2025-09-07T06:40:33.5685183Z 6004d474c546: Download complete 2025-09-07T06:40:33.7698220Z d52b1118c4f3: Verifying Checksum 2025-09-07T06:40:33.7698438Z d52b1118c4f3: Download complete 2025-09-07T06:40:33.9773302Z 90710e19b430: Verifying Checksum 2025-09-07T06:40:33.9773481Z 90710e19b430: Download complete 2025-09-07T06:40:34.5772513Z e8f510972d1a: Verifying Checksum 2025-09-07T06:40:34.5773371Z e8f510972d1a: Download complete 2025-09-07T06:40:34.8176521Z 705289c9d65e: Verifying Checksum 2025-09-07T06:40:34.8177835Z 705289c9d65e: Download complete 2025-09-07T06:40:35.0334870Z aa3590d8b0d4: Verifying Checksum 2025-09-07T06:40:35.0335327Z aa3590d8b0d4: Download complete 2025-09-07T06:40:35.6276035Z b790e385f849: Verifying Checksum 2025-09-07T06:40:35.6276477Z b790e385f849: Download complete 2025-09-07T06:40:35.8618858Z 7f422bd7611b: Download complete 2025-09-07T06:40:36.0790119Z 8e1167399aca: Verifying Checksum 2025-09-07T06:40:36.0790560Z 8e1167399aca: Download complete 2025-09-07T06:40:36.2988343Z d157c63b23dc: Download complete 2025-09-07T06:40:36.5224214Z ec0c7fb1e287: Verifying Checksum 2025-09-07T06:40:36.5224627Z ec0c7fb1e287: Download complete 2025-09-07T06:40:36.6015658Z 4f4fb700ef54: Download complete 2025-09-07T06:40:36.8114203Z 1e33591be1b2: Download complete 2025-09-07T06:40:37.0527037Z 7988968c85d3: Download complete 2025-09-07T06:40:37.3131328Z 91a6ca8580ee: Verifying Checksum 2025-09-07T06:40:37.3132130Z 91a6ca8580ee: Download complete 2025-09-07T06:40:37.5289292Z b14b67d48e1d: Download complete 2025-09-07T06:40:37.7531121Z b192db73bfe1: Download complete 2025-09-07T06:40:37.9625230Z 2150bf331086: Verifying Checksum 2025-09-07T06:40:37.9625689Z 2150bf331086: Download complete 2025-09-07T06:40:38.1781861Z 733c73768857: Download complete 2025-09-07T06:40:50.4375744Z dc4852f72739: Verifying Checksum 2025-09-07T06:40:50.4376165Z dc4852f72739: Download complete 2025-09-07T06:40:50.6563520Z e86fed99150a: Download complete 2025-09-07T06:40:50.8391945Z 81d56f8c0e9e: Verifying Checksum 2025-09-07T06:40:50.8392156Z 81d56f8c0e9e: Download complete 2025-09-07T06:40:52.6953995Z c3379e965cca: Verifying Checksum 2025-09-07T06:40:52.6955160Z c3379e965cca: Download complete 2025-09-07T06:40:52.9360287Z ca8d286566c5: Verifying Checksum 2025-09-07T06:40:52.9360586Z ca8d286566c5: Download complete 2025-09-07T06:40:53.1374262Z ac22ab965410: Verifying Checksum 2025-09-07T06:40:53.1374918Z ac22ab965410: Download complete 2025-09-07T06:40:55.0543618Z 6fd45892b6e7: Verifying Checksum 2025-09-07T06:40:55.0543854Z 6fd45892b6e7: Download complete 2025-09-07T06:41:17.2836113Z dc4852f72739: Pull complete 2025-09-07T06:41:17.3059930Z 829c85269cfc: Pull complete 2025-09-07T06:41:17.8673030Z 77ab4e659dd8: Pull complete 2025-09-07T06:41:17.8825713Z c0da146487b6: Pull complete 2025-09-07T06:41:17.8974557Z a61c8111f466: Pull complete 2025-09-07T06:41:17.9099579Z 720fb67e397f: Pull complete 2025-09-07T06:41:21.5519115Z fa7524284edd: Pull complete 2025-09-07T06:41:21.5608619Z 57cfc9fee363: Pull complete 2025-09-07T06:41:21.5698636Z c9e2c9bad36d: Pull complete 2025-09-07T06:41:33.0213005Z b61655c9140a: Verifying Checksum 2025-09-07T06:41:33.0213375Z b61655c9140a: Download complete 2025-09-07T06:41:42.5890371Z 8257abce8e9b: Verifying Checksum 2025-09-07T06:41:42.5890629Z 8257abce8e9b: Download complete 2025-09-07T06:42:48.5015295Z 8257abce8e9b: Pull complete 2025-09-07T06:42:49.3209510Z 8b81352a9241: Pull complete 2025-09-07T06:42:49.5895649Z 5acab4245292: Pull complete 2025-09-07T06:42:55.3420672Z 93616f9ff93b: Pull complete 2025-09-07T06:42:55.6204055Z 89ff93a7db63: Pull complete 2025-09-07T06:42:55.8626978Z adfe896bf742: Pull complete 2025-09-07T06:42:56.2434307Z 4fa7b9266ac5: Pull complete 2025-09-07T06:42:56.2603351Z 96da3351f842: Pull complete 2025-09-07T06:42:56.3142091Z 6004d474c546: Pull complete 2025-09-07T06:42:56.3331185Z d52b1118c4f3: Pull complete 2025-09-07T06:42:56.3473885Z 90710e19b430: Pull complete 2025-09-07T06:42:56.6389415Z e8f510972d1a: Pull complete 2025-09-07T06:42:56.6498564Z 705289c9d65e: Pull complete 2025-09-07T06:42:56.6649028Z aa3590d8b0d4: Pull complete 2025-09-07T06:42:56.8073852Z b790e385f849: Pull complete 2025-09-07T06:42:56.8220945Z 7f422bd7611b: Pull complete 2025-09-07T06:42:56.8675078Z 8e1167399aca: Pull complete 2025-09-07T06:42:56.8781091Z d157c63b23dc: Pull complete 2025-09-07T06:42:56.8915491Z ec0c7fb1e287: Pull complete 2025-09-07T06:42:56.9120505Z 4f4fb700ef54: Pull complete 2025-09-07T06:42:56.9337659Z 1e33591be1b2: Pull complete 2025-09-07T06:42:56.9501292Z 7988968c85d3: Pull complete 2025-09-07T06:42:56.9637264Z 91a6ca8580ee: Pull complete 2025-09-07T06:42:56.9767603Z b14b67d48e1d: Pull complete 2025-09-07T06:42:56.9961168Z b192db73bfe1: Pull complete 2025-09-07T06:42:57.0390178Z 2150bf331086: Pull complete 2025-09-07T06:42:57.0569568Z 733c73768857: Pull complete 2025-09-07T06:43:40.0001431Z b61655c9140a: Pull complete 2025-09-07T06:43:40.0109498Z e86fed99150a: Pull complete 2025-09-07T06:43:40.0245909Z 81d56f8c0e9e: Pull complete 2025-09-07T06:43:43.4873457Z c3379e965cca: Pull complete 2025-09-07T06:43:43.5118906Z ca8d286566c5: Pull complete 2025-09-07T06:43:43.5524599Z ac22ab965410: Pull complete 2025-09-07T06:43:44.6903938Z 6fd45892b6e7: Pull complete 2025-09-07T06:43:44.6956818Z Digest: sha256:9e860fd68cd38c78fd118edc6e8b6bbf754ab60affb0c456f2b2696bd7ea79a5 2025-09-07T06:43:44.6971143Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:43:44.6985628Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:43:44.7081694Z Prepare all required actions 2025-09-07T06:43:44.7116347Z ##[group]Run ./.github/actions/get-workflow-job-id 2025-09-07T06:43:44.7116494Z with: 2025-09-07T06:43:44.7119140Z github-token: *** 2025-09-07T06:43:44.7119238Z env: 2025-09-07T06:43:44.7119329Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:43:44.7119469Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:43:44.7119649Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:43:44.7119815Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:43:44.7120205Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:43:44.7120591Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:43:44.7120705Z AWS_REGION: us-east-1 2025-09-07T06:43:44.7120838Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:43:44.7123014Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:43:44.7128752Z AWS_SESSION_TOKEN: *** 2025-09-07T06:43:44.7128989Z ##[endgroup] 2025-09-07T06:43:44.7146911Z ##[group]Run set -eux 2025-09-07T06:43:44.7147041Z set -eux 2025-09-07T06:43:44.7147221Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2025-09-07T06:43:44.7153738Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:43:44.7153894Z env: 2025-09-07T06:43:44.7153997Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:43:44.7154143Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:43:44.7157142Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:43:44.7157308Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:43:44.7157705Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:43:44.7158074Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:43:44.7158187Z AWS_REGION: us-east-1 2025-09-07T06:43:44.7158340Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:43:44.7158627Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:43:44.7161173Z AWS_SESSION_TOKEN: *** 2025-09-07T06:43:44.7161349Z GITHUB_TOKEN: *** 2025-09-07T06:43:44.7161442Z ##[endgroup] 2025-09-07T06:43:44.7217737Z + python3 .github/scripts/get_workflow_job_id.py 17524754565 linux.rocm.gpu.gfx942.1-xb8kr-runner-wp76s 2025-09-07T06:43:45.2951425Z Setting output job-id=49774353518 2025-09-07T06:43:45.2952409Z Setting output job-name=linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:43:45.3087098Z Prepare all required actions 2025-09-07T06:43:45.3087354Z Getting action download info 2025-09-07T06:43:45.5647679Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2025-09-07T06:43:45.9220436Z Download action repository 'actions/download-artifact@v4' (SHA:d3f86a106a0bac45b974a628896c90dbdf5c8093) 2025-09-07T06:43:46.2970886Z ##[group]Run ./.github/actions/download-build-artifacts 2025-09-07T06:43:46.2973594Z with: 2025-09-07T06:43:46.2973752Z name: linux-noble-rocm-py3.12-mi300 2025-09-07T06:43:46.2973937Z s3-bucket: gha-artifacts 2025-09-07T06:43:46.2974084Z env: 2025-09-07T06:43:46.2974211Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:43:46.2974399Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:43:46.2974657Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:43:46.2974889Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:43:46.2975481Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:43:46.2976336Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:43:46.2978732Z AWS_REGION: us-east-1 2025-09-07T06:43:46.2979047Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:43:46.2979264Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:43:46.2983562Z AWS_SESSION_TOKEN: *** 2025-09-07T06:43:46.2983703Z ##[endgroup] 2025-09-07T06:43:46.3010831Z ##[group]Run seemethere/download-artifact-s3@v4 2025-09-07T06:43:46.3014420Z with: 2025-09-07T06:43:46.3014578Z name: linux-noble-rocm-py3.12-mi300 2025-09-07T06:43:46.3014759Z s3-bucket: gha-artifacts 2025-09-07T06:43:46.3014910Z region: us-east-1 2025-09-07T06:43:46.3015038Z env: 2025-09-07T06:43:46.3015165Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:43:46.3015349Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:43:46.3015613Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:43:46.3015877Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:43:46.3016431Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:43:46.3016968Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:43:46.3019594Z AWS_REGION: us-east-1 2025-09-07T06:43:46.3019871Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:43:46.3020094Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:43:46.3025655Z AWS_SESSION_TOKEN: *** 2025-09-07T06:43:46.3025798Z ##[endgroup] 2025-09-07T06:43:46.5565804Z (node:4944) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-09-07T06:43:46.5566114Z 2025-09-07T06:43:46.5566231Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-09-07T06:43:46.5566625Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-09-07T06:43:46.5566968Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-09-07T06:43:46.6779412Z Found 1 objects with prefix pytorch/pytorch/17524754565/linux-noble-rocm-py3.12-mi300/ 2025-09-07T06:43:46.6781042Z Starting download (1/1): /home/runner/_work/pytorch/pytorch/artifacts.zip 2025-09-07T06:43:55.1686501Z Finished download (1/1): /home/runner/_work/pytorch/pytorch/artifacts.zip 2025-09-07T06:43:55.1688765Z Artifact download has finished successfully 2025-09-07T06:43:55.1868483Z ##[group]Run unzip -o artifacts.zip 2025-09-07T06:43:55.1868655Z unzip -o artifacts.zip 2025-09-07T06:43:55.1874123Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:43:55.1874266Z env: 2025-09-07T06:43:55.1874358Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:43:55.1874487Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:43:55.1877099Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:43:55.1877289Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:43:55.1877666Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:43:55.1878029Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:43:55.1878137Z AWS_REGION: us-east-1 2025-09-07T06:43:55.1878337Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:43:55.1878482Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:43:55.1880856Z AWS_SESSION_TOKEN: *** 2025-09-07T06:43:55.1880960Z ##[endgroup] 2025-09-07T06:43:55.1908205Z Archive: artifacts.zip 2025-09-07T06:43:55.1910007Z creating: dist/ 2025-09-07T06:43:56.7165354Z inflating: dist/torch-2.9.0a0+git93fb23d-cp312-cp312-linux_x86_64.whl 2025-09-07T06:43:56.7225474Z inflating: dist/.ninja_log 2025-09-07T06:43:56.7225825Z creating: build/custom_test_artifacts/ 2025-09-07T06:43:56.7226362Z creating: build/custom_test_artifacts/custom-op-build/ 2025-09-07T06:43:56.7226557Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2025-09-07T06:43:56.7268256Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2025-09-07T06:43:56.7268523Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2025-09-07T06:43:56.7268769Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/ 2025-09-07T06:43:56.7269015Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeSystem.cmake 2025-09-07T06:43:56.7269275Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/ 2025-09-07T06:43:56.7269528Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/tmp/ 2025-09-07T06:43:56.7269813Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/CMakeCCompilerId.c 2025-09-07T06:43:56.7270100Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdC/a.out 2025-09-07T06:43:56.7270371Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeCCompiler.cmake 2025-09-07T06:43:56.7270625Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/ 2025-09-07T06:43:56.7270871Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/tmp/ 2025-09-07T06:43:56.7271713Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-09-07T06:43:56.7272210Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CompilerIdCXX/a.out 2025-09-07T06:43:56.7273036Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeCXXCompiler.cmake 2025-09-07T06:43:56.7274015Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_C.bin 2025-09-07T06:43:56.7274330Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_CXX.bin 2025-09-07T06:43:56.7274609Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2025-09-07T06:43:56.7274831Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2025-09-07T06:43:56.7275066Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2025-09-07T06:43:56.7275305Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2025-09-07T06:43:56.7275568Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2025-09-07T06:43:56.7275865Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2025-09-07T06:43:56.7276148Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2025-09-07T06:43:56.7276590Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2025-09-07T06:43:56.7276869Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2025-09-07T06:43:56.7277147Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2025-09-07T06:43:56.7277421Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2025-09-07T06:43:56.7277693Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2025-09-07T06:43:56.7277966Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2025-09-07T06:43:56.7278239Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2025-09-07T06:43:56.7365839Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2025-09-07T06:43:56.7374337Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.d 2025-09-07T06:43:56.7374658Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2025-09-07T06:43:56.7374937Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2025-09-07T06:43:56.7375252Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2025-09-07T06:43:56.7377905Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2025-09-07T06:43:56.7378190Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2025-09-07T06:43:56.7378478Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2025-09-07T06:43:56.7378767Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2025-09-07T06:43:56.7379060Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2025-09-07T06:43:56.7379351Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2025-09-07T06:43:56.7379630Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2025-09-07T06:43:56.7385104Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2025-09-07T06:43:56.7433967Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2025-09-07T06:43:56.7434271Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.d 2025-09-07T06:43:56.7450147Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-09-07T06:43:56.7450563Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2025-09-07T06:43:56.7451495Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2025-09-07T06:43:56.7452144Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2025-09-07T06:43:56.7452746Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2025-09-07T06:43:56.7453446Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/InstallScripts.json 2025-09-07T06:43:56.7454068Z inflating: build/custom_test_artifacts/custom-op-build/hipblaslt_test_outer_vec.cc 2025-09-07T06:43:56.7454680Z inflating: build/custom_test_artifacts/custom-op-build/hipblaslt_test_vec_ext.cc 2025-09-07T06:43:56.7455101Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2025-09-07T06:43:56.7455325Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2025-09-07T06:43:56.7455533Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2025-09-07T06:43:56.7544366Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2025-09-07T06:43:56.7579317Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2025-09-07T06:43:56.7579630Z creating: build/custom_test_artifacts/jit-hook-build/ 2025-09-07T06:43:56.7579922Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2025-09-07T06:43:56.7580324Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2025-09-07T06:43:56.7582958Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2025-09-07T06:43:56.7583282Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/ 2025-09-07T06:43:56.7583514Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeSystem.cmake 2025-09-07T06:43:56.7583763Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/ 2025-09-07T06:43:56.7584012Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/tmp/ 2025-09-07T06:43:56.7603176Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/CMakeCCompilerId.c 2025-09-07T06:43:56.7603876Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdC/a.out 2025-09-07T06:43:56.7604547Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeCCompiler.cmake 2025-09-07T06:43:56.7605163Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/ 2025-09-07T06:43:56.7605772Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/tmp/ 2025-09-07T06:43:56.7606414Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-09-07T06:43:56.7606871Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CompilerIdCXX/a.out 2025-09-07T06:43:56.7607404Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeCXXCompiler.cmake 2025-09-07T06:43:56.7607732Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_C.bin 2025-09-07T06:43:56.7608042Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_CXX.bin 2025-09-07T06:43:56.7608316Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2025-09-07T06:43:56.7608536Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2025-09-07T06:43:56.7611270Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2025-09-07T06:43:56.7611514Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2025-09-07T06:43:56.7611798Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2025-09-07T06:43:56.7612105Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2025-09-07T06:43:56.7612405Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2025-09-07T06:43:56.7612687Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2025-09-07T06:43:56.7612970Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2025-09-07T06:43:56.7613329Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2025-09-07T06:43:56.7613606Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2025-09-07T06:43:56.7613881Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2025-09-07T06:43:56.7614157Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2025-09-07T06:43:56.7615023Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2025-09-07T06:43:56.7644152Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2025-09-07T06:43:56.7645104Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.d 2025-09-07T06:43:56.7645974Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-09-07T06:43:56.7646252Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2025-09-07T06:43:56.7646505Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2025-09-07T06:43:56.7648570Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2025-09-07T06:43:56.7673962Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2025-09-07T06:43:56.7674202Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/InstallScripts.json 2025-09-07T06:43:56.7674447Z inflating: build/custom_test_artifacts/jit-hook-build/hipblaslt_test_outer_vec.cc 2025-09-07T06:43:56.7674858Z inflating: build/custom_test_artifacts/jit-hook-build/hipblaslt_test_vec_ext.cc 2025-09-07T06:43:56.7675083Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2025-09-07T06:43:56.7675279Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2025-09-07T06:43:56.7675478Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2025-09-07T06:43:56.7675690Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2025-09-07T06:43:56.7675882Z creating: build/custom_test_artifacts/custom-backend-build/ 2025-09-07T06:43:56.7676070Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2025-09-07T06:43:56.7676295Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2025-09-07T06:43:56.7676565Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2025-09-07T06:43:56.7676824Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/ 2025-09-07T06:43:56.7677069Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeSystem.cmake 2025-09-07T06:43:56.7677329Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/ 2025-09-07T06:43:56.7679756Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/tmp/ 2025-09-07T06:43:56.7681627Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/CMakeCCompilerId.c 2025-09-07T06:43:56.7682023Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdC/a.out 2025-09-07T06:43:56.7682330Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeCCompiler.cmake 2025-09-07T06:43:56.7682626Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/ 2025-09-07T06:43:56.7682964Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/tmp/ 2025-09-07T06:43:56.7683410Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-09-07T06:43:56.7683751Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CompilerIdCXX/a.out 2025-09-07T06:43:56.7684064Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeCXXCompiler.cmake 2025-09-07T06:43:56.7685023Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_C.bin 2025-09-07T06:43:56.7686146Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/4.0.0/CMakeDetermineCompilerABI_CXX.bin 2025-09-07T06:43:56.7686466Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2025-09-07T06:43:56.7687127Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2025-09-07T06:43:56.7687922Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2025-09-07T06:43:56.7688206Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2025-09-07T06:43:56.7688501Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2025-09-07T06:43:56.7688845Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2025-09-07T06:43:56.7689255Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2025-09-07T06:43:56.7689547Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2025-09-07T06:43:56.7689848Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2025-09-07T06:43:56.7690180Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2025-09-07T06:43:56.7690635Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2025-09-07T06:43:56.7690933Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2025-09-07T06:43:56.7717490Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2025-09-07T06:43:56.7718206Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2025-09-07T06:43:56.7784241Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2025-09-07T06:43:56.7784560Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.d 2025-09-07T06:43:56.7784858Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2025-09-07T06:43:56.7785198Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2025-09-07T06:43:56.7785562Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2025-09-07T06:43:56.7785907Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2025-09-07T06:43:56.7786232Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2025-09-07T06:43:56.7786567Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2025-09-07T06:43:56.7786906Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2025-09-07T06:43:56.7787244Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2025-09-07T06:43:56.7787588Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2025-09-07T06:43:56.7787925Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2025-09-07T06:43:56.7788274Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2025-09-07T06:43:56.7813761Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2025-09-07T06:43:56.7814098Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.d 2025-09-07T06:43:56.7814614Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-09-07T06:43:56.7814937Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2025-09-07T06:43:56.7815380Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2025-09-07T06:43:56.7815690Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2025-09-07T06:43:56.7817559Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2025-09-07T06:43:56.7817824Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/InstallScripts.json 2025-09-07T06:43:56.7818088Z inflating: build/custom_test_artifacts/custom-backend-build/hipblaslt_test_outer_vec.cc 2025-09-07T06:43:56.7818349Z inflating: build/custom_test_artifacts/custom-backend-build/hipblaslt_test_vec_ext.cc 2025-09-07T06:43:56.7821755Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2025-09-07T06:43:56.7822023Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2025-09-07T06:43:56.7822252Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2025-09-07T06:43:56.7893877Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2025-09-07T06:43:56.7907210Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2025-09-07T06:43:56.7907411Z creating: build/lib/ 2025-09-07T06:43:56.7965468Z inflating: build/lib/libprotobuf-lite.a 2025-09-07T06:43:56.8236311Z inflating: build/lib/libprotobuf.a 2025-09-07T06:43:56.8547587Z inflating: build/lib/libprotoc.a 2025-09-07T06:43:56.8554003Z inflating: build/lib/libpthreadpool.a 2025-09-07T06:43:56.8559328Z inflating: build/lib/libcpuinfo.a 2025-09-07T06:43:56.8564484Z inflating: build/lib/libcpuinfo_internals.a 2025-09-07T06:43:56.8564647Z inflating: build/lib/libclog.a 2025-09-07T06:43:56.8577176Z inflating: build/lib/libpytorch_qnnpack.a 2025-09-07T06:43:56.8578738Z inflating: build/lib/libnnpack_reference_layers.a 2025-09-07T06:43:56.8695643Z inflating: build/lib/libmicrokernels-prod.a 2025-09-07T06:43:56.8706825Z inflating: build/lib/libnnpack.a 2025-09-07T06:43:56.9263248Z inflating: build/lib/libmicrokernels-all.a 2025-09-07T06:43:56.9306750Z inflating: build/lib/libgtest.a 2025-09-07T06:43:56.9317617Z inflating: build/lib/libgmock.a 2025-09-07T06:43:56.9317754Z inflating: build/lib/libgtest_main.a 2025-09-07T06:43:56.9317900Z inflating: build/lib/libgmock_main.a 2025-09-07T06:43:56.9375210Z inflating: build/lib/libXNNPACK.a 2025-09-07T06:43:56.9422676Z inflating: build/lib/libbenchmark.a 2025-09-07T06:43:56.9422912Z inflating: build/lib/libbenchmark_main.a 2025-09-07T06:43:56.9464864Z inflating: build/lib/libasmjit.a 2025-09-07T06:43:56.9493872Z inflating: build/lib/libittnotify.a 2025-09-07T06:43:57.0205648Z inflating: build/lib/libfbgemm.a 2025-09-07T06:43:57.0206691Z inflating: build/lib/libjitprofiling.a 2025-09-07T06:43:57.0225698Z inflating: build/lib/libtensorpipe_uv.a 2025-09-07T06:43:57.0575439Z inflating: build/lib/libtensorpipe.a 2025-09-07T06:43:57.0650877Z inflating: build/lib/libgloo.a 2025-09-07T06:43:57.0680464Z inflating: build/lib/libonnx_proto.a 2025-09-07T06:43:57.0942601Z inflating: build/lib/libgloo_hip.a 2025-09-07T06:43:57.1389649Z inflating: build/lib/libonnx.a 2025-09-07T06:43:57.7732078Z inflating: build/lib/libdnnl.a 2025-09-07T06:43:57.7745489Z inflating: build/lib/libfmt.a 2025-09-07T06:43:57.7937570Z inflating: build/lib/libkineto.a 2025-09-07T06:43:57.8013279Z inflating: build/lib/libc10.so 2025-09-07T06:43:57.8014135Z inflating: build/lib/libtorch_global_deps.so 2025-09-07T06:43:57.8019919Z inflating: build/lib/libcaffe2_nvrtc.so 2025-09-07T06:43:57.8053771Z inflating: build/lib/libc10_hip.so 2025-09-07T06:43:57.8425178Z inflating: build/lib/libfbgemm_genai.a 2025-09-07T06:43:59.7327358Z inflating: build/lib/libtorch_cpu.so 2025-09-07T06:43:59.7330093Z inflating: build/lib/libshm.so 2025-09-07T06:44:00.2634672Z inflating: build/lib/libtorch_hip.so 2025-09-07T06:44:00.2635558Z inflating: build/lib/libtorch.so 2025-09-07T06:44:00.2639623Z inflating: build/lib/libjitbackend_test.so 2025-09-07T06:44:00.2683891Z inflating: build/lib/libtorchbind_test.so 2025-09-07T06:44:00.2710034Z inflating: build/lib/libbackend_with_compiler.so 2025-09-07T06:44:00.2716831Z inflating: build/lib/libaoti_custom_ops.so 2025-09-07T06:44:00.4056665Z inflating: build/lib/libtorch_python.so 2025-09-07T06:44:00.4077732Z inflating: build/lib/libnnapi_backend.so 2025-09-07T06:44:00.4098395Z creating: build/bin/ 2025-09-07T06:44:00.4098647Z creating: build/bin/CMakeFiles/ 2025-09-07T06:44:00.4104092Z inflating: build/bin/cmake_install.cmake 2025-09-07T06:44:00.4104578Z inflating: build/bin/CTestTestfile.cmake 2025-09-07T06:44:00.4367120Z inflating: build/bin/protoc-3.13.0.0 2025-09-07T06:44:00.4658752Z inflating: build/bin/protoc 2025-09-07T06:44:00.4693277Z inflating: build/bin/c10_AllocatorConfig_test 2025-09-07T06:44:00.4754948Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2025-09-07T06:44:00.4779041Z inflating: build/bin/c10_DeviceGuard_test 2025-09-07T06:44:00.4811180Z inflating: build/bin/c10_Device_test 2025-09-07T06:44:00.4897384Z inflating: build/bin/c10_DispatchKeySet_test 2025-09-07T06:44:00.4897813Z inflating: build/bin/c10_Scalar_test 2025-09-07T06:44:00.4918598Z inflating: build/bin/c10_StreamGuard_test 2025-09-07T06:44:00.4955681Z inflating: build/bin/c10_SymInt_test 2025-09-07T06:44:00.5001166Z inflating: build/bin/c10_InlineStreamGuard_test 2025-09-07T06:44:00.5033313Z inflating: build/bin/c10_InlineDeviceGuard_test 2025-09-07T06:44:00.5076242Z inflating: build/bin/c10_SizesAndStrides_test 2025-09-07T06:44:00.5108359Z inflating: build/bin/c10_ArrayRef_test 2025-09-07T06:44:00.5155497Z inflating: build/bin/c10_cow_test 2025-09-07T06:44:00.5192135Z inflating: build/bin/c10_Bitset_test 2025-09-07T06:44:00.5226599Z inflating: build/bin/c10_ConstexprCrc_test 2025-09-07T06:44:00.5262083Z inflating: build/bin/c10_DeadlockDetection_test 2025-09-07T06:44:00.5301909Z inflating: build/bin/c10_Enumerate_test 2025-09-07T06:44:00.5337377Z inflating: build/bin/c10_Half_test 2025-09-07T06:44:00.5380515Z inflating: build/bin/c10_IntrusiveList_test 2025-09-07T06:44:00.5413492Z inflating: build/bin/c10_LeftRight_test 2025-09-07T06:44:00.5452202Z inflating: build/bin/c10_Metaprogramming_test 2025-09-07T06:44:00.5489174Z inflating: build/bin/c10_NetworkFlow_test 2025-09-07T06:44:00.5527689Z inflating: build/bin/c10_ThreadLocal_test 2025-09-07T06:44:00.5564783Z inflating: build/bin/c10_Semaphore_test 2025-09-07T06:44:00.5661028Z inflating: build/bin/c10_Synchronized_test 2025-09-07T06:44:00.5661306Z inflating: build/bin/c10_TypeList_test 2025-09-07T06:44:00.5669894Z inflating: build/bin/c10_TypeIndex_test 2025-09-07T06:44:00.5704973Z inflating: build/bin/c10_TypeTraits_test 2025-09-07T06:44:00.5741148Z inflating: build/bin/c10_accumulate_test 2025-09-07T06:44:00.5779759Z inflating: build/bin/c10_complex_math_test 2025-09-07T06:44:00.5818345Z inflating: build/bin/c10_bfloat16_test 2025-09-07T06:44:00.5856855Z inflating: build/bin/c10_complex_test 2025-09-07T06:44:00.5892120Z inflating: build/bin/c10_bit_cast_test 2025-09-07T06:44:00.5926926Z inflating: build/bin/c10_error_test 2025-09-07T06:44:00.5963626Z inflating: build/bin/c10_exception_test 2025-09-07T06:44:00.5999189Z inflating: build/bin/c10_flags_test 2025-09-07T06:44:00.6034758Z inflating: build/bin/c10_generic_math_test 2025-09-07T06:44:00.6070389Z inflating: build/bin/c10_irange_test 2025-09-07T06:44:00.6177960Z inflating: build/bin/c10_intrusive_ptr_test 2025-09-07T06:44:00.6220051Z inflating: build/bin/c10_lazy_test 2025-09-07T06:44:00.6258002Z inflating: build/bin/c10_logging_test 2025-09-07T06:44:00.6307644Z inflating: build/bin/c10_optional_test 2025-09-07T06:44:00.6352330Z inflating: build/bin/c10_ordered_preserving_dict_test 2025-09-07T06:44:00.6387638Z inflating: build/bin/c10_registry_test 2025-09-07T06:44:00.6490525Z inflating: build/bin/c10_small_vector_test 2025-09-07T06:44:00.6534147Z inflating: build/bin/c10_string_util_test 2025-09-07T06:44:00.6586196Z inflating: build/bin/c10_ssize_test 2025-09-07T06:44:00.6603007Z inflating: build/bin/c10_string_view_test 2025-09-07T06:44:00.6634613Z inflating: build/bin/c10_tempfile_test 2025-09-07T06:44:00.6666008Z inflating: build/bin/c10_intrusive_ptr_benchmark 2025-09-07T06:44:00.6730824Z inflating: build/bin/c10_typeid_test 2025-09-07T06:44:00.6765427Z inflating: build/bin/c10_hip_HIPAssertionsTest_1_var_test 2025-09-07T06:44:00.6776500Z inflating: build/bin/c10_hip_HIPAssertionsTest_catches_stream 2025-09-07T06:44:00.6835867Z inflating: build/bin/c10_hip_HIPAssertionsTest_catches_thread_and_block_and_device 2025-09-07T06:44:00.6848652Z inflating: build/bin/c10_hip_HIPAssertionsTest_from_2_processes 2025-09-07T06:44:00.6885072Z inflating: build/bin/c10_hip_HIPAssertionsTest_multiple_writes_from_blocks_and_threads 2025-09-07T06:44:00.6913523Z inflating: build/bin/c10_hip_HIPAssertionsTest_multiple_writes_from_multiple_blocks 2025-09-07T06:44:00.6947840Z inflating: build/bin/c10_hip_HIPAssertionsTest_multiple_writes_from_same_block 2025-09-07T06:44:00.6982275Z inflating: build/bin/c10_hip_HIPTest 2025-09-07T06:44:00.7379006Z inflating: build/bin/vec_test_all_types_DEFAULT 2025-09-07T06:44:00.7753528Z inflating: build/bin/vec_test_all_types_AVX512 2025-09-07T06:44:00.8152816Z inflating: build/bin/vec_test_all_types_AVX2 2025-09-07T06:44:00.8193725Z inflating: build/bin/BackoffTest 2025-09-07T06:44:00.8213937Z inflating: build/bin/FileStoreTest 2025-09-07T06:44:00.8261857Z inflating: build/bin/TCPStoreTest 2025-09-07T06:44:00.8291327Z inflating: build/bin/HashStoreTest 2025-09-07T06:44:00.8338330Z inflating: build/bin/ProcessGroupGlooTest 2025-09-07T06:44:00.8339050Z inflating: build/bin/example_allreduce 2025-09-07T06:44:00.8341064Z inflating: build/bin/torch_shm_manager 2025-09-07T06:44:00.8380296Z inflating: build/bin/static_runtime_bench 2025-09-07T06:44:00.8543857Z inflating: build/bin/static_runtime_test 2025-09-07T06:44:00.8594879Z inflating: build/bin/Dict_test 2025-09-07T06:44:00.8631475Z inflating: build/bin/Dimname_test 2025-09-07T06:44:00.8690143Z inflating: build/bin/MaybeOwned_test 2025-09-07T06:44:00.8722667Z inflating: build/bin/NamedTensor_test 2025-09-07T06:44:00.8763000Z inflating: build/bin/apply_utils_test 2025-09-07T06:44:00.8797278Z inflating: build/bin/atest 2025-09-07T06:44:00.8841465Z inflating: build/bin/basic 2025-09-07T06:44:00.8881239Z inflating: build/bin/broadcast_test 2025-09-07T06:44:00.8923677Z inflating: build/bin/cpu_allocator_test 2025-09-07T06:44:00.8957552Z inflating: build/bin/cpu_generator_test 2025-09-07T06:44:00.8994560Z inflating: build/bin/cpu_profiling_allocator_test 2025-09-07T06:44:00.9057191Z inflating: build/bin/cpu_rng_test 2025-09-07T06:44:00.9092581Z inflating: build/bin/dlconvertor_test 2025-09-07T06:44:00.9132290Z inflating: build/bin/extension_backend_test 2025-09-07T06:44:00.9203836Z inflating: build/bin/half_test 2025-09-07T06:44:00.9236459Z inflating: build/bin/ivalue_test 2025-09-07T06:44:00.9273827Z inflating: build/bin/math_kernel_test 2025-09-07T06:44:00.9311280Z inflating: build/bin/memory_format_test 2025-09-07T06:44:00.9346298Z inflating: build/bin/lazy_tensor_test 2025-09-07T06:44:00.9384126Z inflating: build/bin/memory_overlapping_test 2025-09-07T06:44:00.9419624Z inflating: build/bin/operator_name_test 2025-09-07T06:44:00.9456575Z inflating: build/bin/mobile_memory_cleanup 2025-09-07T06:44:00.9495600Z inflating: build/bin/native_test 2025-09-07T06:44:00.9531920Z inflating: build/bin/packedtensoraccessor_test 2025-09-07T06:44:00.9569015Z inflating: build/bin/operators_test 2025-09-07T06:44:00.9616247Z inflating: build/bin/pow_test 2025-09-07T06:44:00.9655616Z inflating: build/bin/quantized_test 2025-09-07T06:44:00.9690535Z inflating: build/bin/reduce_ops_test 2025-09-07T06:44:00.9726243Z inflating: build/bin/reportMemoryUsage_test 2025-09-07T06:44:00.9762349Z inflating: build/bin/StorageUtils_test 2025-09-07T06:44:00.9803937Z inflating: build/bin/scalar_test 2025-09-07T06:44:00.9843921Z inflating: build/bin/scalar_tensor_test 2025-09-07T06:44:00.9885485Z inflating: build/bin/stride_properties_test 2025-09-07T06:44:00.9919796Z inflating: build/bin/type_ptr_test 2025-09-07T06:44:00.9973355Z inflating: build/bin/tensor_iterator_test 2025-09-07T06:44:01.0014634Z inflating: build/bin/type_test 2025-09-07T06:44:01.0050051Z inflating: build/bin/thread_init_test 2025-09-07T06:44:01.0088022Z inflating: build/bin/test_parallel 2025-09-07T06:44:01.0124461Z inflating: build/bin/undefined_tensor_test 2025-09-07T06:44:01.0159203Z inflating: build/bin/verify_api_visibility 2025-09-07T06:44:01.0207077Z inflating: build/bin/legacy_vmap_test 2025-09-07T06:44:01.0243421Z inflating: build/bin/weakref_test 2025-09-07T06:44:01.0279487Z inflating: build/bin/wrapdim_test 2025-09-07T06:44:01.0315714Z inflating: build/bin/xla_tensor_test 2025-09-07T06:44:01.0386805Z inflating: build/bin/List_test 2025-09-07T06:44:01.0427868Z inflating: build/bin/IListRef_test 2025-09-07T06:44:01.0491801Z inflating: build/bin/kernel_function_test 2025-09-07T06:44:01.0574097Z inflating: build/bin/kernel_function_legacy_test 2025-09-07T06:44:01.0657386Z inflating: build/bin/kernel_lambda_legacy_test 2025-09-07T06:44:01.0702743Z inflating: build/bin/KernelFunction_test 2025-09-07T06:44:01.0744747Z inflating: build/bin/kernel_stackbased_test 2025-09-07T06:44:01.0815093Z inflating: build/bin/kernel_lambda_test 2025-09-07T06:44:01.0850776Z inflating: build/bin/CppSignature_test 2025-09-07T06:44:01.0919111Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2025-09-07T06:44:01.0949359Z inflating: build/bin/op_allowlist_test 2025-09-07T06:44:01.0987684Z inflating: build/bin/backend_fallback_test 2025-09-07T06:44:01.1034238Z inflating: build/bin/inline_container_test 2025-09-07T06:44:01.1068584Z inflating: build/bin/hip_complex_math_test 2025-09-07T06:44:01.1268589Z inflating: build/bin/op_registration_test 2025-09-07T06:44:01.1302815Z inflating: build/bin/hip_complex_test 2025-09-07T06:44:01.1341836Z inflating: build/bin/hip_apply_test 2025-09-07T06:44:01.1376291Z inflating: build/bin/hip_distributions_test 2025-09-07T06:44:01.1410933Z inflating: build/bin/hip_generator_test 2025-09-07T06:44:01.1445693Z inflating: build/bin/hip_half_test 2025-09-07T06:44:01.1480210Z inflating: build/bin/hip_integer_divider_test 2025-09-07T06:44:01.1514504Z inflating: build/bin/hip_optional_test 2025-09-07T06:44:01.1548494Z inflating: build/bin/hip_packedtensoraccessor_test 2025-09-07T06:44:01.1601234Z inflating: build/bin/hip_dlconvertor_test 2025-09-07T06:44:01.1623421Z inflating: build/bin/hip_vectorized_test 2025-09-07T06:44:01.2364069Z inflating: build/bin/test_jit 2025-09-07T06:44:01.2574117Z inflating: build/bin/test_nativert 2025-09-07T06:44:01.2612306Z inflating: build/bin/test_dist_autograd 2025-09-07T06:44:01.2673818Z inflating: build/bin/test_cpp_rpc 2025-09-07T06:44:01.2673974Z inflating: build/bin/parallel_benchmark 2025-09-07T06:44:01.3405054Z inflating: build/bin/test_api 2025-09-07T06:44:01.3621330Z inflating: build/bin/test_lazy 2025-09-07T06:44:01.3621582Z creating: .additional_ci_files/ 2025-09-07T06:44:01.3680469Z inflating: .additional_ci_files/test-times.json 2025-09-07T06:44:01.3894383Z inflating: .additional_ci_files/test-class-times.json 2025-09-07T06:44:01.3929240Z ##[group]Run rm artifacts.zip 2025-09-07T06:44:01.3929407Z rm artifacts.zip 2025-09-07T06:44:01.3935103Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:44:01.3935277Z env: 2025-09-07T06:44:01.3935382Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:01.3935527Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:01.3935709Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:01.3935883Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:01.3936268Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:01.3936645Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:01.3939955Z AWS_REGION: us-east-1 2025-09-07T06:44:01.3940212Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:01.3940461Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:01.3942920Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:01.3943031Z ##[endgroup] 2025-09-07T06:44:01.5572951Z ##[group]Run df -H 2025-09-07T06:44:01.5573221Z df -H 2025-09-07T06:44:01.5581766Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:44:01.5581925Z env: 2025-09-07T06:44:01.5582030Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:01.5582174Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:01.5582354Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:01.5582525Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:01.5582923Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:01.5583386Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:01.5583505Z AWS_REGION: us-east-1 2025-09-07T06:44:01.5583730Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:01.5583892Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:01.5588360Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:01.5588485Z ##[endgroup] 2025-09-07T06:44:01.5624287Z Filesystem Size Used Avail Use% Mounted on 2025-09-07T06:44:01.5624785Z overlay 2.2T 467G 1.7T 22% / 2025-09-07T06:44:01.5624923Z tmpfs 68M 0 68M 0% /dev 2025-09-07T06:44:01.5625056Z /dev/vda1 2.2T 467G 1.7T 22% /run 2025-09-07T06:44:01.5628464Z shm 68M 4.1k 68M 1% /dev/shm 2025-09-07T06:44:01.5628625Z tmpfs 1.4T 13k 1.4T 1% /run/secrets/kubernetes.io/serviceaccount 2025-09-07T06:44:01.5628793Z tmpfs 675G 0 675G 0% /proc/acpi 2025-09-07T06:44:01.5628936Z tmpfs 675G 0 675G 0% /proc/scsi 2025-09-07T06:44:01.5629069Z tmpfs 675G 0 675G 0% /sys/firmware 2025-09-07T06:44:01.5662800Z Prepare all required actions 2025-09-07T06:44:01.5668132Z Getting action download info 2025-09-07T06:44:01.7393319Z ##[group]Run ./.github/actions/download-td-artifacts 2025-09-07T06:44:01.7393524Z with: 2025-09-07T06:44:01.7393648Z env: 2025-09-07T06:44:01.7393783Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:01.7394002Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:01.7394254Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:01.7394494Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:01.7395048Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:01.7395587Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:01.7395752Z AWS_REGION: us-east-1 2025-09-07T06:44:01.7395993Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:01.7399234Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:01.7403383Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:01.7403527Z ##[endgroup] 2025-09-07T06:44:01.7439257Z ##[group]Run seemethere/download-artifact-s3@v4 2025-09-07T06:44:01.7439446Z with: 2025-09-07T06:44:01.7439564Z name: td_results 2025-09-07T06:44:01.7439714Z s3-bucket: gha-artifacts 2025-09-07T06:44:01.7439862Z region: us-east-1 2025-09-07T06:44:01.7439988Z env: 2025-09-07T06:44:01.7440110Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:01.7440295Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:01.7443816Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:01.7444058Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:01.7444594Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:01.7445117Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:01.7445273Z AWS_REGION: us-east-1 2025-09-07T06:44:01.7445453Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:01.7445658Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:01.7449687Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:01.7449830Z ##[endgroup] 2025-09-07T06:44:02.0397651Z (node:4962) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-09-07T06:44:02.0398195Z 2025-09-07T06:44:02.0404974Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-09-07T06:44:02.0406026Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-09-07T06:44:02.0406263Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-09-07T06:44:02.1445949Z Found 1 objects with prefix pytorch/pytorch/17524754565/td_results/ 2025-09-07T06:44:02.1453987Z Starting download (1/1): /home/runner/_work/pytorch/pytorch/td_results.json 2025-09-07T06:44:02.2680381Z Finished download (1/1): /home/runner/_work/pytorch/pytorch/td_results.json 2025-09-07T06:44:02.2686594Z Artifact download has finished successfully 2025-09-07T06:44:02.2856215Z ##[group]Run mkdir -p .additional_ci_files 2025-09-07T06:44:02.2856599Z mkdir -p .additional_ci_files 2025-09-07T06:44:02.2856771Z mv td_results.json .additional_ci_files/td_results.json || true 2025-09-07T06:44:02.2862739Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:44:02.2862897Z env: 2025-09-07T06:44:02.2863171Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:02.2863319Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:02.2863505Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:02.2863684Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:02.2864244Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:02.2864618Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:02.2864739Z AWS_REGION: us-east-1 2025-09-07T06:44:02.2864940Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:02.2865100Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:02.2867609Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:02.2867727Z ##[endgroup] 2025-09-07T06:44:02.2959131Z ##[group]Run .github/scripts/parse_ref.py 2025-09-07T06:44:02.2959389Z .github/scripts/parse_ref.py 2025-09-07T06:44:02.2971534Z shell: /usr/bin/bash -e {0} 2025-09-07T06:44:02.2971713Z env: 2025-09-07T06:44:02.2971863Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:02.2972062Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:02.2972325Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:02.2972570Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:02.2973227Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:02.2973775Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:02.2973944Z AWS_REGION: us-east-1 2025-09-07T06:44:02.2974237Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:02.2974516Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:02.2978570Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:02.2978724Z ##[endgroup] 2025-09-07T06:44:02.3132597Z Setting output branch=main 2025-09-07T06:44:02.3278428Z Prepare all required actions 2025-09-07T06:44:02.3278682Z Getting action download info 2025-09-07T06:44:02.4595959Z ##[group]Run ./.github/actions/filter-test-configs 2025-09-07T06:44:02.4596131Z with: 2025-09-07T06:44:02.4596526Z github-token: *** 2025-09-07T06:44:02.4597124Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}]} 2025-09-07T06:44:02.4597996Z job-name: linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:44:02.4598225Z env: 2025-09-07T06:44:02.4598328Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:02.4598475Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:02.4598659Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:02.4598833Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:02.4599224Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:02.4599594Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:02.4599720Z AWS_REGION: us-east-1 2025-09-07T06:44:02.4599858Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:02.4600017Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:02.4602417Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:02.4602533Z ##[endgroup] 2025-09-07T06:44:02.4622213Z ##[group]Run nick-fields/retry@v3.0.0 2025-09-07T06:44:02.4622358Z with: 2025-09-07T06:44:02.4622462Z shell: bash 2025-09-07T06:44:02.4622563Z timeout_minutes: 10 2025-09-07T06:44:02.4622668Z max_attempts: 5 2025-09-07T06:44:02.4622778Z retry_wait_seconds: 30 2025-09-07T06:44:02.4623180Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.2 2025-09-07T06:44:02.4623481Z polling_interval_seconds: 1 2025-09-07T06:44:02.4623601Z warning_on_retry: true 2025-09-07T06:44:02.4623718Z continue_on_error: false 2025-09-07T06:44:02.4623825Z env: 2025-09-07T06:44:02.4623924Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:02.4624063Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:02.4624250Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:02.4624436Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:02.4624819Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:02.4625188Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:02.4625311Z AWS_REGION: us-east-1 2025-09-07T06:44:02.4625489Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:02.4625644Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:02.4628036Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:02.4628248Z GITHUB_TOKEN: *** 2025-09-07T06:44:02.4628348Z ##[endgroup] 2025-09-07T06:44:02.5184314Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.2 2025-09-07T06:44:02.6597139Z Defaulting to user installation because normal site-packages is not writeable 2025-09-07T06:44:02.8508492Z Collecting requests==2.27.1 2025-09-07T06:44:02.9588531Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2025-09-07T06:44:03.0072513Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.1/63.1 KB 1.2 MB/s eta 0:00:00 2025-09-07T06:44:03.0802306Z Collecting pyyaml==6.0.2 2025-09-07T06:44:03.1076519Z Downloading PyYAML-6.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (751 kB) 2025-09-07T06:44:03.1988608Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 751.2/751.2 KB 8.7 MB/s eta 0:00:00 2025-09-07T06:44:03.2592077Z Collecting urllib3<1.27,>=1.21.1 2025-09-07T06:44:03.2881010Z Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2025-09-07T06:44:03.2989425Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 144.2/144.2 KB 13.5 MB/s eta 0:00:00 2025-09-07T06:44:03.3450086Z Collecting certifi>=2017.4.17 2025-09-07T06:44:03.3716996Z Downloading certifi-2025.8.3-py3-none-any.whl (161 kB) 2025-09-07T06:44:03.3808754Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 161.2/161.2 KB 19.2 MB/s eta 0:00:00 2025-09-07T06:44:03.4235089Z Collecting idna<4,>=2.5 2025-09-07T06:44:03.4506522Z Downloading idna-3.10-py3-none-any.whl (70 kB) 2025-09-07T06:44:03.4628705Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70.4/70.4 KB 6.7 MB/s eta 0:00:00 2025-09-07T06:44:03.5951177Z Collecting charset-normalizer~=2.0.0 2025-09-07T06:44:03.6216376Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2025-09-07T06:44:03.6785759Z Installing collected packages: urllib3, pyyaml, idna, charset-normalizer, certifi, requests 2025-09-07T06:44:03.7844246Z WARNING: The script normalizer is installed in '/home/runner/.local/bin' which is not on PATH. 2025-09-07T06:44:03.7845140Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2025-09-07T06:44:03.8206579Z Successfully installed certifi-2025.8.3 charset-normalizer-2.0.12 idna-3.10 pyyaml-6.0.2 requests-2.27.1 urllib3-1.26.20 2025-09-07T06:44:04.5127714Z Command completed after 1 attempt(s). 2025-09-07T06:44:04.5239616Z ##[group]Run set -x 2025-09-07T06:44:04.5239812Z set -x 2025-09-07T06:44:04.5239917Z  2025-09-07T06:44:04.5240081Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-09-07T06:44:04.5240289Z # in runner workspace 2025-09-07T06:44:04.5240454Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2025-09-07T06:44:04.5246524Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:44:04.5251981Z env: 2025-09-07T06:44:04.5252109Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:04.5252346Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:04.5252575Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:04.5252769Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:04.5253262Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:04.5253675Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:04.5253807Z AWS_REGION: us-east-1 2025-09-07T06:44:04.5278004Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:04.5278185Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:04.5280649Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:04.5280762Z ##[endgroup] 2025-09-07T06:44:04.5316542Z + python3 /home/runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2025-09-07T06:44:04.5388218Z Setting output branch=main 2025-09-07T06:44:04.5445018Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2025-09-07T06:44:04.5445231Z echo "Workflow: ${GITHUB_WORKFLOW}" 2025-09-07T06:44:04.5445375Z echo "Job name: ${JOB_NAME}" 2025-09-07T06:44:04.5445502Z  2025-09-07T06:44:04.5445660Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-09-07T06:44:04.5448306Z # in runner workspace 2025-09-07T06:44:04.5448493Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2025-09-07T06:44:04.5448707Z  --workflow "${GITHUB_WORKFLOW}" \ 2025-09-07T06:44:04.5448840Z  --job-name "${JOB_NAME}" \ 2025-09-07T06:44:04.5449819Z  --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}]}" \ 2025-09-07T06:44:04.5450461Z  --selected-test-configs "" \ 2025-09-07T06:44:04.5450594Z  --pr-number "${PR_NUMBER}" \ 2025-09-07T06:44:04.5450719Z  --tag "${TAG}" \ 2025-09-07T06:44:04.5450951Z  --event-name "${EVENT_NAME}" \ 2025-09-07T06:44:04.5451080Z  --schedule "${SCHEDULE}" \ 2025-09-07T06:44:04.5451206Z  --branch "${HEAD_BRANCH}" 2025-09-07T06:44:04.5459604Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:44:04.5459752Z env: 2025-09-07T06:44:04.5459850Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:04.5459985Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:04.5460161Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:04.5460327Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:04.5460707Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:04.5461076Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:04.5461193Z AWS_REGION: us-east-1 2025-09-07T06:44:04.5461397Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:04.5463556Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:04.5465958Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:04.5466280Z GITHUB_TOKEN: *** 2025-09-07T06:44:04.5466459Z JOB_NAME: linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:44:04.5466648Z PR_NUMBER: 2025-09-07T06:44:04.5466739Z TAG: 2025-09-07T06:44:04.5466824Z EVENT_NAME: push 2025-09-07T06:44:04.5466920Z SCHEDULE: 2025-09-07T06:44:04.5467005Z HEAD_BRANCH: main 2025-09-07T06:44:04.5467101Z ##[endgroup] 2025-09-07T06:44:04.5497930Z Workflow: rocm-mi300 2025-09-07T06:44:04.5498112Z Job name: linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:44:04.8017648Z Setting output keep-going=True 2025-09-07T06:44:04.8033828Z Setting output ci-verbose-test-logs=False 2025-09-07T06:44:04.8073543Z Setting output ci-test-showlocals=False 2025-09-07T06:44:04.8075028Z Setting output ci-no-test-timeout=False 2025-09-07T06:44:04.8075256Z Setting output ci-no-td=False 2025-09-07T06:44:04.8075398Z Setting output ci-td-distributed=False 2025-09-07T06:44:04.8075537Z Setting output is-unstable=False 2025-09-07T06:44:04.8075685Z Setting output reenabled-issues= 2025-09-07T06:44:04.8076352Z Setting output test-matrix={"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}]} 2025-09-07T06:44:04.8077038Z Setting output is-test-matrix-empty=False 2025-09-07T06:44:04.8127025Z ##[group]Run echo "Filtered matrix:" 2025-09-07T06:44:04.8127195Z echo "Filtered matrix:" 2025-09-07T06:44:04.8127968Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1"}]}" 2025-09-07T06:44:04.8128580Z  2025-09-07T06:44:04.8128673Z echo 2025-09-07T06:44:04.8135604Z echo "Is the current job unstable? False" 2025-09-07T06:44:04.8135773Z  2025-09-07T06:44:04.8135861Z echo 2025-09-07T06:44:04.8135990Z echo "Is keep-going label set? True" 2025-09-07T06:44:04.8136112Z  2025-09-07T06:44:04.8136354Z echo 2025-09-07T06:44:04.8136449Z echo "Reenabled issues? " 2025-09-07T06:44:04.8142709Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:44:04.8142856Z env: 2025-09-07T06:44:04.8142957Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:04.8143196Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:04.8143369Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:04.8143534Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:04.8146127Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:04.8146539Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:04.8146652Z AWS_REGION: us-east-1 2025-09-07T06:44:04.8146821Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:04.8146969Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:04.8149395Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:04.8149499Z ##[endgroup] 2025-09-07T06:44:04.8172212Z Filtered matrix: 2025-09-07T06:44:04.8173934Z {include: [{config: default, shard: 1, num_shards: 6, runner: linux.rocm.gpu.gfx942.1}, {config: default, shard: 2, num_shards: 6, runner: linux.rocm.gpu.gfx942.1}, {config: default, shard: 3, num_shards: 6, runner: linux.rocm.gpu.gfx942.1}, {config: default, shard: 4, num_shards: 6, runner: linux.rocm.gpu.gfx942.1}, {config: default, shard: 5, num_shards: 6, runner: linux.rocm.gpu.gfx942.1}, {config: default, shard: 6, num_shards: 6, runner: linux.rocm.gpu.gfx942.1}]} 2025-09-07T06:44:04.8174569Z 2025-09-07T06:44:04.8174624Z Is the current job unstable? False 2025-09-07T06:44:04.8174713Z 2025-09-07T06:44:04.8174765Z Is keep-going label set? True 2025-09-07T06:44:04.8174847Z 2025-09-07T06:44:04.8174888Z Reenabled issues? 2025-09-07T06:44:04.8212331Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-09-07T06:44:04.8212546Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-09-07T06:44:04.8221656Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T06:44:04.8221803Z env: 2025-09-07T06:44:04.8221898Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:04.8222029Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:04.8222203Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:04.8222370Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:04.8222752Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:04.8223204Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:04.8223317Z AWS_REGION: us-east-1 2025-09-07T06:44:04.8223487Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:04.8225639Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:04.8228251Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:04.8228363Z JOB_TIMEOUT: 300 2025-09-07T06:44:04.8228456Z ##[endgroup] 2025-09-07T06:44:04.8353979Z ##[group]Run set -x 2025-09-07T06:44:04.8354131Z set -x 2025-09-07T06:44:04.8354223Z  2025-09-07T06:44:04.8354332Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2025-09-07T06:44:04.8356546Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2025-09-07T06:44:04.8356712Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2025-09-07T06:44:04.8356855Z  TEST_COMMAND=.ci/caffe2/test.sh 2025-09-07T06:44:04.8356975Z else 2025-09-07T06:44:04.8357078Z  TEST_COMMAND=.ci/pytorch/test.sh 2025-09-07T06:44:04.8357194Z fi 2025-09-07T06:44:04.8357279Z  2025-09-07T06:44:04.8357409Z # detached container should get cleaned up by teardown_ec2_linux 2025-09-07T06:44:04.8357606Z # TODO: Stop building test binaries as part of the build phase 2025-09-07T06:44:04.8357781Z # Used for GPU_FLAG since that doesn't play nice 2025-09-07T06:44:04.8358076Z # shellcheck disable=SC2086,SC2090 2025-09-07T06:44:04.8358210Z container_name=$(docker run \ 2025-09-07T06:44:04.8358335Z  ${GPU_FLAG:-} \ 2025-09-07T06:44:04.8360089Z  -e BUILD_ENVIRONMENT \ 2025-09-07T06:44:04.8360215Z  -e PR_NUMBER \ 2025-09-07T06:44:04.8360326Z  -e GITHUB_ACTIONS \ 2025-09-07T06:44:04.8360440Z  -e GITHUB_REPOSITORY \ 2025-09-07T06:44:04.8360555Z  -e GITHUB_WORKFLOW \ 2025-09-07T06:44:04.8360664Z  -e GITHUB_JOB \ 2025-09-07T06:44:04.8360770Z  -e GITHUB_RUN_ID \ 2025-09-07T06:44:04.8360877Z  -e GITHUB_RUN_NUMBER \ 2025-09-07T06:44:04.8360990Z  -e GITHUB_RUN_ATTEMPT \ 2025-09-07T06:44:04.8361103Z  -e JOB_ID \ 2025-09-07T06:44:04.8361203Z  -e JOB_NAME \ 2025-09-07T06:44:04.8362751Z  -e BRANCH \ 2025-09-07T06:44:04.8362854Z  -e SHA1 \ 2025-09-07T06:44:04.8362961Z  -e AWS_DEFAULT_REGION \ 2025-09-07T06:44:04.8363165Z  -e IN_WHEEL_TEST \ 2025-09-07T06:44:04.8363273Z  -e SHARD_NUMBER \ 2025-09-07T06:44:04.8363381Z  -e TEST_CONFIG \ 2025-09-07T06:44:04.8363487Z  -e NUM_TEST_SHARDS \ 2025-09-07T06:44:04.8363602Z  -e REENABLED_ISSUES \ 2025-09-07T06:44:04.8363719Z  -e CONTINUE_THROUGH_ERROR \ 2025-09-07T06:44:04.8363837Z  -e VERBOSE_TEST_LOGS \ 2025-09-07T06:44:04.8363949Z  -e TEST_SHOWLOCALS \ 2025-09-07T06:44:04.8365465Z  -e NO_TEST_TIMEOUT \ 2025-09-07T06:44:04.8365576Z  -e NO_TD \ 2025-09-07T06:44:04.8365687Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2025-09-07T06:44:04.8365826Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2025-09-07T06:44:04.8365966Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2025-09-07T06:44:04.8366095Z  -e TESTS_TO_INCLUDE \ 2025-09-07T06:44:04.8366206Z  -e DASHBOARD_TAG \ 2025-09-07T06:44:04.8366356Z  --env-file="${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" \ 2025-09-07T06:44:04.8366513Z  --ulimit stack=10485760:83886080 \ 2025-09-07T06:44:04.8366633Z  --ulimit core=0 \ 2025-09-07T06:44:04.8366750Z  --security-opt seccomp=unconfined \ 2025-09-07T06:44:04.8368216Z  --cap-add=SYS_PTRACE \ 2025-09-07T06:44:04.8368337Z  --shm-size="8g" \ 2025-09-07T06:44:04.8368438Z  --tty \ 2025-09-07T06:44:04.8368532Z  --detach \ 2025-09-07T06:44:04.8368637Z  --name="${container_name}" \ 2025-09-07T06:44:04.8368758Z  --user jenkins \ 2025-09-07T06:44:04.8368894Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2025-09-07T06:44:04.8369106Z  -w /var/lib/jenkins/workspace \ 2025-09-07T06:44:04.8369226Z  "${DOCKER_IMAGE}" 2025-09-07T06:44:04.8369327Z ) 2025-09-07T06:44:04.8369425Z # save container name for later step 2025-09-07T06:44:04.8371034Z echo "CONTAINER_NAME=${container_name}" >> "$GITHUB_ENV" 2025-09-07T06:44:04.8371308Z # jenkins user does not have write permission to mounted workspace; work-around by copying within container to jenkins home 2025-09-07T06:44:04.8371646Z docker exec -t "${container_name}" sh -c "cd .. && cp -R workspace pytorch && cd pytorch && pip install dist/*.whl && ${TEST_COMMAND}" 2025-09-07T06:44:04.8379248Z shell: /usr/bin/bash -e {0} 2025-09-07T06:44:04.8379357Z env: 2025-09-07T06:44:04.8379445Z GIT_DEFAULT_BRANCH: main 2025-09-07T06:44:04.8379578Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T06:44:04.8379750Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T06:44:04.8379911Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T06:44:04.8380297Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T06:44:04.8382524Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T06:44:04.8382643Z AWS_REGION: us-east-1 2025-09-07T06:44:04.8382800Z AWS_ACCESS_KEY_ID: *** 2025-09-07T06:44:04.8382949Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T06:44:04.8385487Z AWS_SESSION_TOKEN: *** 2025-09-07T06:44:04.8385618Z BUILD_ENVIRONMENT: linux-noble-rocm-py3.12-mi300 2025-09-07T06:44:04.8385751Z PR_NUMBER: 2025-09-07T06:44:04.8385849Z GITHUB_REPOSITORY: pytorch/pytorch 2025-09-07T06:44:04.8385973Z GITHUB_WORKFLOW: rocm-mi300 2025-09-07T06:44:04.8386077Z GITHUB_JOB: test 2025-09-07T06:44:04.8386170Z GITHUB_RUN_ID: 17524754565 2025-09-07T06:44:04.8387810Z GITHUB_RUN_NUMBER: 9398 2025-09-07T06:44:04.8387915Z GITHUB_RUN_ATTEMPT: 1 2025-09-07T06:44:04.8388011Z JOB_ID: 49774353518 2025-09-07T06:44:04.8388180Z JOB_NAME: linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:44:04.8388365Z BRANCH: main 2025-09-07T06:44:04.8388475Z SHA1: 93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:44:04.8388603Z CONTINUE_THROUGH_ERROR: True 2025-09-07T06:44:04.8388714Z VERBOSE_TEST_LOGS: False 2025-09-07T06:44:04.8388817Z TEST_SHOWLOCALS: False 2025-09-07T06:44:04.8388918Z NO_TEST_TIMEOUT: False 2025-09-07T06:44:04.8389013Z NO_TD: False 2025-09-07T06:44:04.8390506Z TEST_CONFIG: default 2025-09-07T06:44:04.8390599Z SHARD_NUMBER: 4 2025-09-07T06:44:04.8390690Z NUM_TEST_SHARDS: 6 2025-09-07T06:44:04.8390782Z REENABLED_ISSUES: 2025-09-07T06:44:04.8391048Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:44:04.8391336Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2025-09-07T06:44:04.8391463Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2025-09-07T06:44:04.8391578Z TESTS_TO_INCLUDE: 2025-09-07T06:44:04.8391668Z DASHBOARD_TAG: 2025-09-07T06:44:04.8391765Z ##[endgroup] 2025-09-07T06:44:04.8420265Z + [[ default == \m\u\l\t\i\g\p\u ]] 2025-09-07T06:44:04.8420414Z + [[ linux-noble-rocm-py3.12-mi300 == *onnx* ]] 2025-09-07T06:44:04.8420599Z + TEST_COMMAND=.ci/pytorch/test.sh 2025-09-07T06:44:04.8420722Z +++ nproc --ignore=2 2025-09-07T06:44:04.8434483Z ++ docker run --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e MAX_JOBS=158 -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e TESTS_TO_INCLUDE -e DASHBOARD_TAG --env-file=/home/runner/_work/_temp/github_env_17524754565 --ulimit stack=10485760:83886080 --ulimit core=0 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --shm-size=8g --tty --detach --name= --user jenkins -v /home/runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-ae53c6842aa4c2407d0ad976491ca941c2635c77 2025-09-07T06:44:06.5396118Z + container_name=852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T06:44:06.5423503Z + echo CONTAINER_NAME=852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T06:44:06.5424814Z + docker exec -t 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 sh -c 'cd .. && cp -R workspace pytorch && cd pytorch && pip install dist/*.whl && .ci/pytorch/test.sh' 2025-09-07T06:44:11.3738134Z Processing ./dist/torch-2.9.0a0+git93fb23d-cp312-cp312-linux_x86_64.whl 2025-09-07T06:44:11.6747246Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.9.0a0+git93fb23d) (3.19.1) 2025-09-07T06:44:11.6768103Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.9.0a0+git93fb23d) (4.15.0) 2025-09-07T06:44:11.6768620Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.9.0a0+git93fb23d) (80.9.0) 2025-09-07T06:44:11.6776422Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.9.0a0+git93fb23d) (1.13.3) 2025-09-07T06:44:11.6776829Z Requirement already satisfied: networkx>=2.5.1 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.9.0a0+git93fb23d) (2.8.8) 2025-09-07T06:44:11.6777214Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.9.0a0+git93fb23d) (3.1.6) 2025-09-07T06:44:11.6777685Z Requirement already satisfied: fsspec>=0.8.5 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.9.0a0+git93fb23d) (2025.7.0) 2025-09-07T06:44:11.6814528Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from sympy>=1.13.3->torch==2.9.0a0+git93fb23d) (1.3.0) 2025-09-07T06:44:11.6840572Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from jinja2->torch==2.9.0a0+git93fb23d) (3.0.2) 2025-09-07T06:44:11.7890953Z Installing collected packages: torch 2025-09-07T06:44:17.1408810Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2025-09-07T06:44:17.1409519Z helion 0.1.3 requires filecheck, which is not installed. 2025-09-07T06:44:17.1418102Z Successfully installed torch-2.9.0a0+git93fb23d 2025-09-07T06:44:17.1965530Z + export TERM=vt100 2025-09-07T06:44:17.1965696Z + TERM=vt100 2025-09-07T06:44:17.1967804Z ++ dirname .ci/pytorch/test.sh 2025-09-07T06:44:17.1976603Z + source .ci/pytorch/common.sh 2025-09-07T06:44:17.1978737Z +++ dirname .ci/pytorch/common.sh 2025-09-07T06:44:17.1984192Z ++ source .ci/pytorch/common_utils.sh 2025-09-07T06:44:17.1985285Z +++ declare -f -t trap_add 2025-09-07T06:44:17.1986438Z ++ set -ex -o pipefail 2025-09-07T06:44:17.1987776Z ++ [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-09-07T06:44:17.1987996Z ++ unset HIP_PLATFORM 2025-09-07T06:44:17.1988907Z ++ export PYTORCH_TEST_WITH_ROCM=1 2025-09-07T06:44:17.1989100Z ++ PYTORCH_TEST_WITH_ROCM=1 2025-09-07T06:44:17.1990063Z ++ BUILD_TEST_LIBTORCH=0 2025-09-07T06:44:17.1990243Z ++ dirname .ci/pytorch/test.sh 2025-09-07T06:44:17.1993238Z + source .ci/pytorch/common-build.sh 2025-09-07T06:44:17.1994695Z ++ [[ linux-noble-rocm-py3.12-mi300 != *win-* ]] 2025-09-07T06:44:17.1996825Z ++++ dirname .ci/pytorch/common-build.sh 2025-09-07T06:44:17.2000648Z +++ cd .ci/pytorch 2025-09-07T06:44:17.2000826Z +++ pwd -P 2025-09-07T06:44:17.2002137Z ++ script_dir=/var/lib/jenkins/pytorch/.ci/pytorch 2025-09-07T06:44:17.2002413Z ++ [[ linux-noble-rocm-py3.12-mi300 == *-pch* ]] 2025-09-07T06:44:17.2002602Z ++ which sccache 2025-09-07T06:44:17.2036023Z ++ [[ -z '' ]] 2025-09-07T06:44:17.2036514Z ++ unset SCCACHE_BUCKET 2025-09-07T06:44:17.2036855Z ++ unset SCCACHE_REGION 2025-09-07T06:44:17.2037558Z ++ sccache --stop-server 2025-09-07T06:44:17.2053417Z ++ true 2025-09-07T06:44:17.2053756Z ++ rm -f /var/lib/jenkins/sccache_error.log 2025-09-07T06:44:17.2060402Z ++ trap_add sccache_epilogue EXIT 2025-09-07T06:44:17.2060622Z ++ trap_add_cmd=sccache_epilogue 2025-09-07T06:44:17.2060801Z ++ shift 2025-09-07T06:44:17.2060936Z ++ for trap_add_name in "$@" 2025-09-07T06:44:17.2070281Z ++++ trap -p EXIT 2025-09-07T06:44:17.2077913Z +++ eval 'extract_trap_cmd ' 2025-09-07T06:44:17.2093685Z ++++ extract_trap_cmd 2025-09-07T06:44:17.2093846Z ++++ printf '%s\n' '' 2025-09-07T06:44:17.2094950Z +++ printf '%s\n' sccache_epilogue 2025-09-07T06:44:17.2095110Z ++ trap -- ' 2025-09-07T06:44:17.2095245Z sccache_epilogue' EXIT 2025-09-07T06:44:17.2095374Z ++ [[ -n '' ]] 2025-09-07T06:44:17.2095512Z ++ [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-09-07T06:44:17.2095695Z ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 2025-09-07T06:44:17.2095860Z ++ SCCACHE_IDLE_TIMEOUT=0 2025-09-07T06:44:17.2102271Z ++ sccache --start-server 2025-09-07T06:44:17.2102392Z sccache: Starting the server... 2025-09-07T06:44:17.2648234Z sccache: Listening on address 127.0.0.1:4226 2025-09-07T06:44:17.2654924Z ++ sccache --zero-stats 2025-09-07T06:44:17.2677666Z Statistics zeroed. 2025-09-07T06:44:17.2681095Z ++ which ccache 2025-09-07T06:44:17.2689628Z + [[ linux-noble-rocm-py3.12-mi300 != *rocm* ]] 2025-09-07T06:44:17.2690237Z + echo 'Environment variables:' 2025-09-07T06:44:17.2690428Z Environment variables: 2025-09-07T06:44:17.2690568Z + env 2025-09-07T06:44:17.2700525Z GITHUB_WORKSPACE=/home/runner/_work/pytorch/pytorch 2025-09-07T06:44:17.2701015Z CONTINUE_THROUGH_ERROR=True 2025-09-07T06:44:17.2701291Z BUILD_ENVIRONMENT=linux-noble-rocm-py3.12-mi300 2025-09-07T06:44:17.2701468Z HOSTNAME=linux.rocm.gpu.gfx942.1-xb8kr-runner-wp76s 2025-09-07T06:44:17.2701721Z GITHUB_PATH=/home/runner/_work/_temp/_runner_file_commands/add_path_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2701937Z GITHUB_ACTION=__self 2025-09-07T06:44:17.2702050Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-09-07T06:44:17.2702195Z GITHUB_RUN_NUMBER=9398 2025-09-07T06:44:17.2702313Z TEST_CONFIG=default 2025-09-07T06:44:17.2702452Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-09-07T06:44:17.2710061Z AWS_DEFAULT_REGION=us-east-1 2025-09-07T06:44:17.2710236Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-09-07T06:44:17.2710370Z GITHUB_REF_TYPE=branch 2025-09-07T06:44:17.2710714Z *** 2025-09-07T06:44:17.2710804Z GITHUB_REPOSITORY_ID=65600975 2025-09-07T06:44:17.2710916Z GITHUB_ACTIONS=true 2025-09-07T06:44:17.2711031Z SHA1=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:44:17.2711208Z GITHUB_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:44:17.2711419Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/rocm-mi300.yml@refs/heads/main 2025-09-07T06:44:17.2711598Z UCC_HOME=/usr 2025-09-07T06:44:17.2711705Z VERBOSE_TEST_LOGS=False 2025-09-07T06:44:17.2711838Z GITHUB_REF=refs/heads/main 2025-09-07T06:44:17.2711967Z SHARD_NUMBER=4 2025-09-07T06:44:17.2712089Z GITHUB_REF_PROTECTED=true 2025-09-07T06:44:17.2712219Z HOME=/var/lib/jenkins 2025-09-07T06:44:17.2712368Z GITHUB_API_URL=https://api.github.com 2025-09-07T06:44:17.2715000Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2025-09-07T06:44:17.2715143Z LANG=C.UTF-8 2025-09-07T06:44:17.2715254Z UCX_COMMIT=cc312eaa4655c0cc5c2bcd796db938f90563bcf6 2025-09-07T06:44:17.2715391Z PYTORCH_TEST_WITH_ROCM=1 2025-09-07T06:44:17.2715490Z NUM_TEST_SHARDS=6 2025-09-07T06:44:17.2715580Z UCX_HOME=/usr 2025-09-07T06:44:17.2715764Z GITHUB_STATE=/home/runner/_work/_temp/_runner_file_commands/save_state_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2716353Z JOB_NAME=linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:44:17.2716539Z MAGMA_HOME=/opt/rocm/magma 2025-09-07T06:44:17.2716723Z GITHUB_ENV=/home/runner/_work/_temp/_runner_file_commands/set_env_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2716958Z GITHUB_EVENT_PATH=/home/runner/_work/_temp/_github_workflow/event.json 2025-09-07T06:44:17.2717115Z GITHUB_EVENT_NAME=push 2025-09-07T06:44:17.2717262Z GITHUB_ACTIONS_RUNNER_EXTRA_USER_AGENT=actions-runner-controller/0.11.0 2025-09-07T06:44:17.2717417Z DASHBOARD_TAG= 2025-09-07T06:44:17.2717506Z GITHUB_RUN_ID=17524754565 2025-09-07T06:44:17.2717709Z GITHUB_STEP_SUMMARY=/home/runner/_work/_temp/_runner_file_commands/step_summary_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2717925Z GITHUB_ACTOR=pytorchmergebot 2025-09-07T06:44:17.2718060Z PR_NUMBER= 2025-09-07T06:44:17.2718163Z GITHUB_RUN_ATTEMPT=1 2025-09-07T06:44:17.2718425Z ANACONDA_PYTHON_VERSION=3.12 2025-09-07T06:44:17.2718585Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-09-07T06:44:17.2720650Z TERM=vt100 2025-09-07T06:44:17.2720744Z INSTALLED_VISION=yes 2025-09-07T06:44:17.2720844Z BRANCH=main 2025-09-07T06:44:17.2720932Z OPENSSL_ROOT_DIR=/opt/openssl 2025-09-07T06:44:17.2721036Z TESTS_TO_INCLUDE= 2025-09-07T06:44:17.2721187Z GITHUB_ACTION_PATH=/home/runner/_work/pytorch/pytorch/./.github/actions/setup-rocm 2025-09-07T06:44:17.2721374Z GITHUB_SERVER_URL=https://github.com 2025-09-07T06:44:17.2721498Z PYTORCH_ROCM_ARCH=gfx90a;gfx942 2025-09-07T06:44:17.2721623Z UCC_COMMIT=0c0fc21559835044ab107199e334f7157d6a0d3d 2025-09-07T06:44:17.2721745Z REENABLED_ISSUES= 2025-09-07T06:44:17.2721832Z SHLVL=1 2025-09-07T06:44:17.2721912Z MAX_JOBS=158 2025-09-07T06:44:17.2721999Z GITHUB_ACTOR_ID=97764156 2025-09-07T06:44:17.2722131Z GITHUB_WORKFLOW_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:44:17.2722273Z GITHUB_REF_NAME=main 2025-09-07T06:44:17.2722364Z ROCM_PATH=/opt/rocm 2025-09-07T06:44:17.2722458Z GITHUB_JOB=test 2025-09-07T06:44:17.2722546Z NO_TEST_TIMEOUT=False 2025-09-07T06:44:17.2724333Z GITHUB_REPOSITORY=pytorch/pytorch 2025-09-07T06:44:17.2724450Z LC_ALL=C.UTF-8 2025-09-07T06:44:17.2724539Z GITHUB_RETENTION_DAYS=90 2025-09-07T06:44:17.2724640Z OPENSSL_DIR=/opt/openssl 2025-09-07T06:44:17.2724744Z GITHUB_ACTION_REPOSITORY= 2025-09-07T06:44:17.2725090Z PATH=/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T06:44:17.2725431Z GITHUB_BASE_REF= 2025-09-07T06:44:17.2725515Z CI=true 2025-09-07T06:44:17.2725604Z GITHUB_REPOSITORY_OWNER=pytorch 2025-09-07T06:44:17.2725709Z JOB_ID=49774353518 2025-09-07T06:44:17.2725793Z GITHUB_HEAD_REF= 2025-09-07T06:44:17.2725877Z GITHUB_ACTION_REF= 2025-09-07T06:44:17.2725968Z TEST_SHOWLOCALS=False 2025-09-07T06:44:17.2726067Z GITHUB_WORKFLOW=rocm-mi300 2025-09-07T06:44:17.2726181Z DEBIAN_FRONTEND=noninteractive 2025-09-07T06:44:17.2726387Z GITHUB_OUTPUT=/home/runner/_work/_temp/_runner_file_commands/set_output_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2726586Z NO_TD=False 2025-09-07T06:44:17.2726670Z OLDPWD=/var/lib/jenkins 2025-09-07T06:44:17.2726763Z _=/usr/bin/env 2025-09-07T06:44:17.2726886Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2025-09-07T06:44:17.2780183Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch 2025-09-07T06:44:17.2780851Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/bin 2025-09-07T06:44:17.2784404Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/lib 2025-09-07T06:44:17.2784699Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/test 2025-09-07T06:44:17.2784877Z + BUILD_DIR=build 2025-09-07T06:44:17.2784993Z + BUILD_RENAMED_DIR=build_renamed 2025-09-07T06:44:17.2785125Z + BUILD_BIN_DIR=build/bin 2025-09-07T06:44:17.2785271Z + SHARD_NUMBER=4 2025-09-07T06:44:17.2785377Z + NUM_TEST_SHARDS=6 2025-09-07T06:44:17.2785756Z + export TORCH_SERIALIZATION_DEBUG=1 2025-09-07T06:44:17.2785895Z + TORCH_SERIALIZATION_DEBUG=1 2025-09-07T06:44:17.2786012Z + export VALGRIND=ON 2025-09-07T06:44:17.2786115Z + VALGRIND=ON 2025-09-07T06:44:17.2786242Z + [[ linux-noble-rocm-py3.12-mi300 == *clang9* ]] 2025-09-07T06:44:17.2786393Z + [[ linux-noble-rocm-py3.12-mi300 == *xpu* ]] 2025-09-07T06:44:17.2786519Z + detect_cuda_arch 2025-09-07T06:44:17.2786629Z + [[ linux-noble-rocm-py3.12-mi300 == *cuda* ]] 2025-09-07T06:44:17.2786765Z + [[ linux-noble-rocm-py3.12-mi300 == *s390x* ]] 2025-09-07T06:44:17.2786889Z + [[ 0 == \1 ]] 2025-09-07T06:44:17.2786980Z + [[ True == \1 ]] 2025-09-07T06:44:17.2787091Z + [[ linux-noble-rocm-py3.12-mi300 != *bazel* ]] 2025-09-07T06:44:17.2793669Z ++ realpath build/custom_test_artifacts 2025-09-07T06:44:17.2793937Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/pytorch/build/custom_test_artifacts 2025-09-07T06:44:17.2794340Z + [[ -n '' ]] 2025-09-07T06:44:17.2794440Z + echo 'Environment variables' 2025-09-07T06:44:17.2794562Z Environment variables 2025-09-07T06:44:17.2794663Z + env 2025-09-07T06:44:17.2794771Z GITHUB_WORKSPACE=/home/runner/_work/pytorch/pytorch 2025-09-07T06:44:17.2794910Z CONTINUE_THROUGH_ERROR=True 2025-09-07T06:44:17.2795046Z BUILD_ENVIRONMENT=linux-noble-rocm-py3.12-mi300 2025-09-07T06:44:17.2795200Z HOSTNAME=linux.rocm.gpu.gfx942.1-xb8kr-runner-wp76s 2025-09-07T06:44:17.2795427Z GITHUB_PATH=/home/runner/_work/_temp/_runner_file_commands/add_path_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2795630Z GITHUB_ACTION=__self 2025-09-07T06:44:17.2795735Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-09-07T06:44:17.2795853Z GITHUB_RUN_NUMBER=9398 2025-09-07T06:44:17.2795950Z TEST_CONFIG=default 2025-09-07T06:44:17.2796050Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-09-07T06:44:17.2796171Z AWS_DEFAULT_REGION=us-east-1 2025-09-07T06:44:17.2796287Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-09-07T06:44:17.2796415Z GITHUB_REF_TYPE=branch 2025-09-07T06:44:17.2796644Z *** 2025-09-07T06:44:17.2796743Z GITHUB_REPOSITORY_ID=65600975 2025-09-07T06:44:17.2796859Z GITHUB_ACTIONS=true 2025-09-07T06:44:17.2796969Z SHA1=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:44:17.2797108Z GITHUB_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:44:17.2797302Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/rocm-mi300.yml@refs/heads/main 2025-09-07T06:44:17.2797483Z UCC_HOME=/usr 2025-09-07T06:44:17.2800856Z TORCH_SERIALIZATION_DEBUG=1 2025-09-07T06:44:17.2800972Z VERBOSE_TEST_LOGS=False 2025-09-07T06:44:17.2801082Z GITHUB_REF=refs/heads/main 2025-09-07T06:44:17.2801195Z SHARD_NUMBER=4 2025-09-07T06:44:17.2801291Z GITHUB_REF_PROTECTED=true 2025-09-07T06:44:17.2801391Z HOME=/var/lib/jenkins 2025-09-07T06:44:17.2801506Z GITHUB_API_URL=https://api.github.com 2025-09-07T06:44:17.2801642Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2025-09-07T06:44:17.2801752Z LANG=C.UTF-8 2025-09-07T06:44:17.2801861Z UCX_COMMIT=cc312eaa4655c0cc5c2bcd796db938f90563bcf6 2025-09-07T06:44:17.2802001Z PYTORCH_TEST_WITH_ROCM=1 2025-09-07T06:44:17.2802108Z NUM_TEST_SHARDS=6 2025-09-07T06:44:17.2802193Z UCX_HOME=/usr 2025-09-07T06:44:17.2802374Z GITHUB_STATE=/home/runner/_work/_temp/_runner_file_commands/save_state_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2802649Z JOB_NAME=linux-noble-rocm-py3.12-mi300 / test (default, 4, 6, linux.rocm.gpu.gfx942.1) 2025-09-07T06:44:17.2802833Z MAGMA_HOME=/opt/rocm/magma 2025-09-07T06:44:17.2803016Z GITHUB_ENV=/home/runner/_work/_temp/_runner_file_commands/set_env_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2803522Z GITHUB_EVENT_PATH=/home/runner/_work/_temp/_github_workflow/event.json 2025-09-07T06:44:17.2803675Z GITHUB_EVENT_NAME=push 2025-09-07T06:44:17.2803822Z GITHUB_ACTIONS_RUNNER_EXTRA_USER_AGENT=actions-runner-controller/0.11.0 2025-09-07T06:44:17.2803977Z DASHBOARD_TAG= 2025-09-07T06:44:17.2806388Z GITHUB_RUN_ID=17524754565 2025-09-07T06:44:17.2806588Z GITHUB_STEP_SUMMARY=/home/runner/_work/_temp/_runner_file_commands/step_summary_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2806899Z GITHUB_ACTOR=pytorchmergebot 2025-09-07T06:44:17.2807004Z PR_NUMBER= 2025-09-07T06:44:17.2807090Z GITHUB_RUN_ATTEMPT=1 2025-09-07T06:44:17.2807183Z VALGRIND=ON 2025-09-07T06:44:17.2807272Z ANACONDA_PYTHON_VERSION=3.12 2025-09-07T06:44:17.2807400Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-09-07T06:44:17.2807530Z TERM=vt100 2025-09-07T06:44:17.2807615Z INSTALLED_VISION=yes 2025-09-07T06:44:17.2807713Z BRANCH=main 2025-09-07T06:44:17.2807805Z OPENSSL_ROOT_DIR=/opt/openssl 2025-09-07T06:44:17.2807917Z TESTS_TO_INCLUDE= 2025-09-07T06:44:17.2808073Z GITHUB_ACTION_PATH=/home/runner/_work/pytorch/pytorch/./.github/actions/setup-rocm 2025-09-07T06:44:17.2808259Z GITHUB_SERVER_URL=https://github.com 2025-09-07T06:44:17.2808386Z PYTORCH_ROCM_ARCH=gfx90a;gfx942 2025-09-07T06:44:17.2808514Z UCC_COMMIT=0c0fc21559835044ab107199e334f7157d6a0d3d 2025-09-07T06:44:17.2808644Z REENABLED_ISSUES= 2025-09-07T06:44:17.2808792Z SHLVL=1 2025-09-07T06:44:17.2811101Z MAX_JOBS=158 2025-09-07T06:44:17.2811199Z GITHUB_ACTOR_ID=97764156 2025-09-07T06:44:17.2811338Z GITHUB_WORKFLOW_SHA=93fb23d6fae7c4e82c4239a1033e522088742634 2025-09-07T06:44:17.2811484Z GITHUB_REF_NAME=main 2025-09-07T06:44:17.2811579Z ROCM_PATH=/opt/rocm 2025-09-07T06:44:17.2811670Z GITHUB_JOB=test 2025-09-07T06:44:17.2811759Z NO_TEST_TIMEOUT=False 2025-09-07T06:44:17.2811865Z GITHUB_REPOSITORY=pytorch/pytorch 2025-09-07T06:44:17.2811975Z LC_ALL=C.UTF-8 2025-09-07T06:44:17.2812066Z GITHUB_RETENTION_DAYS=90 2025-09-07T06:44:17.2812168Z OPENSSL_DIR=/opt/openssl 2025-09-07T06:44:17.2814141Z GITHUB_ACTION_REPOSITORY= 2025-09-07T06:44:17.2814499Z PATH=/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T06:44:17.2814847Z GITHUB_BASE_REF= 2025-09-07T06:44:17.2814934Z CI=true 2025-09-07T06:44:17.2815024Z GITHUB_REPOSITORY_OWNER=pytorch 2025-09-07T06:44:17.2815133Z JOB_ID=49774353518 2025-09-07T06:44:17.2815221Z GITHUB_HEAD_REF= 2025-09-07T06:44:17.2815309Z GITHUB_ACTION_REF= 2025-09-07T06:44:17.2815399Z TEST_SHOWLOCALS=False 2025-09-07T06:44:17.2815499Z GITHUB_WORKFLOW=rocm-mi300 2025-09-07T06:44:17.2815609Z DEBIAN_FRONTEND=noninteractive 2025-09-07T06:44:17.2816975Z GITHUB_OUTPUT=/home/runner/_work/_temp/_runner_file_commands/set_output_f6d64aed-376d-457f-a2a9-935067aa32f7 2025-09-07T06:44:17.2817179Z NO_TD=False 2025-09-07T06:44:17.2817266Z OLDPWD=/var/lib/jenkins 2025-09-07T06:44:17.2817364Z _=/usr/bin/env 2025-09-07T06:44:17.2817454Z + echo 'Testing pytorch' 2025-09-07T06:44:17.2817552Z Testing pytorch 2025-09-07T06:44:17.2817642Z + export LANG=C.UTF-8 2025-09-07T06:44:17.2817734Z + LANG=C.UTF-8 2025-09-07T06:44:17.2817817Z + PR_NUMBER= 2025-09-07T06:44:17.2817908Z + [[ default == \d\e\f\a\u\l\t ]] 2025-09-07T06:44:17.2818022Z + export CUDA_VISIBLE_DEVICES=0 2025-09-07T06:44:17.2819227Z + CUDA_VISIBLE_DEVICES=0 2025-09-07T06:44:17.2819335Z + export HIP_VISIBLE_DEVICES=0 2025-09-07T06:44:17.2819445Z + HIP_VISIBLE_DEVICES=0 2025-09-07T06:44:17.2819551Z + [[ default == \d\i\s\t\r\i\b\u\t\e\d ]] 2025-09-07T06:44:17.2819671Z + [[ default == \s\l\o\w ]] 2025-09-07T06:44:17.2819806Z + [[ linux-noble-rocm-py3.12-mi300 == *slow-gradcheck* ]] 2025-09-07T06:44:17.2819961Z + [[ linux-noble-rocm-py3.12-mi300 == *cuda* ]] 2025-09-07T06:44:17.2820096Z + [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-09-07T06:44:17.2820232Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2025-09-07T06:44:17.2820362Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2025-09-07T06:44:17.2820481Z + [[ default == *crossref* ]] 2025-09-07T06:44:17.2821671Z + [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-09-07T06:44:17.2821797Z + export VALGRIND=OFF 2025-09-07T06:44:17.2821891Z + VALGRIND=OFF 2025-09-07T06:44:17.2821975Z + rocminfo 2025-09-07T06:44:17.2915665Z ROCk module version 6.12.12 is loaded 2025-09-07T06:44:17.3392703Z ===================== 2025-09-07T06:44:17.3392935Z HSA System Attributes 2025-09-07T06:44:17.3393440Z ===================== 2025-09-07T06:44:17.3393620Z Runtime Version: 1.15 2025-09-07T06:44:17.3393818Z Runtime Ext Version: 1.7 2025-09-07T06:44:17.3394094Z System Timestamp Freq.: 1000.000000MHz 2025-09-07T06:44:17.3394377Z Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) 2025-09-07T06:44:17.3394692Z Machine Model: LARGE 2025-09-07T06:44:17.3395021Z System Endianness: LITTLE 2025-09-07T06:44:17.3395504Z Mwaitx: DISABLED 2025-09-07T06:44:17.3395736Z XNACK enabled: NO 2025-09-07T06:44:17.3396025Z DMAbuf Support: YES 2025-09-07T06:44:17.3396240Z VMM Support: YES 2025-09-07T06:44:17.3396365Z 2025-09-07T06:44:17.3396580Z ========== 2025-09-07T06:44:17.3396932Z HSA Agents 2025-09-07T06:44:17.3397560Z ========== 2025-09-07T06:44:17.3397904Z ******* 2025-09-07T06:44:17.3398247Z Agent 1 2025-09-07T06:44:17.3398436Z ******* 2025-09-07T06:44:17.3398878Z Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:44:17.3399522Z Uuid: CPU-XX 2025-09-07T06:44:17.3399834Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:44:17.3400106Z Vendor Name: CPU 2025-09-07T06:44:17.3404404Z Feature: None specified 2025-09-07T06:44:17.3404652Z Profile: FULL_PROFILE 2025-09-07T06:44:17.3404909Z Float Round Mode: NEAR 2025-09-07T06:44:17.3405179Z Max Queue Number: 0(0x0) 2025-09-07T06:44:17.3405459Z Queue Min Size: 0(0x0) 2025-09-07T06:44:17.3405726Z Queue Max Size: 0(0x0) 2025-09-07T06:44:17.3405990Z Queue Type: MULTI 2025-09-07T06:44:17.3406212Z Node: 0 2025-09-07T06:44:17.3406439Z Device Type: CPU 2025-09-07T06:44:17.3406646Z Cache Info: 2025-09-07T06:44:17.3406838Z L1: 65536(0x10000) KB 2025-09-07T06:44:17.3407057Z Chip ID: 0(0x0) 2025-09-07T06:44:17.3407287Z ASIC Revision: 0(0x0) 2025-09-07T06:44:17.3407530Z Cacheline Size: 64(0x40) 2025-09-07T06:44:17.3407772Z Max Clock Freq. (MHz): 0 2025-09-07T06:44:17.3408000Z BDFID: 0 2025-09-07T06:44:17.3408233Z Internal Node ID: 0 2025-09-07T06:44:17.3408489Z Compute Unit: 80 2025-09-07T06:44:17.3408724Z SIMDs per CU: 0 2025-09-07T06:44:17.3408953Z Shader Engines: 0 2025-09-07T06:44:17.3409276Z Shader Arrs. per Eng.: 0 2025-09-07T06:44:17.3409524Z WatchPts on Addr. Ranges:1 2025-09-07T06:44:17.3409728Z Memory Properties: 2025-09-07T06:44:17.3409885Z Features: None 2025-09-07T06:44:17.3410040Z Pool Info: 2025-09-07T06:44:17.3410191Z Pool 1 2025-09-07T06:44:17.3410377Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-09-07T06:44:17.3410704Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:44:17.3410918Z Allocatable: TRUE 2025-09-07T06:44:17.3411155Z Alloc Granule: 4KB 2025-09-07T06:44:17.3411596Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3411834Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3414507Z Accessible by all: TRUE 2025-09-07T06:44:17.3414724Z Pool 2 2025-09-07T06:44:17.3414907Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-09-07T06:44:17.3415134Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:44:17.3415352Z Allocatable: TRUE 2025-09-07T06:44:17.3415577Z Alloc Granule: 4KB 2025-09-07T06:44:17.3415823Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3416056Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3416493Z Accessible by all: TRUE 2025-09-07T06:44:17.3416702Z Pool 3 2025-09-07T06:44:17.3416880Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-09-07T06:44:17.3417090Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:44:17.3417295Z Allocatable: TRUE 2025-09-07T06:44:17.3417514Z Alloc Granule: 4KB 2025-09-07T06:44:17.3417741Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3417969Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3418192Z Accessible by all: TRUE 2025-09-07T06:44:17.3418387Z Pool 4 2025-09-07T06:44:17.3418563Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-09-07T06:44:17.3418769Z Size: 660245920(0x275a8da0) KB 2025-09-07T06:44:17.3418987Z Allocatable: TRUE 2025-09-07T06:44:17.3419206Z Alloc Granule: 4KB 2025-09-07T06:44:17.3419435Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3419664Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3419889Z Accessible by all: TRUE 2025-09-07T06:44:17.3420085Z ISA Info: 2025-09-07T06:44:17.3420227Z ******* 2025-09-07T06:44:17.3420365Z Agent 2 2025-09-07T06:44:17.3420500Z ******* 2025-09-07T06:44:17.3420663Z Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:44:17.3422417Z Uuid: CPU-XX 2025-09-07T06:44:17.3422634Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:44:17.3422871Z Vendor Name: CPU 2025-09-07T06:44:17.3423186Z Feature: None specified 2025-09-07T06:44:17.3423400Z Profile: FULL_PROFILE 2025-09-07T06:44:17.3423616Z Float Round Mode: NEAR 2025-09-07T06:44:17.3423832Z Max Queue Number: 0(0x0) 2025-09-07T06:44:17.3424044Z Queue Min Size: 0(0x0) 2025-09-07T06:44:17.3424251Z Queue Max Size: 0(0x0) 2025-09-07T06:44:17.3424457Z Queue Type: MULTI 2025-09-07T06:44:17.3424654Z Node: 1 2025-09-07T06:44:17.3426365Z Device Type: CPU 2025-09-07T06:44:17.3426555Z Cache Info: 2025-09-07T06:44:17.3426723Z L1: 65536(0x10000) KB 2025-09-07T06:44:17.3426991Z Chip ID: 0(0x0) 2025-09-07T06:44:17.3427196Z ASIC Revision: 0(0x0) 2025-09-07T06:44:17.3427411Z Cacheline Size: 64(0x40) 2025-09-07T06:44:17.3427627Z Max Clock Freq. (MHz): 0 2025-09-07T06:44:17.3427830Z BDFID: 0 2025-09-07T06:44:17.3428033Z Internal Node ID: 1 2025-09-07T06:44:17.3428246Z Compute Unit: 80 2025-09-07T06:44:17.3428453Z SIMDs per CU: 0 2025-09-07T06:44:17.3430130Z Shader Engines: 0 2025-09-07T06:44:17.3430349Z Shader Arrs. per Eng.: 0 2025-09-07T06:44:17.3430573Z WatchPts on Addr. Ranges:1 2025-09-07T06:44:17.3430853Z Memory Properties: 2025-09-07T06:44:17.3431004Z Features: None 2025-09-07T06:44:17.3431154Z Pool Info: 2025-09-07T06:44:17.3431298Z Pool 1 2025-09-07T06:44:17.3431477Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-09-07T06:44:17.3431687Z Size: 656328584(0x271ec788) KB 2025-09-07T06:44:17.3431897Z Allocatable: TRUE 2025-09-07T06:44:17.3432117Z Alloc Granule: 4KB 2025-09-07T06:44:17.3433919Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3434150Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3434375Z Accessible by all: TRUE 2025-09-07T06:44:17.3434569Z Pool 2 2025-09-07T06:44:17.3434756Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-09-07T06:44:17.3434974Z Size: 656328584(0x271ec788) KB 2025-09-07T06:44:17.3435180Z Allocatable: TRUE 2025-09-07T06:44:17.3435399Z Alloc Granule: 4KB 2025-09-07T06:44:17.3435628Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3435857Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3437565Z Accessible by all: TRUE 2025-09-07T06:44:17.3437769Z Pool 3 2025-09-07T06:44:17.3437948Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-09-07T06:44:17.3438155Z Size: 656328584(0x271ec788) KB 2025-09-07T06:44:17.3438362Z Allocatable: TRUE 2025-09-07T06:44:17.3438590Z Alloc Granule: 4KB 2025-09-07T06:44:17.3438825Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3439054Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3439279Z Accessible by all: TRUE 2025-09-07T06:44:17.3439474Z Pool 4 2025-09-07T06:44:17.3439650Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-09-07T06:44:17.3441306Z Size: 656328584(0x271ec788) KB 2025-09-07T06:44:17.3441519Z Allocatable: TRUE 2025-09-07T06:44:17.3441738Z Alloc Granule: 4KB 2025-09-07T06:44:17.3441965Z Alloc Recommended Granule:4KB 2025-09-07T06:44:17.3442193Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3442424Z Accessible by all: TRUE 2025-09-07T06:44:17.3442716Z ISA Info: 2025-09-07T06:44:17.3442858Z ******* 2025-09-07T06:44:17.3442995Z Agent 3 2025-09-07T06:44:17.3443220Z ******* 2025-09-07T06:44:17.3443378Z Name: gfx942 2025-09-07T06:44:17.3445075Z Uuid: GPU-bec9e12a4472d3aa 2025-09-07T06:44:17.3445303Z Marketing Name: AMD Instinct Mi325X VF 2025-09-07T06:44:17.3445528Z Vendor Name: AMD 2025-09-07T06:44:17.3445743Z Feature: KERNEL_DISPATCH 2025-09-07T06:44:17.3445956Z Profile: BASE_PROFILE 2025-09-07T06:44:17.3446174Z Float Round Mode: NEAR 2025-09-07T06:44:17.3446393Z Max Queue Number: 128(0x80) 2025-09-07T06:44:17.3446680Z Queue Min Size: 64(0x40) 2025-09-07T06:44:17.3446891Z Queue Max Size: 131072(0x20000) 2025-09-07T06:44:17.3447102Z Queue Type: MULTI 2025-09-07T06:44:17.3447300Z Node: 2 2025-09-07T06:44:17.3449026Z Device Type: GPU 2025-09-07T06:44:17.3449221Z Cache Info: 2025-09-07T06:44:17.3449379Z L1: 32(0x20) KB 2025-09-07T06:44:17.3449564Z L2: 4096(0x1000) KB 2025-09-07T06:44:17.3449744Z L3: 262144(0x40000) KB 2025-09-07T06:44:17.3449930Z Chip ID: 29881(0x74b9) 2025-09-07T06:44:17.3450135Z ASIC Revision: 1(0x1) 2025-09-07T06:44:17.3450362Z Cacheline Size: 128(0x80) 2025-09-07T06:44:17.3450586Z Max Clock Freq. (MHz): 2100 2025-09-07T06:44:17.3450790Z BDFID: 33536 2025-09-07T06:44:17.3450994Z Internal Node ID: 2 2025-09-07T06:44:17.3452661Z Compute Unit: 304 2025-09-07T06:44:17.3452877Z SIMDs per CU: 4 2025-09-07T06:44:17.3453177Z Shader Engines: 32 2025-09-07T06:44:17.3453398Z Shader Arrs. per Eng.: 1 2025-09-07T06:44:17.3453624Z WatchPts on Addr. Ranges:4 2025-09-07T06:44:17.3453854Z Coherent Host Access: FALSE 2025-09-07T06:44:17.3454055Z Memory Properties: 2025-09-07T06:44:17.3454215Z Features: KERNEL_DISPATCH 2025-09-07T06:44:17.3454434Z Fast F16 Operation: TRUE 2025-09-07T06:44:17.3454660Z Wavefront Size: 64(0x40) 2025-09-07T06:44:17.3454927Z Workgroup Max Size: 1024(0x400) 2025-09-07T06:44:17.3456953Z Workgroup Max Size per Dimension: 2025-09-07T06:44:17.3457136Z x 1024(0x400) 2025-09-07T06:44:17.3457318Z y 1024(0x400) 2025-09-07T06:44:17.3457494Z z 1024(0x400) 2025-09-07T06:44:17.3457690Z Max Waves Per CU: 32(0x20) 2025-09-07T06:44:17.3457906Z Max Work-item Per CU: 2048(0x800) 2025-09-07T06:44:17.3458123Z Grid Max Size: 4294967295(0xffffffff) 2025-09-07T06:44:17.3458317Z Grid Max Size per Dimension: 2025-09-07T06:44:17.3458477Z x 4294967295(0xffffffff) 2025-09-07T06:44:17.3458733Z y 4294967295(0xffffffff) 2025-09-07T06:44:17.3458918Z z 4294967295(0xffffffff) 2025-09-07T06:44:17.3459126Z Max fbarriers/Workgrp: 32 2025-09-07T06:44:17.3460965Z Packet Processor uCode:: 177 2025-09-07T06:44:17.3461196Z SDMA engine uCode:: 24 2025-09-07T06:44:17.3461415Z IOMMU Support:: None 2025-09-07T06:44:17.3461607Z Pool Info: 2025-09-07T06:44:17.3461752Z Pool 1 2025-09-07T06:44:17.3461934Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-09-07T06:44:17.3462148Z Size: 268107776(0xffb0000) KB 2025-09-07T06:44:17.3462359Z Allocatable: TRUE 2025-09-07T06:44:17.3462648Z Alloc Granule: 4KB 2025-09-07T06:44:17.3462885Z Alloc Recommended Granule:2048KB 2025-09-07T06:44:17.3463222Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3465071Z Accessible by all: FALSE 2025-09-07T06:44:17.3465278Z Pool 2 2025-09-07T06:44:17.3465458Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-09-07T06:44:17.3465669Z Size: 268107776(0xffb0000) KB 2025-09-07T06:44:17.3465875Z Allocatable: TRUE 2025-09-07T06:44:17.3466094Z Alloc Granule: 4KB 2025-09-07T06:44:17.3466323Z Alloc Recommended Granule:2048KB 2025-09-07T06:44:17.3466553Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3466778Z Accessible by all: FALSE 2025-09-07T06:44:17.3466990Z Pool 3 2025-09-07T06:44:17.3467165Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-09-07T06:44:17.3468821Z Size: 268107776(0xffb0000) KB 2025-09-07T06:44:17.3469029Z Allocatable: TRUE 2025-09-07T06:44:17.3469248Z Alloc Granule: 4KB 2025-09-07T06:44:17.3469476Z Alloc Recommended Granule:2048KB 2025-09-07T06:44:17.3469705Z Alloc Alignment: 4KB 2025-09-07T06:44:17.3469929Z Accessible by all: FALSE 2025-09-07T06:44:17.3470123Z Pool 4 2025-09-07T06:44:17.3470291Z Segment: GROUP 2025-09-07T06:44:17.3470490Z Size: 64(0x40) KB 2025-09-07T06:44:17.3470711Z Allocatable: FALSE 2025-09-07T06:44:17.3470931Z Alloc Granule: 0KB 2025-09-07T06:44:17.3472590Z Alloc Recommended Granule:0KB 2025-09-07T06:44:17.3472818Z Alloc Alignment: 0KB 2025-09-07T06:44:17.3473042Z Accessible by all: FALSE 2025-09-07T06:44:17.3473355Z ISA Info: 2025-09-07T06:44:17.3473502Z ISA 1 2025-09-07T06:44:17.3473685Z Name: amdgcn-amd-amdhsa--gfx942:sramecc+:xnack- 2025-09-07T06:44:17.3473920Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-09-07T06:44:17.3474148Z Profiles: HSA_PROFILE_BASE 2025-09-07T06:44:17.3474374Z Default Rounding Mode: NEAR 2025-09-07T06:44:17.3474641Z Default Rounding Mode: NEAR 2025-09-07T06:44:17.3476991Z Fast f16: TRUE 2025-09-07T06:44:17.3477234Z Workgroup Max Size: 1024(0x400) 2025-09-07T06:44:17.3477459Z Workgroup Max Size per Dimension: 2025-09-07T06:44:17.3477638Z x 1024(0x400) 2025-09-07T06:44:17.3477822Z y 1024(0x400) 2025-09-07T06:44:17.3478002Z z 1024(0x400) 2025-09-07T06:44:17.3478198Z Grid Max Size: 4294967295(0xffffffff) 2025-09-07T06:44:17.3478395Z Grid Max Size per Dimension: 2025-09-07T06:44:17.3478563Z x 4294967295(0xffffffff) 2025-09-07T06:44:17.3478751Z y 4294967295(0xffffffff) 2025-09-07T06:44:17.3478982Z z 4294967295(0xffffffff) 2025-09-07T06:44:17.3481061Z FBarrier Max Size: 32 2025-09-07T06:44:17.3481265Z ISA 2 2025-09-07T06:44:17.3481464Z Name: amdgcn-amd-amdhsa--gfx9-4-generic:sramecc+:xnack- 2025-09-07T06:44:17.3481712Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-09-07T06:44:17.3481939Z Profiles: HSA_PROFILE_BASE 2025-09-07T06:44:17.3482164Z Default Rounding Mode: NEAR 2025-09-07T06:44:17.3482397Z Default Rounding Mode: NEAR 2025-09-07T06:44:17.3482614Z Fast f16: TRUE 2025-09-07T06:44:17.3482826Z Workgroup Max Size: 1024(0x400) 2025-09-07T06:44:17.3483031Z Workgroup Max Size per Dimension: 2025-09-07T06:44:17.3483300Z x 1024(0x400) 2025-09-07T06:44:17.3485053Z y 1024(0x400) 2025-09-07T06:44:17.3485233Z z 1024(0x400) 2025-09-07T06:44:17.3485431Z Grid Max Size: 4294967295(0xffffffff) 2025-09-07T06:44:17.3485626Z Grid Max Size per Dimension: 2025-09-07T06:44:17.3485793Z x 4294967295(0xffffffff) 2025-09-07T06:44:17.3485978Z y 4294967295(0xffffffff) 2025-09-07T06:44:17.3486161Z z 4294967295(0xffffffff) 2025-09-07T06:44:17.3486364Z FBarrier Max Size: 32 2025-09-07T06:44:17.3486555Z *** Done *** 2025-09-07T06:44:17.3486698Z + rocminfo 2025-09-07T06:44:17.3486829Z + grep -E 'Name:.*\sgfx|Marketing' 2025-09-07T06:44:17.4331130Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:44:17.4332048Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-09-07T06:44:17.4332357Z Name: gfx942 2025-09-07T06:44:17.4332596Z Marketing Name: AMD Instinct Mi325X VF 2025-09-07T06:44:17.4422051Z + MAYBE_ROCM=rocm/ 2025-09-07T06:44:17.4422237Z + [[ linux-noble-rocm-py3.12-mi300 == *xpu* ]] 2025-09-07T06:44:17.4422448Z + [[ linux-noble-rocm-py3.12-mi300 != *-bazel-* ]] 2025-09-07T06:44:17.4422646Z + pip_install ninja==1.10.2 2025-09-07T06:44:17.4422861Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2025-09-07T06:44:17.4424663Z + python3 -m pip install --progress-bar off ninja==1.10.2 2025-09-07T06:44:17.9727682Z Collecting ninja==1.10.2 2025-09-07T06:44:18.0423458Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2025-09-07T06:44:18.2919296Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2025-09-07T06:44:18.4367064Z Installing collected packages: ninja 2025-09-07T06:44:18.4369157Z Attempting uninstall: ninja 2025-09-07T06:44:18.4379017Z Found existing installation: ninja 1.11.1.3 2025-09-07T06:44:18.4389788Z Uninstalling ninja-1.11.1.3: 2025-09-07T06:44:18.4861756Z Successfully uninstalled ninja-1.11.1.3 2025-09-07T06:44:18.5058877Z Successfully installed ninja-1.10.2 2025-09-07T06:44:18.5437522Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T06:44:18.5438636Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-09-07T06:44:18.5439720Z + [[ linux-noble-rocm-py3.12-mi300 == *aarch64* ]] 2025-09-07T06:44:18.5440169Z + [[ linux-noble-rocm-py3.12-mi300 == *asan* ]] 2025-09-07T06:44:18.5446995Z + [[ linux-noble-rocm-py3.12-mi300 == *-debug* ]] 2025-09-07T06:44:18.5447261Z + [[ linux-noble-rocm-py3.12-mi300 != *-bazel-* ]] 2025-09-07T06:44:18.5447487Z + echo 'We are not in debug mode: linux-noble-rocm-py3.12-mi300. Expect the assertion to pass' 2025-09-07T06:44:18.5447747Z We are not in debug mode: linux-noble-rocm-py3.12-mi300. Expect the assertion to pass 2025-09-07T06:44:18.5447958Z + cd test 2025-09-07T06:44:18.5448112Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2025-09-07T06:44:19.8255635Z + [[ default == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2025-09-07T06:44:19.8258664Z + [[ default == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2025-09-07T06:44:19.8258882Z + [[ default == \l\e\g\a\c\y\_\n\v\i\d\i\a\_\d\r\i\v\e\r ]] 2025-09-07T06:44:19.8259108Z + DYNAMO_BENCHMARK_FLAGS=() 2025-09-07T06:44:19.8266464Z + [[ default == *pr_time_benchmarks* ]] 2025-09-07T06:44:19.8266753Z + [[ default == *dynamo_eager* ]] 2025-09-07T06:44:19.8266949Z + [[ default == *aot_eager* ]] 2025-09-07T06:44:19.8267110Z + [[ default == *aot_inductor* ]] 2025-09-07T06:44:19.8267284Z + [[ default == *max_autotune_inductor* ]] 2025-09-07T06:44:19.8267459Z + [[ default == *inductor* ]] 2025-09-07T06:44:19.8267616Z + [[ default == *dynamic* ]] 2025-09-07T06:44:19.8267766Z + [[ default == *cpu* ]] 2025-09-07T06:44:19.8267947Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2025-09-07T06:44:19.8268146Z + [[ linux-noble-rocm-py3.12-mi300 == *libtorch* ]] 2025-09-07T06:44:19.8268361Z + [[ linux-noble-rocm-py3.12-mi300 == *-bazel-* ]] 2025-09-07T06:44:19.8268547Z + cd test 2025-09-07T06:44:19.8270910Z + python -c 'import torch; print(torch.__config__.show())' 2025-09-07T06:44:20.7420342Z PyTorch built with: 2025-09-07T06:44:20.7420786Z - GCC 11.5 2025-09-07T06:44:20.7421057Z - C++ Version: 201703 2025-09-07T06:44:20.7421685Z - Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications 2025-09-07T06:44:20.7422509Z - Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-09-07T06:44:20.7422982Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2025-09-07T06:44:20.7423786Z - LAPACK is enabled (usually provided by MKL) 2025-09-07T06:44:20.7432085Z - NNPACK is enabled 2025-09-07T06:44:20.7432197Z - CPU capability usage: AVX512 2025-09-07T06:44:20.7432311Z - HIP Runtime 6.4.43484 2025-09-07T06:44:20.7432413Z - MIOpen 3.4.0 2025-09-07T06:44:20.7432501Z - Magma 2.7.2 2025-09-07T06:44:20.7434581Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=93fb23d6fae7c4e82c4239a1033e522088742634, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_FBGEMM_GENAI -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -DC10_NODEPRECATED -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -faligned-new -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.9.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=ON, USE_ROCM_KERNEL_ASSERT=OFF, USE_XCCL=OFF, USE_XPU=OFF, 2025-09-07T06:44:20.7436204Z 2025-09-07T06:44:20.9884797Z + cd test 2025-09-07T06:44:20.9885041Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2025-09-07T06:44:21.7366247Z ATen/Parallel: 2025-09-07T06:44:21.7367280Z at::get_num_threads() : 160 2025-09-07T06:44:21.7367487Z at::get_num_interop_threads() : 160 2025-09-07T06:44:21.7368116Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2025-09-07T06:44:21.7368318Z omp_get_max_threads() : 160 2025-09-07T06:44:21.7368631Z Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications 2025-09-07T06:44:21.7368956Z mkl_get_max_threads() : 160 2025-09-07T06:44:21.7369249Z Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-09-07T06:44:21.7369496Z std::thread::hardware_concurrency() : 160 2025-09-07T06:44:21.7369677Z Environment variables: 2025-09-07T06:44:21.7374263Z OMP_NUM_THREADS : [not set] 2025-09-07T06:44:21.7374431Z MKL_NUM_THREADS : [not set] 2025-09-07T06:44:21.7374590Z ATen parallel backend: OpenMP 2025-09-07T06:44:21.7374696Z 2025-09-07T06:44:21.9379297Z + [[ default == *numpy_2* ]] 2025-09-07T06:44:21.9380806Z + [[ linux-noble-rocm-py3.12-mi300 == *aarch64* ]] 2025-09-07T06:44:21.9381155Z + [[ default == *backward* ]] 2025-09-07T06:44:21.9381340Z + [[ default == *xla* ]] 2025-09-07T06:44:21.9381597Z + [[ default == *vllm* ]] 2025-09-07T06:44:21.9381794Z + [[ default == *executorch* ]] 2025-09-07T06:44:21.9390366Z + [[ default == \j\i\t\_\l\e\g\a\c\y ]] 2025-09-07T06:44:21.9390632Z + [[ linux-noble-rocm-py3.12-mi300 == *libtorch* ]] 2025-09-07T06:44:21.9390836Z + [[ default == distributed ]] 2025-09-07T06:44:21.9391005Z + [[ default == *operator_benchmark* ]] 2025-09-07T06:44:21.9391196Z + [[ default == *inductor_distributed* ]] 2025-09-07T06:44:21.9391384Z + [[ default == *inductor-halide* ]] 2025-09-07T06:44:21.9391565Z + [[ default == *inductor-triton-cpu* ]] 2025-09-07T06:44:21.9391754Z + [[ default == *inductor-micro-benchmark* ]] 2025-09-07T06:44:21.9391936Z + [[ default == *huggingface* ]] 2025-09-07T06:44:21.9392093Z + [[ default == *timm* ]] 2025-09-07T06:44:21.9392238Z + [[ default == cachebench ]] 2025-09-07T06:44:21.9392396Z + [[ default == verify_cachebench ]] 2025-09-07T06:44:21.9392568Z + [[ default == *torchbench* ]] 2025-09-07T06:44:21.9395020Z + [[ default == *inductor_cpp_wrapper* ]] 2025-09-07T06:44:21.9395221Z + [[ default == *inductor* ]] 2025-09-07T06:44:21.9395383Z + [[ default == *einops* ]] 2025-09-07T06:44:21.9395543Z + [[ default == *dynamo_wrapped* ]] 2025-09-07T06:44:21.9395729Z + [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-09-07T06:44:21.9395921Z + [[ -n '' ]] 2025-09-07T06:44:21.9396041Z + [[ 4 == 1 ]] 2025-09-07T06:44:21.9396159Z + [[ 4 == 2 ]] 2025-09-07T06:44:21.9396279Z + [[ 4 -gt 2 ]] 2025-09-07T06:44:21.9396407Z + install_torchvision 2025-09-07T06:44:21.9396551Z + local orig_preload 2025-09-07T06:44:21.9398369Z + local commit 2025-09-07T06:44:21.9399655Z ++ get_pinned_commit vision 2025-09-07T06:44:21.9401174Z ++ cat .github/ci_commit_pins/vision.txt 2025-09-07T06:44:21.9401546Z + commit=966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T06:44:21.9401759Z + orig_preload= 2025-09-07T06:44:21.9401934Z + '[' -n '' ']' 2025-09-07T06:44:21.9402102Z + [[ linux-noble-rocm-py3.12-mi300 == *cuda* ]] 2025-09-07T06:44:21.9402505Z + pip_build_and_install git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 dist/vision 2025-09-07T06:44:21.9403716Z + local build_target=git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T06:44:21.9404030Z + local wheel_dir=dist/vision 2025-09-07T06:44:21.9404195Z + local found_whl=0 2025-09-07T06:44:21.9410974Z + for file in "${wheel_dir}"/*.whl 2025-09-07T06:44:21.9411182Z + [[ -f dist/vision/*.whl ]] 2025-09-07T06:44:21.9411331Z + '[' 0 == 0 ']' 2025-09-07T06:44:21.9411734Z + python3 -m pip wheel --no-build-isolation --no-deps --no-use-pep517 -w dist/vision git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T06:44:22.0795532Z Collecting git+https://github.com/pytorch/vision.git@966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T06:44:22.0812586Z Cloning https://github.com/pytorch/vision.git (to revision 966da7e46f65d6d49df3e31214470a4fe5cc8e66) to /tmp/pip-req-build-c_ogjumv 2025-09-07T06:44:22.0813905Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-c_ogjumv 2025-09-07T06:44:23.6286182Z Running command git rev-parse -q --verify 'sha^966da7e46f65d6d49df3e31214470a4fe5cc8e66' 2025-09-07T06:44:23.6299374Z Running command git fetch -q https://github.com/pytorch/vision.git 966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T06:44:23.8639197Z Running command git checkout -q 966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T06:44:24.2046423Z Resolved https://github.com/pytorch/vision.git to commit 966da7e46f65d6d49df3e31214470a4fe5cc8e66 2025-09-07T06:44:26.1445408Z Preparing metadata (setup.py) ... [?25l- \ | done 2025-09-07T06:44:26.1476497Z [?25hBuilding wheels for collected packages: torchvision 2025-09-07T06:44:26.1586238Z  DEPRECATION: Building 'torchvision' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'torchvision'. Discussion can be found at https://github.com/pypa/pip/issues/6334 2025-09-07T06:44:59.8014931Z  Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - done 2025-09-07T06:44:59.8015597Z [?25h Created wheel for torchvision: filename=torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl size=1581349 sha256=5fbb011840449d0c509f93cef79a00e726a86ef146a3b5c9dcdb57722e8c83a6 2025-09-07T06:44:59.8016146Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/10/ba/61/eb5228b3631dc6bb4f478b3aa59575551a5473e4596e4c001a 2025-09-07T06:44:59.8016466Z Successfully built torchvision 2025-09-07T06:44:59.8606559Z + for file in "${wheel_dir}"/*.whl 2025-09-07T06:44:59.8607176Z + pip_install_whl dist/vision/torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl 2025-09-07T06:44:59.8607486Z + args=('dist/vision/torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl') 2025-09-07T06:44:59.8607867Z + local args 2025-09-07T06:44:59.8609543Z + [[ dist/vision/torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl == *\ * ]] 2025-09-07T06:44:59.8610620Z + for path in "${args[@]}" 2025-09-07T06:44:59.8610919Z + echo 'Installing dist/vision/torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl' 2025-09-07T06:44:59.8611327Z Installing dist/vision/torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl 2025-09-07T06:44:59.8611795Z + python3 -mpip install --no-index --no-deps dist/vision/torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl 2025-09-07T06:45:00.0104145Z Processing ./dist/vision/torchvision-0.22.0a0+966da7e-cp312-cp312-linux_x86_64.whl 2025-09-07T06:45:00.0143565Z Installing collected packages: torchvision 2025-09-07T06:45:00.2738413Z Successfully installed torchvision-0.22.0a0+966da7e 2025-09-07T06:45:00.3020523Z + '[' -n '' ']' 2025-09-07T06:45:00.3021964Z + test_python_shard 4 2025-09-07T06:45:00.3022184Z + [[ -z 6 ]] 2025-09-07T06:45:00.3022479Z + python test/run_test.py --exclude-jit-executor --exclude-distributed-tests --shard 4 6 --verbose --upload-artifacts-while-running 2025-09-07T06:45:01.7398582Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T06:45:01.7399632Z import pkg_resources 2025-09-07T06:45:02.2238554Z Excluding test_cuda_nvml_based_avail on ROCm 2025-09-07T06:45:02.2438741Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/pytorch/test/.pytorch-disabled-tests.json 2025-09-07T06:45:02.4063047Z Ignoring disabled issues: [''] 2025-09-07T06:45:02.4153488Z Found test times from artifacts 2025-09-07T06:45:02.4502364Z Found test times from artifacts 2025-09-07T06:45:02.4514573Z Running all tests 2025-09-07T06:45:02.4777341Z Running parallel tests on 1 processes 2025-09-07T06:45:02.4780654Z Name: tests to run (est. time: 155.17min) 2025-09-07T06:45:02.4794787Z Serial tests (82): 2025-09-07T06:45:02.4795016Z inductor/test_aot_inductor 3/3 2025-09-07T06:45:02.4795242Z dynamo/test_exc 1/1 2025-09-07T06:45:02.4795681Z dynamo/test_exceptions 1/1 2025-09-07T06:45:02.4807224Z dynamo/test_export 1/1 2025-09-07T06:45:02.4807522Z dynamo/test_fx_passes_pre_grad 1/1 2025-09-07T06:45:02.4808052Z dynamo/test_graph_deduplication 1/1 2025-09-07T06:45:02.4808235Z dynamo/test_guard_serialization 1/1 2025-09-07T06:45:02.4808375Z dynamo/test_hooks 1/1 2025-09-07T06:45:02.4808524Z dynamo/test_inline_and_install 1/1 2025-09-07T06:45:02.4809207Z dynamo/test_model_output 1/1 2025-09-07T06:45:02.4809461Z dynamo/test_modes 1/1 2025-09-07T06:45:02.4809756Z dynamo/test_modules 1/1 2025-09-07T06:45:02.4810980Z dynamo/test_package 1/1 2025-09-07T06:45:02.4821408Z dynamo/test_recompiles 1/1 2025-09-07T06:45:02.4821607Z dynamo/test_resume 1/1 2025-09-07T06:45:02.4821764Z dynamo/test_sdpa 1/1 2025-09-07T06:45:02.4821913Z dynamo/test_sets 1/1 2025-09-07T06:45:02.4822082Z dynamo/test_skip_guard_eval_unsafe 1/1 2025-09-07T06:45:02.4822271Z dynamo/test_skip_non_tensor 1/1 2025-09-07T06:45:02.4822450Z dynamo/test_sources 1/1 2025-09-07T06:45:02.4822614Z dynamo/test_structured_trace 1/1 2025-09-07T06:45:02.4822790Z dynamo/test_subclasses 1/1 2025-09-07T06:45:02.4822953Z dynamo/test_utils 1/1 2025-09-07T06:45:02.4823201Z dynamo/test_verify_correctness 1/1 2025-09-07T06:45:02.4823395Z dynamo/test_view 1/1 2025-09-07T06:45:02.4823578Z export/test_converter 1/1 2025-09-07T06:45:02.4823761Z export/test_db 1/1 2025-09-07T06:45:02.4825946Z export/test_experimental 1/1 2025-09-07T06:45:02.4826168Z export/test_export_training_ir_to_run_decomp 1/1 2025-09-07T06:45:02.4826371Z functorch/test_ac 1/1 2025-09-07T06:45:02.4826517Z functorch/test_ops 2/4 2025-09-07T06:45:02.4826670Z inductor/test_async_compile 1/1 2025-09-07T06:45:02.4826839Z inductor/test_binary_folding 1/1 2025-09-07T06:45:02.4827015Z inductor/test_compile_subprocess 2/2 2025-09-07T06:45:02.4827191Z inductor/test_control_flow 2/2 2025-09-07T06:45:02.4827356Z inductor/test_cpu_repro 5/5 2025-09-07T06:45:02.4827518Z inductor/test_cudacodecache 1/1 2025-09-07T06:45:02.4827689Z inductor/test_flex_decoding 2/2 2025-09-07T06:45:02.4829396Z inductor/test_graph_transform_observer 1/1 2025-09-07T06:45:02.4829594Z inductor/test_group_batch_fusion 1/1 2025-09-07T06:45:02.4829771Z inductor/test_inductor_utils 1/1 2025-09-07T06:45:02.4829944Z inductor/test_inplacing_pass 1/1 2025-09-07T06:45:02.4830111Z inductor/test_metrics 1/1 2025-09-07T06:45:02.4830269Z inductor/test_minifier 1/1 2025-09-07T06:45:02.4830434Z inductor/test_padding 1/1 2025-09-07T06:45:02.4830952Z inductor/test_pattern_matcher 1/1 2025-09-07T06:45:02.4831128Z inductor/test_select_algorithm 1/1 2025-09-07T06:45:02.4831340Z inductor/test_torchinductor_codegen_config_overrides 1/1 2025-09-07T06:45:02.4831588Z inductor/test_torchinductor_codegen_dynamic_shapes 1/4 2025-09-07T06:45:02.4833380Z inductor/test_torchinductor_dynamic_shapes 2/4 2025-09-07T06:45:02.4833591Z inductor/test_torchinductor_opinfo 4/9 2025-09-07T06:45:02.4833787Z inductor/test_torchinductor_strided_blocks 1/1 2025-09-07T06:45:02.4833980Z inductor/test_triton_cpu_backend 1/1 2025-09-07T06:45:02.4834156Z inductor/test_triton_wrapper 1/1 2025-09-07T06:45:02.4834329Z inductor/test_unbacked_symints 1/1 2025-09-07T06:45:02.4834499Z inductor/test_utils 1/1 2025-09-07T06:45:02.4834653Z lazy/test_bindings 1/1 2025-09-07T06:45:02.4834805Z lazy/test_debug_util 1/1 2025-09-07T06:45:02.4835223Z lazy/test_functionalization 1/1 2025-09-07T06:45:02.4835390Z lazy/test_generator 1/1 2025-09-07T06:45:02.4836971Z lazy/test_reuse_ir 1/1 2025-09-07T06:45:02.4837130Z lazy/test_step_closures 1/1 2025-09-07T06:45:02.4837284Z lazy/test_ts_opinfo 1/1 2025-09-07T06:45:02.4837431Z nn/test_convolution 1/1 2025-09-07T06:45:02.4837579Z test_autoload_disable 1/1 2025-09-07T06:45:02.4837730Z test_decomp 5/12 2025-09-07T06:45:02.4837866Z test_decomp 11/12 2025-09-07T06:45:02.4838008Z test_fx_experimental 1/1 2025-09-07T06:45:02.4838158Z test_jit_llga_fuser 1/1 2025-09-07T06:45:02.4838300Z test_jiterator 1/1 2025-09-07T06:45:02.4838438Z test_legacy_vmap 1/1 2025-09-07T06:45:02.4839968Z test_license 1/1 2025-09-07T06:45:02.4840107Z test_linalg 1/1 2025-09-07T06:45:02.4840238Z test_namedtensor 1/1 2025-09-07T06:45:02.4840389Z test_namedtuple_return_api 1/1 2025-09-07T06:45:02.4840553Z test_native_functions 1/1 2025-09-07T06:45:02.4840702Z test_native_mha 1/1 2025-09-07T06:45:02.4840848Z test_nestedtensor 1/2 2025-09-07T06:45:02.4840994Z test_ops 3/4 2025-09-07T06:45:02.4841122Z test_quantization 2/5 2025-09-07T06:45:02.4841265Z test_sparse_csr 2/2 2025-09-07T06:45:02.4841403Z xpu/test_fusion 1/1 2025-09-07T06:45:02.4842913Z Parallel tests (0): 2025-09-07T06:45:02.4843147Z Name: excluded (est. time: 0.0min) 2025-09-07T06:45:02.4843306Z Serial tests (0): 2025-09-07T06:45:02.4843439Z Parallel tests (0): 2025-09-07T06:45:02.4843644Z Running inductor/test_aot_inductor 3/3 ... [2025-09-07 06:45:02.478805] 2025-09-07T06:45:02.4843885Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:45:02.4844459Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_aot_inductor.py', '--shard-id=3', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:45:02.479077] 2025-09-07T06:54:34.7720120Z 2025-09-07T06:54:34.7727010Z inductor/test_aot_inductor 3/3 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_aot_inductor_3.3_84dd9c994926757b_.log 2025-09-07T06:54:34.7770465Z Running 288 items in this shard: test/inductor/test_aot_inductor.py::TestAOTInductorConfig::test_compile_standalone_explicit_set, test/inductor/test_aot_inductor.py::TestAOTInductorConfig::test_compile_standalone_package_cpp_false_raises, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test__int_mm_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test__weight_int4pack_mm_m_32_n_64_q_group_32_num_groups_2_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test__weight_int4pack_mm_m_32_n_64_q_group_64_num_groups_1_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test__weight_int4pack_mm_m_32_n_64_q_group_64_num_groups_2_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test__weight_int4pack_mm_with_scales_and_zeros_m_32_n_64_q_group_32_num_groups_2_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_addmm_multiple_dynamic_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_amp_fallback_random_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_aoti_constant_tensor_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_aoti_debug_printing_model_inputs_codegen_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_aoti_profiler_enable_kernel_profile_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_aoti_profiler_enable_kernel_profile_True_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_aoti_runtime_asserts_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_assert_tensor_meta_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_autotune_with_constant_folding_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_autotuning_args_reuse_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_bool_input_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_buffer_mutation_2_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_buffer_mutation_4_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_buffer_mutation_and_force_mmap_weights_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_buffer_reuse_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_composed_dynamic_size_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_cond_mismatched_branch_output_dynamic_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_cond_share_predicte_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_cond_unbacked_symint_closure_dynamic_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_cond_with_outer_code_before_after_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_cond_with_parameters_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_constant_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_constant_folding_with_update_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_conv_freezing_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_convolution_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_copy_non_blocking_is_pinned_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_deconv_freezing_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dup_unbacked_sym_decl_with_refinement_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_duplicate_constant_folding_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_embedding_bag_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_empty_cat_dtype_promotion_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_empty_graph_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_extract_constants_map_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_fallback_kernel_with_symexpr_output_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_fallback_mem_leak_fix_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_index_put_fallback_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_index_put_with_none_index_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_load_package_multiple_gpus_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_misc_1_max_autotune_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_multiple_output_alias_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_narrow_fallback_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_non_contiguous_output_alias_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_non_tensor_input_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_on_gpu_device1_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_output_misaligned_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_pad_fallback_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_quantized_linear_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_repeated_user_defined_triton_kernel_embed_kernel_binary_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_replicate_on_devices_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_rocm_triton_autotuning_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_run_with_grad_enabled_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_runtime_checks_device_type_failed_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_runtime_checks_dtype_failed_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_runtime_checks_large_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_runtime_checks_shape_failed_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_scatter_reduce_fallback_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_seq_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_shifted_constraint_ranges_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_simple_embed_kernel_binary_False_max_autotune_True_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_size_with_unbacked_add_and_mul_expr_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_so_without_weight_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_stride_with_unbacked_expr_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_sym_expr_indexing_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_sympy_cpp_printer_min_max_minmax1_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_torchvision_transforms_functional_tensor_resize_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_dynamic_launcher_grid_infer_from_tensor_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_bool_param_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_dynamic_grid_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_dynamic_shape_with_div_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_equal_to_1_arg_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_extern_kernel_arg_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_grid_type_1_num_dims_1_dynamic_False_autotune_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_grid_type_1_num_dims_2_dynamic_True_autotune_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_grid_type_2_num_dims_2_dynamic_False_autotune_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_grid_type_3_num_dims_2_dynamic_False_autotune_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_multi_output_arg_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_on_device_tma_dynamic_True_tma_version_old_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_reinterpret_view_mem_leak_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_tma_descriptor_1d_dynamic_False_tma_version_new_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_tma_descriptor_2d_dynamic_True_tma_version_old_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_weird_param_order_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_triton_kernel_with_none_inputs_and_equal_to_1_arg_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_unbacked_equals_input_size_runtime_assertion_mark_unbacked_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_update_inactive_constant_buffer_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_view_outputs_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_while_loop_with_conv_dynamic_True_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_while_loop_with_mixed_device_dynamic_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_while_loop_with_mixed_device_dynamic_True_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_while_loop_with_parameters_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_while_loop_with_unbacked_symint_closure_dynamic_False_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_with_no_triton_profiler_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_with_offset_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_with_profiler_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_zero_grid_with_backed_symbols_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_zero_size_buffer_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_zero_size_weight_cpu, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__int_mm_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__weight_int4pack_mm_m_32_n_64_q_group_32_num_groups_2_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__weight_int4pack_mm_m_32_n_64_q_group_64_num_groups_1_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__weight_int4pack_mm_with_scales_and_zeros_m_32_n_64_q_group_32_num_groups_1_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__weight_int4pack_mm_with_scales_and_zeros_m_32_n_64_q_group_32_num_groups_2_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test__weight_int4pack_mm_with_scales_and_zeros_m_32_n_64_q_group_64_num_groups_1_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_addmm_multiple_dynamic_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_aliased_buffer_reuse_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_aoti_constant_tensor_name_collision_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_aoti_debug_printer_cpp_kernel_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_aoti_debug_printer_sym_inputs_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_aoti_debug_printing_model_inputs_codegen_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_aoti_profiler_enable_kernel_profile_False_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_aoti_profiler_enable_kernel_profile_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_assert_tensor_meta_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_autotune_int64_user_defined_triton_kernel_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_autotuning_args_reuse_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_backward_no_op_logging_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_buffer_mutation_1_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_buffer_mutation_4_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_buffer_mutation_and_force_mmap_weights_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_buffer_reuse_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_cond_share_predicte_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_cond_with_outer_code_before_after_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_cond_with_parameters_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_conv3d_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_copy_non_blocking_is_pinned_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_deconv_freezing_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_duplicate_constant_folding_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_dynamic_cat_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_extract_constants_map_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_fake_tensor_device_validation_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_foreach_multiple_dynamic_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_fp8_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_index_put_fallback_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_inf_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_input_codegen_with_sympy_expr_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_load_package_multiple_gpus_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_masked_select_dynamic_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_misaligned_input_1_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_misaligned_input_2_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_misc_1_max_autotune_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_multi_device_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_multiple_output_alias_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_nested_tensor_from_jagged_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_non_tensor_input_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_none_args_aot_codegen_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_normal_functional_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_output_path_2_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_pad_fallback_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_pad_non_zero_memory_leak_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_proxy_executor_squeeze_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_quantized_linear_bias_none_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_repeated_calling_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_repeated_user_defined_triton_kernel_embed_kernel_binary_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_return_view_constant_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_reuse_kernel_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_rocm_triton_autotuning_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_run_with_grad_enabled_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_runtime_checks_device_type_failed_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_scatter_fallback_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_seq_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_simple_embed_kernel_binary_False_max_autotune_False_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_simple_embed_kernel_binary_False_max_autotune_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_simple_embed_kernel_binary_True_max_autotune_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_simple_split_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_size_with_unbacked_add_expr_transitive_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_sym_expr_indexing_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_symbool_item_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_torchvision_transforms_functional_tensor_resize_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_dynamic_shape_with_div_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_equal_to_1_float_arg_dynamic_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_grid_type_1_num_dims_1_dynamic_False_autotune_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_grid_type_2_num_dims_1_dynamic_False_autotune_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_grid_type_3_num_dims_1_dynamic_True_autotune_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_grid_type_3_num_dims_2_dynamic_False_autotune_False_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_grid_type_3_num_dims_2_dynamic_False_autotune_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_multi_output_arg_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_on_device_tma_dynamic_False_tma_version_new_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_reinterpret_view_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_sympy_fn_like_arg_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_unbacked_symint_in_grid_dynamic_False_autotuning_False_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_unbacked_symint_in_grid_dynamic_False_autotuning_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_with_none_input_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_kernel_with_none_inputs_and_equal_to_1_arg_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_triton_next_power_of_2_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_unbacked_equals_input_size_runtime_assertion_mark_unbacked_False_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_update_inactive_constant_buffer_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_upper_bound_i64_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_view_outputs_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_weight_on_disk_legacy_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_while_loop_with_mixed_device_dynamic_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_while_loop_with_outer_buffers_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_while_loop_with_parameters_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_while_loop_with_sym_expr_cond_dynamic_True_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_with_cudagraphs_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_with_profiler_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleGpu::test_zero_size_buffer_cuda, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test__int_mm_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test__weight_int4pack_mm_m_32_n_64_q_group_32_num_groups_1_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test__weight_int4pack_mm_with_scales_and_zeros_m_32_n_64_q_group_64_num_groups_2_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_addmm_multiple_dynamic_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_aoti_constant_tensor_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_aoti_debug_printing_model_inputs_codegen_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_aoti_runtime_asserts_backed_symint_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_aoti_runtime_asserts_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_assert_async_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_assert_tensor_meta_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_backward_no_op_logging_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_buffer_mutation_1_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_buffer_mutation_3_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_clamp_decomposition_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_cond_non_tensor_predicates_dynamic_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_cond_unbacked_symint_closure_dynamic_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_cond_unbacked_symint_closure_dynamic_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_cond_use_buffers_from_outer_scope_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_cond_with_parameters_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_cond_with_reinterpret_view_inputs_outputs_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_copy_non_blocking_is_pinned_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_d2h_copy_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_deconv_freezing_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_dup_unbacked_sym_decl_with_refinement_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_dynamic_cat_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_fft_c2c_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_fp8_view_of_param_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_fx_gm_return_tuple_validation_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_index_put_fallback_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_index_put_with_none_index_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_input_codegen_with_sympy_expr_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_large_dynamic_dim_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_large_mmaped_weights_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_linear_freezing_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_misc_1_max_autotune_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_multi_device_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_no_args_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_normal_functional_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_output_path_2_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_poi_multiple_dynamic_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_proxy_executor_abs_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_proxy_executor_squeeze_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_quanatized_int8_linear_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_repeat_interleave_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_repeat_output_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_repeated_calling_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_rocm_triton_autotuning_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_runtime_checks_device_type_failed_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_runtime_checks_shape_failed_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_sdpa_2_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_shifted_constraint_ranges_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_simple_embed_kernel_binary_False_max_autotune_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_simple_embed_kernel_binary_True_max_autotune_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_size_from_multi_output_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_size_with_unbacked_add_and_mul_expr_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_stft_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_subclasses_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_symbool_item_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_symfloat_item_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_symint_item_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_sympy_cpp_printer_min_max_minmax0_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_torchvision_transforms_functional_tensor_resize_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_bool_param_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_dynamic_shape_with_div_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_equal_to_1_arg_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_grid_type_1_num_dims_1_dynamic_False_autotune_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_grid_type_1_num_dims_1_dynamic_True_autotune_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_grid_type_3_num_dims_1_dynamic_False_autotune_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_grid_type_3_num_dims_1_dynamic_True_autotune_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_grid_type_3_num_dims_2_dynamic_False_autotune_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_grid_type_3_num_dims_2_dynamic_True_autotune_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_grid_type_3_num_dims_2_dynamic_True_autotune_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_on_device_tma_dynamic_True_tma_version_new_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_sympy_expr_arg_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_tma_descriptor_1d_dynamic_False_tma_version_new_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_tma_descriptor_1d_dynamic_False_tma_version_old_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_tma_descriptor_1d_dynamic_True_tma_version_old_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_tma_descriptor_2d_dynamic_False_tma_version_old_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_tma_descriptor_2d_dynamic_True_tma_version_new_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_unbacked_symint_in_grid_dynamic_True_autotuning_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_triton_kernel_weird_param_order_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_update_constant_buffer_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_while_loop_with_sym_expr_cond_dynamic_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_while_loop_with_unbacked_symint_closure_dynamic_False_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_while_loop_with_unbacked_symint_closure_dynamic_True_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_zero_size_buffer_mps, test/inductor/test_aot_inductor.py::AOTInductorTestABICompatibleMps::test_zero_size_weight_mps 2025-09-07T06:54:34.7813042Z 2025-09-07T06:54:34.7813217Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T06:54:34.7813402Z Uploading artifacts took 0.00 seconds 2025-09-07T06:54:34.7813553Z Running dynamo/test_exc 1/1 ... [2025-09-07 06:54:34.772376] 2025-09-07T06:54:34.7813703Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:54:34.7814072Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_exc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:54:34.772588] 2025-09-07T06:54:38.5937743Z 2025-09-07T06:54:38.5938579Z dynamo/test_exc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_exc_1.1_fe4725f4c12f209f_.log 2025-09-07T06:54:38.5939709Z Running 10 items in this shard: test/dynamo/test_exc.py::ExcTests::test_backend_suppress_line, test/dynamo/test_exc.py::ExcTests::test_graph_break_log, test/dynamo/test_exc.py::ExcTests::test_graph_break_log_generic_jump, test/dynamo/test_exc.py::ExcTests::test_internal_error_no_suppress, test/dynamo/test_exc.py::ExcTests::test_internal_error_suppress_errors, test/dynamo/test_exc.py::ExcTests::test_not_implemented_error, test/dynamo/test_exc.py::ExcTests::test_trigger_bisect_on_error, test/dynamo/test_exc.py::ExcTests::test_trigger_on_error, test/dynamo/test_exc.py::ExcTests::test_unsupported_error, test/dynamo/test_exc.py::ExcTests::test_unsupported_real_stack 2025-09-07T06:54:38.5940595Z 2025-09-07T06:54:38.5940703Z Running dynamo/test_exceptions 1/1 ... [2025-09-07 06:54:38.593605] 2025-09-07T06:54:38.5946668Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:54:38.5947304Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_exceptions.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:54:38.593806] 2025-09-07T06:54:48.1749388Z 2025-09-07T06:54:48.1750668Z dynamo/test_exceptions 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_exceptions_1.1_39eaf2ea672aadd0_.log 2025-09-07T06:54:48.1762159Z Running 48 items in this shard: test/dynamo/test_exceptions.py::ExceptionTests::test_atrribute_error, test/dynamo/test_exceptions.py::ExceptionTests::test_attribute_error_from_getattr, test/dynamo/test_exceptions.py::ExceptionTests::test_autocast_with_exception, test/dynamo/test_exceptions.py::ExceptionTests::test_block_stack_cleanup, test/dynamo/test_exceptions.py::ExceptionTests::test_custom_getattr_on_module_exception, test/dynamo/test_exceptions.py::ExceptionTests::test_dict_pop, test/dynamo/test_exceptions.py::ExceptionTests::test_dynamo_undo_kw_names, test/dynamo/test_exceptions.py::ExceptionTests::test_ensure_exception_is_active_after_try_except_block, test/dynamo/test_exceptions.py::ExceptionTests::test_ensure_exception_is_active_inside_try_except_block, test/dynamo/test_exceptions.py::ExceptionTests::test_exception, test/dynamo/test_exceptions.py::ExceptionTests::test_exception2, test/dynamo/test_exceptions.py::ExceptionTests::test_exception3, test/dynamo/test_exceptions.py::ExceptionTests::test_exception4, test/dynamo/test_exceptions.py::ExceptionTests::test_exception_else, test/dynamo/test_exceptions.py::ExceptionTests::test_exception_raised_from_child, test/dynamo/test_exceptions.py::ExceptionTests::test_exception_with_another_exception, test/dynamo/test_exceptions.py::ExceptionTests::test_exception_with_another_exception2, test/dynamo/test_exceptions.py::ExceptionTests::test_exception_with_ctx_manager, test/dynamo/test_exceptions.py::ExceptionTests::test_exception_with_vars, test/dynamo/test_exceptions.py::ExceptionTests::test_handle_all_exceptions, test/dynamo/test_exceptions.py::ExceptionTests::test_isinstance_CustomException, test/dynamo/test_exceptions.py::ExceptionTests::test_key_error, test/dynamo/test_exceptions.py::ExceptionTests::test_nn_module_getattr, test/dynamo/test_exceptions.py::ExceptionTests::test_nn_reraise, test/dynamo/test_exceptions.py::ExceptionTests::test_propagate_exception_inside_ctx_manager, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_GeneratorExit, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_custom_exception, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_custom_exception_with_args, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_finally_simple, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_from_None, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_from_None_2, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_from_other, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_match, test/dynamo/test_exceptions.py::ExceptionTests::test_raise_set___context__, test/dynamo/test_exceptions.py::ExceptionTests::test_reconstruct___context__, test/dynamo/test_exceptions.py::ExceptionTests::test_reconstruct_exception_2, test/dynamo/test_exceptions.py::ExceptionTests::test_reraise, test/dynamo/test_exceptions.py::ExceptionTests::test_reraise_first_exc, test/dynamo/test_exceptions.py::ExceptionTests::test_set___cause___CustomException, test/dynamo/test_exceptions.py::ExceptionTests::test_set___cause___TypeError, test/dynamo/test_exceptions.py::ExceptionTests::test_set___cause___error_CustomException, test/dynamo/test_exceptions.py::ExceptionTests::test_set___cause___error_RuntimeError, test/dynamo/test_exceptions.py::ExceptionTests::test_set_cause_with_arg, test/dynamo/test_exceptions.py::ExceptionTests::test_set_cause_with_arg_error, test/dynamo/test_exceptions.py::ExceptionTests::test_speculation_exception, test/dynamo/test_exceptions.py::ExceptionTests::test_stop_iteration, test/dynamo/test_exceptions.py::ExceptionTests::test_user_defined_exception_variable, test/dynamo/test_exceptions.py::ExceptionTests::test_user_defined_exception_with_args 2025-09-07T06:54:48.1775948Z 2025-09-07T06:54:48.1776052Z Running dynamo/test_export 1/1 ... [2025-09-07 06:54:48.174715] 2025-09-07T06:54:48.1776230Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:54:48.1776633Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_export.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:54:48.174948] 2025-09-07T06:55:53.0477141Z 2025-09-07T06:55:53.0479018Z dynamo/test_export 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_export_1.1_5e9f2cecf47b4721_.log 2025-09-07T06:55:53.0501255Z Running 187 items in this shard: test/dynamo/test_export.py::ExportTests::test_access_class_method_from_user_class_attr, test/dynamo/test_export.py::ExportTests::test_access_class_method_from_user_class_builtin, test/dynamo/test_export.py::ExportTests::test_byte_tensor_does_not_crash, test/dynamo/test_export.py::ExportTests::test_capture_symbolic_tracing_simple_within_fake_mode, test/dynamo/test_export.py::ExportTests::test_capture_symbolic_tracing_within_fake_mode, test/dynamo/test_export.py::ExportTests::test_cond_free_variables_overlapping, test/dynamo/test_export.py::ExportTests::test_cond_op_param_buffer_lifted, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_branch_args_mismatch, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_branch_return_multiple_tensors, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_branch_return_non_tensor, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_mismatch_return_length, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_mismatch_return_tensor_meta, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_missing_args, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_non_list_operands, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_non_tensor_operands, test/dynamo/test_export.py::ExportTests::test_cond_raise_user_error_on_unsupported_pred, test/dynamo/test_export.py::ExportTests::test_cond_supported_pred_types, test/dynamo/test_export.py::ExportTests::test_constraint_violation_error_messages, test/dynamo/test_export.py::ExportTests::test_dataclass_input_output, test/dynamo/test_export.py::ExportTests::test_dict_return, test/dynamo/test_export.py::ExportTests::test_dict_return_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_dupes, test/dynamo/test_export.py::ExportTests::test_dupes_2, test/dynamo/test_export.py::ExportTests::test_dupes_2_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass_reorder_with_non_tensor_arg, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass_reorder_with_non_tensor_arg_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass_with_non_tensor_arg, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass_with_non_tensor_arg_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass_with_non_tensor_output, test/dynamo/test_export.py::ExportTests::test_dupes_and_bypass_with_non_tensor_output_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_dupes_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_dynamic_slicing, test/dynamo/test_export.py::ExportTests::test_dynamic_slicing_invalid, test/dynamo/test_export.py::ExportTests::test_dynamic_slicing_simple, test/dynamo/test_export.py::ExportTests::test_dynamo_enum_in_tuple, test/dynamo/test_export.py::ExportTests::test_dynamo_list_index, test/dynamo/test_export.py::ExportTests::test_empty, test/dynamo/test_export.py::ExportTests::test_enforce_equalities, test/dynamo/test_export.py::ExportTests::test_export, test/dynamo/test_export.py::ExportTests::test_export_compare_optimize_with_make_fx, test/dynamo/test_export.py::ExportTests::test_export_cond_in_aten_symbolic, test/dynamo/test_export.py::ExportTests::test_export_control_flow_with_getattr, test/dynamo/test_export.py::ExportTests::test_export_decomp, test/dynamo/test_export.py::ExportTests::test_export_decomp_asserts_bad_args, test/dynamo/test_export.py::ExportTests::test_export_defaults_ok, test/dynamo/test_export.py::ExportTests::test_export_dynamic_control_flow_error, test/dynamo/test_export.py::ExportTests::test_export_dynamic_dim_cleanup, test/dynamo/test_export.py::ExportTests::test_export_dynamic_dim_not_1, test/dynamo/test_export.py::ExportTests::test_export_dynamic_dim_range_constraint, test/dynamo/test_export.py::ExportTests::test_export_graph_bypass, test/dynamo/test_export.py::ExportTests::test_export_graph_bypass_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_export_graph_with_complex_reorder, test/dynamo/test_export.py::ExportTests::test_export_graph_with_complex_reorder_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_export_graph_with_list, test/dynamo/test_export.py::ExportTests::test_export_graph_with_list_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_export_identity, test/dynamo/test_export.py::ExportTests::test_export_masking_with_no_grad, test/dynamo/test_export.py::ExportTests::test_export_meta, test/dynamo/test_export.py::ExportTests::test_export_meta_val, test/dynamo/test_export.py::ExportTests::test_export_mismatched_out, test/dynamo/test_export.py::ExportTests::test_export_mismatched_out_2, test/dynamo/test_export.py::ExportTests::test_export_mismatched_out_2_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_export_mismatched_out_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_export_module_specify_constraints_signature, test/dynamo/test_export.py::ExportTests::test_export_multi_dynamic_dim_constraint, test/dynamo/test_export.py::ExportTests::test_export_multi_dynamic_dim_unsafe_relationship, test/dynamo/test_export.py::ExportTests::test_export_nn_module_stack_patched_module, test/dynamo/test_export.py::ExportTests::test_export_no_raise, test/dynamo/test_export.py::ExportTests::test_export_no_tensor_computation_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_export_pass_arg_by_name, test/dynamo/test_export.py::ExportTests::test_export_pass_arg_by_name_star_args, test/dynamo/test_export.py::ExportTests::test_export_persist_assert, test/dynamo/test_export.py::ExportTests::test_export_preserve_constraints_as_metadata_tensor, test/dynamo/test_export.py::ExportTests::test_export_preserves_nn_module_stack_for_get_attr, test/dynamo/test_export.py::ExportTests::test_export_raise_guard_full_constraint, test/dynamo/test_export.py::ExportTests::test_export_raise_guard_partial_constraint, test/dynamo/test_export.py::ExportTests::test_export_raise_on_relationship, test/dynamo/test_export.py::ExportTests::test_export_shape_control_flow_1, test/dynamo/test_export.py::ExportTests::test_export_specialized_int, test/dynamo/test_export.py::ExportTests::test_export_symbolic_shape, test/dynamo/test_export.py::ExportTests::test_export_with_args_and_empty_kwargs, test/dynamo/test_export.py::ExportTests::test_export_with_args_with_default_None, test/dynamo/test_export.py::ExportTests::test_export_with_args_with_default_float, test/dynamo/test_export.py::ExportTests::test_export_with_args_with_default_tensor, test/dynamo/test_export.py::ExportTests::test_export_with_args_with_default_tuple, test/dynamo/test_export.py::ExportTests::test_export_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_export_with_builtin_op_on_assume_constant, test/dynamo/test_export.py::ExportTests::test_export_with_cond_branches_calling_methods, test/dynamo/test_export.py::ExportTests::test_export_with_cond_closure, test/dynamo/test_export.py::ExportTests::test_export_with_cond_dynamic_shape_pred, test/dynamo/test_export.py::ExportTests::test_export_with_cond_with_closed_function, test/dynamo/test_export.py::ExportTests::test_export_with_constant_dict_values, test/dynamo/test_export.py::ExportTests::test_export_with_constant_free_function, test/dynamo/test_export.py::ExportTests::test_export_with_constant_free_function_and_class_method, test/dynamo/test_export.py::ExportTests::test_export_with_constant_free_function_and_class_method_multiarg, test/dynamo/test_export.py::ExportTests::test_export_with_constant_free_function_and_class_method_multiarg_diff, test/dynamo/test_export.py::ExportTests::test_export_with_constant_global_function, test/dynamo/test_export.py::ExportTests::test_export_with_constant_in_unspecialized_nn_module, test/dynamo/test_export.py::ExportTests::test_export_with_constant_list_nonzero, test/dynamo/test_export.py::ExportTests::test_export_with_constant_list_nonzero_free_function, test/dynamo/test_export.py::ExportTests::test_export_with_constant_method_on_module, test/dynamo/test_export.py::ExportTests::test_export_with_constant_method_on_module_invoke_twice, test/dynamo/test_export.py::ExportTests::test_export_with_constant_none_control_flow, test/dynamo/test_export.py::ExportTests::test_export_with_constant_none_control_flow_free_func, test/dynamo/test_export.py::ExportTests::test_export_with_constant_not_none_control_flow, test/dynamo/test_export.py::ExportTests::test_export_with_constant_not_none_control_flow_free_func, test/dynamo/test_export.py::ExportTests::test_export_with_constant_not_none_control_flow_pos, test/dynamo/test_export.py::ExportTests::test_export_with_constant_not_return_const, test/dynamo/test_export.py::ExportTests::test_export_with_constant_tuple_nonzero, test/dynamo/test_export.py::ExportTests::test_export_with_functools_wrapped_fn, test/dynamo/test_export.py::ExportTests::test_export_with_functools_wrapped_method, test/dynamo/test_export.py::ExportTests::test_export_with_kwargs, test/dynamo/test_export.py::ExportTests::test_export_with_kwargs_and_empty_args, test/dynamo/test_export.py::ExportTests::test_export_with_kwargs_with_default_None, test/dynamo/test_export.py::ExportTests::test_export_with_kwargs_with_default_float, test/dynamo/test_export.py::ExportTests::test_export_with_kwargs_with_default_tensor, test/dynamo/test_export.py::ExportTests::test_export_with_kwargs_with_default_tuple, test/dynamo/test_export.py::ExportTests::test_export_with_map_cond, test/dynamo/test_export.py::ExportTests::test_export_with_map_zero_sized_tensor, test/dynamo/test_export.py::ExportTests::test_export_with_map_zero_sized_tensor_suppress_errors, test/dynamo/test_export.py::ExportTests::test_export_with_module_layer, test/dynamo/test_export.py::ExportTests::test_export_with_nonzero_static, test/dynamo/test_export.py::ExportTests::test_export_with_shallow_list_copy_with_side_effects, test/dynamo/test_export.py::ExportTests::test_export_with_shallow_list_copy_wo_side_effects, test/dynamo/test_export.py::ExportTests::test_export_with_stack_trace, test/dynamo/test_export.py::ExportTests::test_export_with_symbool_inputs, test/dynamo/test_export.py::ExportTests::test_export_with_wrapped_fn, test/dynamo/test_export.py::ExportTests::test_exported_graph_serialization, test/dynamo/test_export.py::ExportTests::test_func_return, test/dynamo/test_export.py::ExportTests::test_func_return_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_fx_pytree, test/dynamo/test_export.py::ExportTests::test_immutable_list_dict, test/dynamo/test_export.py::ExportTests::test_input_container_type, test/dynamo/test_export.py::ExportTests::test_invalid_input_global, test/dynamo/test_export.py::ExportTests::test_invalid_input_global_multiple_access, test/dynamo/test_export.py::ExportTests::test_invalid_input_nonlocal, test/dynamo/test_export.py::ExportTests::test_invalid_input_unused_nonlocal_ok, test/dynamo/test_export.py::ExportTests::test_list_contains, test/dynamo/test_export.py::ExportTests::test_list_not_contains, test/dynamo/test_export.py::ExportTests::test_list_unpack, test/dynamo/test_export.py::ExportTests::test_list_unpack_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_map_cond_param_buffer_lifted, test/dynamo/test_export.py::ExportTests::test_mixed_real_and_fake_inputs, test/dynamo/test_export.py::ExportTests::test_multiple_outputs_op_with_evaluator, test/dynamo/test_export.py::ExportTests::test_nested_cond_op_param_buffer_lifted, test/dynamo/test_export.py::ExportTests::test_no_tensor_computation, test/dynamo/test_export.py::ExportTests::test_no_tensor_computation_2, test/dynamo/test_export.py::ExportTests::test_no_tensor_computation_2_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_no_tensor_computation_fail, test/dynamo/test_export.py::ExportTests::test_not_functionalize, test/dynamo/test_export.py::ExportTests::test_param_buffer_safe_from_mutation_recurse, test/dynamo/test_export.py::ExportTests::test_param_buffer_safe_from_mutation_simple, test/dynamo/test_export.py::ExportTests::test_pre_dispatch_simple, test/dynamo/test_export.py::ExportTests::test_predispatch_with_for_out_dtype, test/dynamo/test_export.py::ExportTests::test_predispatch_with_for_out_dtype_nested, test/dynamo/test_export.py::ExportTests::test_predispatch_with_higher_order, test/dynamo/test_export.py::ExportTests::test_predispatch_with_higher_order_nested, test/dynamo/test_export.py::ExportTests::test_preserve_fx_node_metadata, test/dynamo/test_export.py::ExportTests::test_preserve_fx_node_metadata_graph_break, test/dynamo/test_export.py::ExportTests::test_preserve_fx_node_metadata_inline, test/dynamo/test_export.py::ExportTests::test_preserve_fx_node_metadata_recompile, test/dynamo/test_export.py::ExportTests::test_remove_redundant_dynamic_dim_in_error_message, test/dynamo/test_export.py::ExportTests::test_retracibility, test/dynamo/test_export.py::ExportTests::test_retracibility_dict_container_inp_out, test/dynamo/test_export.py::ExportTests::test_retracibility_nested_list_out, test/dynamo/test_export.py::ExportTests::test_round_dynamic_shapes, test/dynamo/test_export.py::ExportTests::test_strict_fake_tensor_prop_real_tensors, test/dynamo/test_export.py::ExportTests::test_subclass_parameters, test/dynamo/test_export.py::ExportTests::test_sum_param, test/dynamo/test_export.py::ExportTests::test_sym_contains, test/dynamo/test_export.py::ExportTests::test_symbolic_tracing_within_fake_mode_with_constraints, test/dynamo/test_export.py::ExportTests::test_symbolic_tracing_within_fake_mode_with_constraints_with_parameters, test/dynamo/test_export.py::ExportTests::test_symbool, test/dynamo/test_export.py::ExportTests::test_torch_inference_mode_ctx, test/dynamo/test_export.py::ExportTests::test_trivial_constraint, test/dynamo/test_export.py::ExportTests::test_uncaptured_higher_order_op_error_not_suppresed, test/dynamo/test_export.py::ExportTests::test_untracked_inputs_in_constraints, test/dynamo/test_export.py::ExportTests::test_zeroes_in_and_out_different_shape_on_test, test/dynamo/test_export.py::ExportTests::test_zeroes_in_and_out_different_shape_on_test_with_aten_graph, test/dynamo/test_export.py::ExportTests::test_zeroes_in_new_shape_scalar_out, test/dynamo/test_export.py::ExportTests::test_zeroes_in_new_shape_scalar_out_permute, test/dynamo/test_export.py::ExportTests::test_zeroes_in_new_shape_scalar_out_permute_dupe_and_bypass, test/dynamo/test_export.py::ExportTestsDeviceCUDA::test_export_fast_binary_broadcast_check_cuda, test/dynamo/test_export.py::ExportTestsDeviceCUDA::test_export_fast_binary_broadcast_check_unbacked_cuda, test/dynamo/test_export.py::ExportTestsDeviceCUDA::test_export_with_parameters_cuda 2025-09-07T06:55:53.0520255Z 2025-09-07T06:55:53.0525617Z Running dynamo/test_fx_passes_pre_grad 1/1 ... [2025-09-07 06:55:53.047795] 2025-09-07T06:55:53.0525804Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:55:53.0526196Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_fx_passes_pre_grad.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:55:53.048010] 2025-09-07T06:55:58.4719462Z 2025-09-07T06:55:58.4720731Z dynamo/test_fx_passes_pre_grad 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_fx_passes_pre_grad_1.1_5c53e0d01a6cf50f_.log 2025-09-07T06:55:58.4721953Z Running 1 items in this shard: test/dynamo/test_fx_passes_pre_grad.py::FxPassesPreGradTests::test_pass_execution_and_save 2025-09-07T06:55:58.4722449Z 2025-09-07T06:55:58.4722699Z Running dynamo/test_graph_deduplication 1/1 ... [2025-09-07 06:55:58.471633] 2025-09-07T06:55:58.4723448Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:55:58.4724545Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_graph_deduplication.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:55:58.471839] 2025-09-07T06:56:06.5535869Z 2025-09-07T06:56:06.5537843Z dynamo/test_graph_deduplication 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_graph_deduplication_1.1_24bad3c8dacf47ac_.log 2025-09-07T06:56:06.5542144Z Running 18 items in this shard: test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_autocast_ordering, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_cycle_detection_arg_and_additional_deps, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_cycle_detection_complex, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_cycle_detection_no_cycle, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_cycle_detection_simple, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_cycle_detection_single_node, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_cycle_detection_two_node, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_dependent_subgraphs, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_input_aliasing, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_input_mutation, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_multiple_subgraphs, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_mutation_ordering, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_output_nodes_last, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_param_transfer_to_submodule, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_single_subgraph, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_single_subgraph2, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_tuple_inputs, test/dynamo/test_graph_deduplication.py::GraphDededuplicationTests::test_tuple_return 2025-09-07T06:56:06.5545176Z 2025-09-07T06:56:06.5545287Z Running dynamo/test_guard_serialization 1/1 ... [2025-09-07 06:56:06.553399] 2025-09-07T06:56:06.5545493Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:56:06.5545941Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_guard_serialization.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:56:06.553612] 2025-09-07T06:56:15.1351534Z 2025-09-07T06:56:15.1352875Z dynamo/test_guard_serialization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_guard_serialization_1.1_6c68801f4aec72f9_.log 2025-09-07T06:56:15.1365571Z Running 38 items in this shard: test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_bool_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_builtin_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_closure_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_constant_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_default_device, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_deterministic_algorithms, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_dict_contains, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_dict_keys_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_dict_version, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_dispatch_key_set_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_dual_level, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_duplicate_input, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_empty_nn_module_hooks_dict, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_equals_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_fsdp_training_state, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_function_locals, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_function_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_functorch_stack_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_grad_mode, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_grad_mode_loading, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_hasattr_serialization, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_id_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_id_match_with_config, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_mapping_keys_check, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_name_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_nn_module, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_none_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_not_present_in_generic_dict, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_range_iterator_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_sequence_length, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_shape_env, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_skipped_objects, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_tensor_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_tensor_subclass_metadata_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_torch_function_state, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_tuple_iterator_len, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_type_match, test/dynamo/test_guard_serialization.py::TestGuardSerialization::test_weakref_alive 2025-09-07T06:56:15.1373856Z 2025-09-07T06:56:15.1373969Z Running dynamo/test_hooks 1/1 ... [2025-09-07 06:56:15.135120] 2025-09-07T06:56:15.1374197Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:56:15.1374724Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_hooks.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:56:15.135375] 2025-09-07T06:56:31.4792065Z 2025-09-07T06:56:31.4794114Z dynamo/test_hooks 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_hooks_1.1_1c42ca3338ccf75f_.log 2025-09-07T06:56:31.4801255Z Running 34 items in this shard: test/dynamo/test_hooks.py::HooksTests::test_complex_state_mutation_in_intermediary_hooks_same_on_inductor, test/dynamo/test_hooks.py::HooksTests::test_complex_state_mutation_in_intermediary_hooks_same_on_inductor_with_graph_break, test/dynamo/test_hooks.py::HooksTests::test_functools_arg_vary, test/dynamo/test_hooks.py::HooksTests::test_global_module_forward_pre_hook, test/dynamo/test_hooks.py::HooksTests::test_hook_with_closure, test/dynamo/test_hooks.py::HooksTests::test_hook_with_nested_closure, test/dynamo/test_hooks.py::HooksTests::test_input_hooks_same, test/dynamo/test_hooks.py::HooksTests::test_intermediary_hooks, test/dynamo/test_hooks.py::HooksTests::test_intermediary_hooks_same_on_aot_eager, test/dynamo/test_hooks.py::HooksTests::test_intermediary_hooks_same_on_inductor, test/dynamo/test_hooks.py::HooksTests::test_intermediate_hook_with_closure_aot, test/dynamo/test_hooks.py::HooksTests::test_intermediate_hook_with_closure_eager, test/dynamo/test_hooks.py::HooksTests::test_nnmodule_hook_guards, test/dynamo/test_hooks.py::HooksTests::test_no_recompile_on_hook_identity_change, test/dynamo/test_hooks.py::HooksTests::test_no_recompile_on_same_hook, test/dynamo/test_hooks.py::HooksTests::test_post_acc_grad_hook, test/dynamo/test_hooks.py::HooksTests::test_recompile, test/dynamo/test_hooks.py::HooksTests::test_register_hook_partial_guarding, test/dynamo/test_hooks.py::HooksTests::test_removed_handle_return, test/dynamo/test_hooks.py::HooksTests::test_tensor_only_register_hook_in_graph_lambda, test/dynamo/test_hooks.py::HooksTests::test_tensor_only_register_hook_in_graph_local, test/dynamo/test_hooks.py::HooksTests::test_tensor_only_register_hook_in_graph_local_inner, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_global_hook, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_global_hooks_handles_in_list, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_hook_in_graph_break_handle_lambda, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_hook_in_graph_break_handle_local, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_hook_in_graph_lambda, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_hook_in_graph_local, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_hook_multi_handle_return, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_hook_repeated_handle_not_local, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_hook_repeated_handle_return, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_multiple_hooks, test/dynamo/test_hooks.py::HooksTests::test_tensor_register_multiple_hooks_handles_in_list, test/dynamo/test_hooks.py::HooksTests::test_wrap_top_frame_with_hooks 2025-09-07T06:56:31.4807748Z 2025-09-07T06:56:31.4807900Z Running dynamo/test_inline_and_install 1/1 ... [2025-09-07 06:56:31.479097] 2025-09-07T06:56:31.4815286Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:56:31.4815943Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_inline_and_install.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:56:31.479336] 2025-09-07T06:57:02.9666268Z 2025-09-07T06:57:02.9668181Z dynamo/test_inline_and_install 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_inline_and_install_1.1_e8afad42b764f2af_.log 2025-09-07T06:57:02.9708072Z Running 184 items in this shard: test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_access_class_method_from_user_class_attr_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_access_class_method_from_user_class_builtin_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_byte_tensor_does_not_crash_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_capture_symbolic_tracing_simple_within_fake_mode_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_capture_symbolic_tracing_within_fake_mode_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_free_variables_overlapping_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_op_param_buffer_lifted_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_branch_args_mismatch_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_branch_return_multiple_tensors_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_branch_return_non_tensor_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_mismatch_return_length_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_mismatch_return_tensor_meta_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_missing_args_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_non_list_operands_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_non_tensor_operands_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_raise_user_error_on_unsupported_pred_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_cond_supported_pred_types_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_constraint_violation_error_messages_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dataclass_input_output_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dict_return_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dict_return_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_2_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_2_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_reorder_with_non_tensor_arg_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_reorder_with_non_tensor_arg_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_with_non_tensor_arg_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_with_non_tensor_arg_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_with_non_tensor_output_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_and_bypass_with_non_tensor_output_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dupes_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dynamic_slicing_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dynamic_slicing_invalid_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dynamic_slicing_simple_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dynamo_enum_in_tuple_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_dynamo_list_index_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_empty_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_enforce_equalities_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_compare_optimize_with_make_fx_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_cond_in_aten_symbolic_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_control_flow_with_getattr_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_decomp_asserts_bad_args_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_decomp_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_defaults_ok_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_dynamic_control_flow_error_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_dynamic_dim_cleanup_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_dynamic_dim_not_1_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_dynamic_dim_range_constraint_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_graph_bypass_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_graph_bypass_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_graph_with_complex_reorder_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_graph_with_complex_reorder_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_graph_with_list_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_graph_with_list_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_identity_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_masking_with_no_grad_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_meta_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_meta_val_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_mismatched_out_2_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_mismatched_out_2_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_mismatched_out_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_mismatched_out_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_module_specify_constraints_signature_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_multi_dynamic_dim_constraint_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_multi_dynamic_dim_unsafe_relationship_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_nn_module_stack_patched_module_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_no_raise_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_no_tensor_computation_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_pass_arg_by_name_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_pass_arg_by_name_star_args_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_persist_assert_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_preserve_constraints_as_metadata_tensor_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_preserves_nn_module_stack_for_get_attr_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_raise_guard_full_constraint_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_raise_guard_partial_constraint_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_raise_on_relationship_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_shape_control_flow_1_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_specialized_int_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_symbolic_shape_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_args_and_empty_kwargs_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_args_with_default_None_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_args_with_default_float_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_args_with_default_tensor_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_args_with_default_tuple_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_builtin_op_on_assume_constant_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_cond_branches_calling_methods_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_cond_closure_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_cond_dynamic_shape_pred_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_cond_with_closed_function_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_dict_values_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_free_function_and_class_method_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_free_function_and_class_method_multiarg_diff_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_free_function_and_class_method_multiarg_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_free_function_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_global_function_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_in_unspecialized_nn_module_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_list_nonzero_free_function_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_list_nonzero_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_method_on_module_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_method_on_module_invoke_twice_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_none_control_flow_free_func_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_none_control_flow_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_not_none_control_flow_free_func_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_not_none_control_flow_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_not_none_control_flow_pos_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_not_return_const_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_constant_tuple_nonzero_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_functools_wrapped_fn_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_functools_wrapped_method_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_kwargs_and_empty_args_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_kwargs_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_kwargs_with_default_None_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_kwargs_with_default_float_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_kwargs_with_default_tensor_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_kwargs_with_default_tuple_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_map_cond_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_map_zero_sized_tensor_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_map_zero_sized_tensor_suppress_errors_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_module_layer_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_nonzero_static_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_shallow_list_copy_with_side_effects_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_shallow_list_copy_wo_side_effects_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_stack_trace_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_symbool_inputs_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_export_with_wrapped_fn_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_exported_graph_serialization_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_func_return_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_func_return_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_fx_pytree_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_immutable_list_dict_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_input_container_type_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_invalid_input_global_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_invalid_input_global_multiple_access_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_invalid_input_nonlocal_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_invalid_input_unused_nonlocal_ok_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_list_contains_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_list_not_contains_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_list_unpack_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_list_unpack_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_map_cond_param_buffer_lifted_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_mixed_real_and_fake_inputs_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_multiple_outputs_op_with_evaluator_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_nested_cond_op_param_buffer_lifted_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_no_tensor_computation_2_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_no_tensor_computation_2_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_no_tensor_computation_fail_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_no_tensor_computation_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_not_functionalize_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_param_buffer_safe_from_mutation_recurse_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_param_buffer_safe_from_mutation_simple_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_pre_dispatch_simple_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_predispatch_with_for_out_dtype_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_predispatch_with_for_out_dtype_nested_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_predispatch_with_higher_order_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_predispatch_with_higher_order_nested_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_preserve_fx_node_metadata_graph_break_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_preserve_fx_node_metadata_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_preserve_fx_node_metadata_inline_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_preserve_fx_node_metadata_recompile_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_remove_redundant_dynamic_dim_in_error_message_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_retracibility_dict_container_inp_out_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_retracibility_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_retracibility_nested_list_out_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_round_dynamic_shapes_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_strict_fake_tensor_prop_real_tensors_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_subclass_parameters_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_sum_param_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_sym_contains_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_symbolic_tracing_within_fake_mode_with_constraints_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_symbolic_tracing_within_fake_mode_with_constraints_with_parameters_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_symbool_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_torch_inference_mode_ctx_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_trivial_constraint_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_uncaptured_higher_order_op_error_not_suppresed_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_untracked_inputs_in_constraints_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_zeroes_in_and_out_different_shape_on_test_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_zeroes_in_and_out_different_shape_on_test_with_aten_graph_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_zeroes_in_new_shape_scalar_out_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_zeroes_in_new_shape_scalar_out_permute_dupe_and_bypass_inline_and_install, test/dynamo/test_inline_and_install.py::InlineAndInstallExportTests::test_zeroes_in_new_shape_scalar_out_permute_inline_and_install 2025-09-07T06:57:02.9744750Z 2025-09-07T06:57:02.9744843Z Running dynamo/test_model_output 1/1 ... [2025-09-07 06:57:02.966741] 2025-09-07T06:57:02.9745021Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:57:02.9745398Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_model_output.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:57:02.966971] 2025-09-07T06:57:05.1862228Z 2025-09-07T06:57:05.1863314Z dynamo/test_model_output 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_model_output_1.1_f27eb415745169fa_.log 2025-09-07T06:57:05.1866483Z Running 18 items in this shard: test/dynamo/test_model_output.py::TestHFPretrained::test_pretrained, test/dynamo/test_model_output.py::TestHFPretrained::test_pretrained_non_const_attr, test/dynamo/test_model_output.py::TestModelOutput::test_mo_assign, test/dynamo/test_model_output.py::TestModelOutput::test_mo_create, test/dynamo/test_model_output.py::TestModelOutput::test_mo_from_outside, test/dynamo/test_model_output.py::TestModelOutput::test_mo_getattr, test/dynamo/test_model_output.py::TestModelOutput::test_mo_getattr_missing, test/dynamo/test_model_output.py::TestModelOutput::test_mo_getitem, test/dynamo/test_model_output.py::TestModelOutput::test_mo_index, test/dynamo/test_model_output.py::TestModelOutput::test_mo_init, test/dynamo/test_model_output.py::TestModelOutput::test_mo_init2, test/dynamo/test_model_output.py::TestModelOutput::test_mo_init_with_disable, test/dynamo/test_model_output.py::TestModelOutput::test_mo_newkey, test/dynamo/test_model_output.py::TestModelOutput::test_mo_reconstruct_bytecode, test/dynamo/test_model_output.py::TestModelOutput::test_mo_tuple, test/dynamo/test_model_output.py::TestModelOutput::test_none, test/dynamo/test_model_output.py::TestModelOutput::test_reconstruction, test/dynamo/test_model_output.py::TestModelOutputBertCUDA::test_HF_bert_model_output_cuda 2025-09-07T06:57:05.1876286Z 2025-09-07T06:57:05.1876420Z Running dynamo/test_modes 1/1 ... [2025-09-07 06:57:05.186026] 2025-09-07T06:57:05.1877230Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:57:05.1877742Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_modes.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:57:05.186267] 2025-09-07T06:57:19.3269051Z 2025-09-07T06:57:19.3270659Z dynamo/test_modes 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_modes_1.1_9cd7b8c75e2660ed_.log 2025-09-07T06:57:19.3279385Z Running 27 items in this shard: test/dynamo/test_modes.py::TorchDispatchModeTests::test_skip_torch_dispatch_modes, test/dynamo/test_modes.py::TorchDispatchModeTests::test_torch_dispatch_ignore_compile_internals, test/dynamo/test_modes.py::TorchFunctionModeTests::test_builtin_equivalent_funcs, test/dynamo/test_modes.py::TorchFunctionModeTests::test_error_empty_stack_pop_torch_function_mode, test/dynamo/test_modes.py::TorchFunctionModeTests::test_expand, test/dynamo/test_modes.py::TorchFunctionModeTests::test_flex_attention, test/dynamo/test_modes.py::TorchFunctionModeTests::test_hop, test/dynamo/test_modes.py::TorchFunctionModeTests::test_hop_eager, test/dynamo/test_modes.py::TorchFunctionModeTests::test_intermedate_torch_function_mode_construction_mutation, test/dynamo/test_modes.py::TorchFunctionModeTests::test_is_torch_function_all_disabled, test/dynamo/test_modes.py::TorchFunctionModeTests::test_len_torch_function_mode, test/dynamo/test_modes.py::TorchFunctionModeTests::test_nested_torch_function_mode, test/dynamo/test_modes.py::TorchFunctionModeTests::test_pop_torch_function_mode, test/dynamo/test_modes.py::TorchFunctionModeTests::test_push_torch_function_mode, test/dynamo/test_modes.py::TorchFunctionModeTests::test_register_hook, test/dynamo/test_modes.py::TorchFunctionModeTests::test_stack_state_clear_default_device, test/dynamo/test_modes.py::TorchFunctionModeTests::test_stack_state_mutation_default_device, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_and_pop_graph_break, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_and_pop_graph_break_mutation, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_disable, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_enabled_guard, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_enter_exit, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_graph_break, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_guards_cpp, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_guards_py, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_highest_priority, test/dynamo/test_modes.py::TorchFunctionModeTests::test_torch_function_mode_restore_on_exc 2025-09-07T06:57:19.3291532Z 2025-09-07T06:57:19.3291645Z Running dynamo/test_modules 1/1 ... [2025-09-07 06:57:19.326900] 2025-09-07T06:57:19.3291842Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:57:19.3292295Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_modules.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:57:19.327181] 2025-09-07T06:57:39.6133781Z 2025-09-07T06:57:39.6135205Z dynamo/test_modules 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_modules_1.1_0fef801517c60e9f_.log 2025-09-07T06:57:39.6152749Z Running 134 items in this shard: test/dynamo/test_modules.py::NNModuleTests::test_access_by_keys, test/dynamo/test_modules.py::NNModuleTests::test_basicmodule1, test/dynamo/test_modules.py::NNModuleTests::test_basicmodule2, test/dynamo/test_modules.py::NNModuleTests::test_call_fn_with_non_const_inputs_safe, test/dynamo/test_modules.py::NNModuleTests::test_cfgmod, test/dynamo/test_modules.py::NNModuleTests::test_children, test/dynamo/test_modules.py::NNModuleTests::test_constloop, test/dynamo/test_modules.py::NNModuleTests::test_conv_call_forward_directly, test/dynamo/test_modules.py::NNModuleTests::test_conv_call_super_forward_directly, test/dynamo/test_modules.py::NNModuleTests::test_conv_transpose_call_forward_directly, test/dynamo/test_modules.py::NNModuleTests::test_conv_transpose_call_super_forward_directly, test/dynamo/test_modules.py::NNModuleTests::test_densenet, test/dynamo/test_modules.py::NNModuleTests::test_enumvalues, test/dynamo/test_modules.py::NNModuleTests::test_fnmember, test/dynamo/test_modules.py::NNModuleTests::test_fnmembercmp1, test/dynamo/test_modules.py::NNModuleTests::test_fnmembercmp2, test/dynamo/test_modules.py::NNModuleTests::test_forward_directly, test/dynamo/test_modules.py::NNModuleTests::test_generation_tag, test/dynamo/test_modules.py::NNModuleTests::test_hasattr, test/dynamo/test_modules.py::NNModuleTests::test_inject_module_parameters, test/dynamo/test_modules.py::NNModuleTests::test_intarg, test/dynamo/test_modules.py::NNModuleTests::test_iseval1, test/dynamo/test_modules.py::NNModuleTests::test_iseval2, test/dynamo/test_modules.py::NNModuleTests::test_isnonelayer, test/dynamo/test_modules.py::NNModuleTests::test_istraining1, test/dynamo/test_modules.py::NNModuleTests::test_istraining2, test/dynamo/test_modules.py::NNModuleTests::test_layerlist, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module1, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module2, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module4, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module5, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module6, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module7, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module_bad_params, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module_bad_params_call_function, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module_kwargs, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module_no_cls_to_become, test/dynamo/test_modules.py::NNModuleTests::test_lazy_module_speculation_log_divergence, test/dynamo/test_modules.py::NNModuleTests::test_module_attribute_precedence, test/dynamo/test_modules.py::NNModuleTests::test_module_call_module_with_static_forward, test/dynamo/test_modules.py::NNModuleTests::test_module_class_method, test/dynamo/test_modules.py::NNModuleTests::test_module_comparison, test/dynamo/test_modules.py::NNModuleTests::test_module_forward_has_graph_break, test/dynamo/test_modules.py::NNModuleTests::test_module_guard_name_is_valid, test/dynamo/test_modules.py::NNModuleTests::test_module_name_string, test/dynamo/test_modules.py::NNModuleTests::test_module_property, test/dynamo/test_modules.py::NNModuleTests::test_module_static_method, test/dynamo/test_modules.py::NNModuleTests::test_moduledict, test/dynamo/test_modules.py::NNModuleTests::test_moduledict_custom, test/dynamo/test_modules.py::NNModuleTests::test_modulelist, test/dynamo/test_modules.py::NNModuleTests::test_modulelist_custom, test/dynamo/test_modules.py::NNModuleTests::test_modulelist_nested, test/dynamo/test_modules.py::NNModuleTests::test_modulemethod1, test/dynamo/test_modules.py::NNModuleTests::test_modulemethod2, test/dynamo/test_modules.py::NNModuleTests::test_named_children, test/dynamo/test_modules.py::NNModuleTests::test_nn_module_setattr, test/dynamo/test_modules.py::NNModuleTests::test_nn_module_unspec_int_attr, test/dynamo/test_modules.py::NNModuleTests::test_nn_moduledict_contains, test/dynamo/test_modules.py::NNModuleTests::test_parameterdict, test/dynamo/test_modules.py::NNModuleTests::test_parameterdict_custom, test/dynamo/test_modules.py::NNModuleTests::test_parameters1, test/dynamo/test_modules.py::NNModuleTests::test_parameters2, test/dynamo/test_modules.py::NNModuleTests::test_parameters3, test/dynamo/test_modules.py::NNModuleTests::test_parameters4, test/dynamo/test_modules.py::NNModuleTests::test_parameters5, test/dynamo/test_modules.py::NNModuleTests::test_self_mutating1, test/dynamo/test_modules.py::NNModuleTests::test_seq, test/dynamo/test_modules.py::NNModuleTests::test_sequential_with_duplicated_module, test/dynamo/test_modules.py::NNModuleTests::test_sequential_with_duplicated_module2, test/dynamo/test_modules.py::NNModuleTests::test_simple_torch_function, test/dynamo/test_modules.py::NNModuleTests::test_stringmember, test/dynamo/test_modules.py::NNModuleTests::test_submodules1, test/dynamo/test_modules.py::NNModuleTests::test_submodules2, test/dynamo/test_modules.py::NNModuleTests::test_super1, test/dynamo/test_modules.py::NNModuleTests::test_super2, test/dynamo/test_modules.py::NNModuleTests::test_super_class_method, test/dynamo/test_modules.py::NNModuleTests::test_tensorlist, test/dynamo/test_modules.py::NNModuleTests::test_torch_function_with_closure, test/dynamo/test_modules.py::NNModuleTests::test_torch_mangled_class_name, test/dynamo/test_modules.py::NNModuleTests::test_unsupportedmethod, test/dynamo/test_modules.py::NNModuleTests::test_unsupportedmodule, test/dynamo/test_modules.py::NNModuleTests::test_viamodulecall, test/dynamo/test_modules.py::OptimizedModuleTest::test_assign_does_not_exist, test/dynamo/test_modules.py::OptimizedModuleTest::test_attr, test/dynamo/test_modules.py::OptimizedModuleTest::test_attr_precedence, test/dynamo/test_modules.py::OptimizedModuleTest::test_backward_hooks, test/dynamo/test_modules.py::OptimizedModuleTest::test_branch_on_nn_module_custom_bool, test/dynamo/test_modules.py::OptimizedModuleTest::test_branch_on_nn_module_custom_len, test/dynamo/test_modules.py::OptimizedModuleTest::test_buffer_order, test/dynamo/test_modules.py::OptimizedModuleTest::test_composition, test/dynamo/test_modules.py::OptimizedModuleTest::test_composition_with_opt_mod, test/dynamo/test_modules.py::OptimizedModuleTest::test_delattr_on_compiled_module, test/dynamo/test_modules.py::OptimizedModuleTest::test_dir, test/dynamo/test_modules.py::OptimizedModuleTest::test_dunder_call_explicitly, test/dynamo/test_modules.py::OptimizedModuleTest::test_globals_change_in_other_file, test/dynamo/test_modules.py::OptimizedModuleTest::test_guard_on_torch_nn_modules, test/dynamo/test_modules.py::OptimizedModuleTest::test_hooks_allowed_modules, test/dynamo/test_modules.py::OptimizedModuleTest::test_hooks_allowed_modules_compiles, test/dynamo/test_modules.py::OptimizedModuleTest::test_hooks_allowed_modules_compiles_self_contained, test/dynamo/test_modules.py::OptimizedModuleTest::test_hooks_inner, test/dynamo/test_modules.py::OptimizedModuleTest::test_hooks_outer, test/dynamo/test_modules.py::OptimizedModuleTest::test_hooks_skip_guards, test/dynamo/test_modules.py::OptimizedModuleTest::test_inline_inbuilt_nn_modules, test/dynamo/test_modules.py::OptimizedModuleTest::test_mark_static_nn_module_tensor, test/dynamo/test_modules.py::OptimizedModuleTest::test_mark_static_previously_seen_tensor, test/dynamo/test_modules.py::OptimizedModuleTest::test_mark_static_with_freezing, test/dynamo/test_modules.py::OptimizedModuleTest::test_module_dict_iter_keys, test/dynamo/test_modules.py::OptimizedModuleTest::test_module_dict_iter_name, test/dynamo/test_modules.py::OptimizedModuleTest::test_module_dict_iter_values, test/dynamo/test_modules.py::OptimizedModuleTest::test_module_order, test/dynamo/test_modules.py::OptimizedModuleTest::test_module_patch, test/dynamo/test_modules.py::OptimizedModuleTest::test_module_setattr, test/dynamo/test_modules.py::OptimizedModuleTest::test_monkeypatching_forward, test/dynamo/test_modules.py::OptimizedModuleTest::test_nn_module, test/dynamo/test_modules.py::OptimizedModuleTest::test_no_op_assignment, test/dynamo/test_modules.py::OptimizedModuleTest::test_no_recompile_on_nn_guarded_modules, test/dynamo/test_modules.py::OptimizedModuleTest::test_overridden_call, test/dynamo/test_modules.py::OptimizedModuleTest::test_param_order, test/dynamo/test_modules.py::OptimizedModuleTest::test_param_requires_grad, test/dynamo/test_modules.py::OptimizedModuleTest::test_patch_module, test/dynamo/test_modules.py::OptimizedModuleTest::test_recompile_limit_on_freed_module, test/dynamo/test_modules.py::OptimizedModuleTest::test_recompile_limit_on_guarded_nn_modules, test/dynamo/test_modules.py::OptimizedModuleTest::test_recursion, test/dynamo/test_modules.py::OptimizedModuleTest::test_save_and_load_all_backends, test/dynamo/test_modules.py::OptimizedModuleTest::test_save_and_load_inductor, test/dynamo/test_modules.py::OptimizedModuleTest::test_setattr_on_compiled_module, test/dynamo/test_modules.py::OptimizedModuleTest::test_to, test/dynamo/test_modules.py::OptimizedModuleTest::test_trace_delattr, test/dynamo/test_modules.py::OptimizedModuleTest::test_udo_instance_method_as_hook, test/dynamo/test_modules.py::OptimizedModuleTest::test_unhashable_nn_submodule, test/dynamo/test_modules.py::OptimizedModuleTest::test_unspec_non_inlinable_module, test/dynamo/test_modules.py::OptimizedModuleTest::test_unspecialized_seq, test/dynamo/test_modules.py::OptimizedModuleTest::test_user_defined_nn_module_dynamic, test/dynamo/test_modules.py::NNModuleTestsDeviceCUDA::test_lazy_module3_cuda 2025-09-07T06:57:39.6165606Z 2025-09-07T06:57:39.6165696Z Running dynamo/test_package 1/1 ... [2025-09-07 06:57:39.613300] 2025-09-07T06:57:39.6165860Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:57:39.6171433Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_package.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:57:39.613534] 2025-09-07T06:58:12.2943845Z 2025-09-07T06:58:12.2946994Z dynamo/test_package 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_package_1.1_c910f1e2185e0767_.log 2025-09-07T06:58:12.2964104Z Running 46 items in this shard: test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_autotune_cache_device_cuda, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_autotune_cache_device_xpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_graph_breaks_device_cpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_graph_breaks_device_cuda, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_graph_breaks_device_xpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_lazy_backward_device_cpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_lazy_backward_device_cuda, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_lazy_backward_device_xpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_recompiles_device_cpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_recompiles_device_cuda, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_recompiles_device_xpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_serialize_device_cpu, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_serialize_device_cuda, test/dynamo/test_package.py::TestPackage::test_automatic_dynamo_serialize_device_xpu, test/dynamo/test_package.py::TestPackage::test_basic_fn_backend_eager_device_cpu, test/dynamo/test_package.py::TestPackage::test_basic_fn_backend_eager_device_cuda, test/dynamo/test_package.py::TestPackage::test_basic_fn_backend_eager_device_xpu, test/dynamo/test_package.py::TestPackage::test_basic_fn_backend_inductor_device_cpu, test/dynamo/test_package.py::TestPackage::test_basic_fn_backend_inductor_device_cuda, test/dynamo/test_package.py::TestPackage::test_basic_fn_backend_inductor_device_xpu, test/dynamo/test_package.py::TestPackage::test_call_function_from_resume_device_cpu, test/dynamo/test_package.py::TestPackage::test_call_function_from_resume_device_cuda, test/dynamo/test_package.py::TestPackage::test_call_function_from_resume_device_xpu, test/dynamo/test_package.py::TestPackage::test_dynamic_shape_backend_eager_device_cpu, test/dynamo/test_package.py::TestPackage::test_dynamic_shape_backend_eager_device_cuda, test/dynamo/test_package.py::TestPackage::test_dynamic_shape_backend_eager_device_xpu, test/dynamo/test_package.py::TestPackage::test_dynamic_shape_backend_inductor_device_cpu, test/dynamo/test_package.py::TestPackage::test_dynamic_shape_backend_inductor_device_cuda, test/dynamo/test_package.py::TestPackage::test_dynamic_shape_backend_inductor_device_xpu, test/dynamo/test_package.py::TestPackage::test_dynamo_cache_manual_load_device_cpu, test/dynamo/test_package.py::TestPackage::test_dynamo_cache_manual_load_device_cuda, test/dynamo/test_package.py::TestPackage::test_dynamo_cache_manual_load_device_xpu, test/dynamo/test_package.py::TestPackage::test_file_change, test/dynamo/test_package.py::TestPackage::test_graph_break_bomb_backend_eager_device_cpu, test/dynamo/test_package.py::TestPackage::test_graph_break_bomb_backend_eager_device_cuda, test/dynamo/test_package.py::TestPackage::test_graph_break_bomb_backend_eager_device_xpu, test/dynamo/test_package.py::TestPackage::test_graph_break_bomb_backend_inductor_device_cpu, test/dynamo/test_package.py::TestPackage::test_graph_break_bomb_backend_inductor_device_cuda, test/dynamo/test_package.py::TestPackage::test_graph_break_bomb_backend_inductor_device_xpu, test/dynamo/test_package.py::TestPackage::test_lazy_backward_backend_eager_device_cpu, test/dynamo/test_package.py::TestPackage::test_lazy_backward_backend_eager_device_cuda, test/dynamo/test_package.py::TestPackage::test_lazy_backward_backend_eager_device_xpu, test/dynamo/test_package.py::TestPackage::test_lazy_backward_backend_inductor_device_cpu, test/dynamo/test_package.py::TestPackage::test_lazy_backward_backend_inductor_device_cuda, test/dynamo/test_package.py::TestPackage::test_lazy_backward_backend_inductor_device_xpu, test/dynamo/test_package.py::TestPackage::test_nn_module 2025-09-07T06:58:12.2971794Z 2025-09-07T06:58:12.2971909Z Running dynamo/test_recompiles 1/1 ... [2025-09-07 06:58:12.294386] 2025-09-07T06:58:12.2972134Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:12.2972668Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_recompiles.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:12.294743] 2025-09-07T06:58:20.1746080Z 2025-09-07T06:58:20.1748119Z dynamo/test_recompiles 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_recompiles_1.1_cc40291adaa25cc8_.log 2025-09-07T06:58:20.1754672Z Running 18 items in this shard: test/dynamo/test_recompiles.py::RecompileTests::test_aliasing_guard_failures, test/dynamo/test_recompiles.py::RecompileTests::test_aliasing_guard_failures_with_globals, test/dynamo/test_recompiles.py::RecompileTests::test_ambient_autocast_recompile, test/dynamo/test_recompiles.py::RecompileTests::test_autocast_constant_fold, test/dynamo/test_recompiles.py::RecompileTests::test_automatic_dynamic_on_closed_ints, test/dynamo/test_recompiles.py::RecompileTests::test_automatic_dynamic_reduce_recompiles, test/dynamo/test_recompiles.py::RecompileTests::test_automatic_dynamic_shapes_mark_as_oblivious, test/dynamo/test_recompiles.py::RecompileTests::test_automatic_dynamic_shapes_mark_as_oblivious_fail_counterfactual, test/dynamo/test_recompiles.py::RecompileTests::test_automatic_dynamic_shapes_mark_as_unbacked, test/dynamo/test_recompiles.py::RecompileTests::test_automatic_dynamic_tensor_scalar_change, test/dynamo/test_recompiles.py::RecompileTests::test_dunder_call_recompile, test/dynamo/test_recompiles.py::RecompileTests::test_dynamic_shape_parameter_recompile, test/dynamo/test_recompiles.py::RecompileTests::test_inline_inbuilt_nn_modules_candidate, test/dynamo/test_recompiles.py::RecompileTests::test_no_recompile_over_unused_objects, test/dynamo/test_recompiles.py::RecompileTests::test_no_recursive_compile_after_cache_limit_hit, test/dynamo/test_recompiles.py::RecompileTests::test_recompiles_true_false_flop, test/dynamo/test_recompiles.py::RecompileTests::test_run_mode_after_cache_limit_hit, test/dynamo/test_recompiles.py::RecompileTests::test_simple_module_recompile 2025-09-07T06:58:20.1757805Z 2025-09-07T06:58:20.1758251Z Running dynamo/test_resume 1/1 ... [2025-09-07 06:58:20.174389] 2025-09-07T06:58:20.1758483Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:20.1759004Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_resume.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:20.174601] 2025-09-07T06:58:22.3433664Z 2025-09-07T06:58:22.3434602Z dynamo/test_resume 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_resume_1.1_3b304bbc899710a1_.log 2025-09-07T06:58:22.3435272Z Running 1 items in this shard: test/dynamo/test_resume.py::ResumeFunctionTests::test_freevars 2025-09-07T06:58:22.3435520Z 2025-09-07T06:58:22.3435722Z Running dynamo/test_sdpa 1/1 ... [2025-09-07 06:58:22.343219] 2025-09-07T06:58:22.3435979Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:22.3437211Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_sdpa.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:22.343517] 2025-09-07T06:58:24.5623880Z 2025-09-07T06:58:24.5624974Z dynamo/test_sdpa 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_sdpa_1.1_642ccb6c28d00adc_.log 2025-09-07T06:58:24.5626744Z Running 4 items in this shard: test/dynamo/test_sdpa.py::TestSDPA::test_graph_break_SDPAParams, test/dynamo/test_sdpa.py::TestSDPA::test_input_SDPAParams, test/dynamo/test_sdpa.py::TestSDPA::test_intermediate_attr_access_SDPAParams, test/dynamo/test_sdpa.py::TestSDPA::test_returns_SDPAParams 2025-09-07T06:58:24.5627880Z 2025-09-07T06:58:24.5628103Z Running dynamo/test_sets 1/1 ... [2025-09-07 06:58:24.562186] 2025-09-07T06:58:24.5628537Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:24.5637443Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_sets.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:24.562490] 2025-09-07T06:58:29.7870859Z 2025-09-07T06:58:29.7872817Z dynamo/test_sets 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_sets_1.1_1735f9f9118eb449_.log 2025-09-07T06:58:29.7886479Z Running 124 items in this shard: test/dynamo/test_sets.py::CustomSetTests::test_custom_add, test/dynamo/test_sets.py::CustomSetTests::test_custom_contains, test/dynamo/test_sets.py::MiscTests::test_isdisjoint_with_generator, test/dynamo/test_sets.py::TestSetGuards::test_in_guard, test/dynamo/test_sets.py::TestSetGuards::test_set_guard_on_keys_change, test/dynamo/test_sets.py::TestSetGuards::test_set_multiple_types, test/dynamo/test_sets.py::TestSetGuards::test_set_recompile_on_key_change, test/dynamo/test_sets.py::TestSetGuards::test_set_recompile_on_key_pop, test/dynamo/test_sets.py::TestSetGuards::test_set_with_function, test/dynamo/test_sets.py::TestSetGuards::test_set_with_tensors, test/dynamo/test_sets.py::FrozensetTests::test_binop_and, test/dynamo/test_sets.py::FrozensetTests::test_binop_or, test/dynamo/test_sets.py::FrozensetTests::test_binop_sub, test/dynamo/test_sets.py::FrozensetTests::test_binop_xor, test/dynamo/test_sets.py::FrozensetTests::test_cmp_eq, test/dynamo/test_sets.py::FrozensetTests::test_cmp_greater_than, test/dynamo/test_sets.py::FrozensetTests::test_cmp_greater_than_or_equal, test/dynamo/test_sets.py::FrozensetTests::test_cmp_less_than, test/dynamo/test_sets.py::FrozensetTests::test_cmp_less_than_or_equal, test/dynamo/test_sets.py::FrozensetTests::test_cmp_ne, test/dynamo/test_sets.py::FrozensetTests::test_constructor_iterable, test/dynamo/test_sets.py::FrozensetTests::test_contains, test/dynamo/test_sets.py::FrozensetTests::test_copy, test/dynamo/test_sets.py::FrozensetTests::test_difference, test/dynamo/test_sets.py::FrozensetTests::test_equality, test/dynamo/test_sets.py::FrozensetTests::test_in_frozenset, test/dynamo/test_sets.py::FrozensetTests::test_intersection, test/dynamo/test_sets.py::FrozensetTests::test_isdisjoint, test/dynamo/test_sets.py::FrozensetTests::test_issubset, test/dynamo/test_sets.py::FrozensetTests::test_issuperset, test/dynamo/test_sets.py::FrozensetTests::test_symmetric_difference, test/dynamo/test_sets.py::FrozensetTests::test_to_frozenset, test/dynamo/test_sets.py::FrozensetTests::test_to_set, test/dynamo/test_sets.py::FrozensetTests::test_union, test/dynamo/test_sets.py::SetTests::test_add, test/dynamo/test_sets.py::SetTests::test_binop_and, test/dynamo/test_sets.py::SetTests::test_binop_or, test/dynamo/test_sets.py::SetTests::test_binop_sub, test/dynamo/test_sets.py::SetTests::test_binop_xor, test/dynamo/test_sets.py::SetTests::test_clear, test/dynamo/test_sets.py::SetTests::test_cmp_eq, test/dynamo/test_sets.py::SetTests::test_cmp_greater_than, test/dynamo/test_sets.py::SetTests::test_cmp_greater_than_or_equal, test/dynamo/test_sets.py::SetTests::test_cmp_less_than, test/dynamo/test_sets.py::SetTests::test_cmp_less_than_or_equal, test/dynamo/test_sets.py::SetTests::test_cmp_ne, test/dynamo/test_sets.py::SetTests::test_constructor_iterable, test/dynamo/test_sets.py::SetTests::test_contains, test/dynamo/test_sets.py::SetTests::test_copy, test/dynamo/test_sets.py::SetTests::test_difference, test/dynamo/test_sets.py::SetTests::test_difference_update, test/dynamo/test_sets.py::SetTests::test_discard, test/dynamo/test_sets.py::SetTests::test_equality, test/dynamo/test_sets.py::SetTests::test_in_frozenset, test/dynamo/test_sets.py::SetTests::test_intersection, test/dynamo/test_sets.py::SetTests::test_intersection_update, test/dynamo/test_sets.py::SetTests::test_isdisjoint, test/dynamo/test_sets.py::SetTests::test_issubset, test/dynamo/test_sets.py::SetTests::test_issuperset, test/dynamo/test_sets.py::SetTests::test_pop, test/dynamo/test_sets.py::SetTests::test_remove, test/dynamo/test_sets.py::SetTests::test_symmetric_difference, test/dynamo/test_sets.py::SetTests::test_symmetric_difference_update, test/dynamo/test_sets.py::SetTests::test_to_frozenset, test/dynamo/test_sets.py::SetTests::test_to_set, test/dynamo/test_sets.py::SetTests::test_union, test/dynamo/test_sets.py::SetTests::test_update, test/dynamo/test_sets.py::UserDefinedSetTests::test_add, test/dynamo/test_sets.py::UserDefinedSetTests::test_binop_and, test/dynamo/test_sets.py::UserDefinedSetTests::test_binop_or, test/dynamo/test_sets.py::UserDefinedSetTests::test_binop_sub, test/dynamo/test_sets.py::UserDefinedSetTests::test_binop_xor, test/dynamo/test_sets.py::UserDefinedSetTests::test_clear, test/dynamo/test_sets.py::UserDefinedSetTests::test_cmp_eq, test/dynamo/test_sets.py::UserDefinedSetTests::test_cmp_greater_than, test/dynamo/test_sets.py::UserDefinedSetTests::test_cmp_greater_than_or_equal, test/dynamo/test_sets.py::UserDefinedSetTests::test_cmp_less_than, test/dynamo/test_sets.py::UserDefinedSetTests::test_cmp_less_than_or_equal, test/dynamo/test_sets.py::UserDefinedSetTests::test_cmp_ne, test/dynamo/test_sets.py::UserDefinedSetTests::test_constructor_iterable, test/dynamo/test_sets.py::UserDefinedSetTests::test_contains, test/dynamo/test_sets.py::UserDefinedSetTests::test_copy, test/dynamo/test_sets.py::UserDefinedSetTests::test_difference, test/dynamo/test_sets.py::UserDefinedSetTests::test_difference_update, test/dynamo/test_sets.py::UserDefinedSetTests::test_discard, test/dynamo/test_sets.py::UserDefinedSetTests::test_equality, test/dynamo/test_sets.py::UserDefinedSetTests::test_in_frozenset, test/dynamo/test_sets.py::UserDefinedSetTests::test_intersection, test/dynamo/test_sets.py::UserDefinedSetTests::test_intersection_update, test/dynamo/test_sets.py::UserDefinedSetTests::test_isdisjoint, test/dynamo/test_sets.py::UserDefinedSetTests::test_issubset, test/dynamo/test_sets.py::UserDefinedSetTests::test_issuperset, test/dynamo/test_sets.py::UserDefinedSetTests::test_pop, test/dynamo/test_sets.py::UserDefinedSetTests::test_remove, test/dynamo/test_sets.py::UserDefinedSetTests::test_symmetric_difference, test/dynamo/test_sets.py::UserDefinedSetTests::test_symmetric_difference_update, test/dynamo/test_sets.py::UserDefinedSetTests::test_to_frozenset, test/dynamo/test_sets.py::UserDefinedSetTests::test_to_set, test/dynamo/test_sets.py::UserDefinedSetTests::test_union, test/dynamo/test_sets.py::UserDefinedSetTests::test_update, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_binop_and, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_binop_or, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_binop_sub, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_binop_xor, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_cmp_eq, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_cmp_greater_than, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_cmp_greater_than_or_equal, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_cmp_less_than, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_cmp_less_than_or_equal, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_cmp_ne, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_constructor_iterable, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_contains, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_copy, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_difference, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_equality, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_in_frozenset, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_intersection, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_isdisjoint, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_issubset, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_issuperset, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_symmetric_difference, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_to_frozenset, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_to_set, test/dynamo/test_sets.py::UserDefinedFrozensetTests::test_union 2025-09-07T06:58:29.7896920Z 2025-09-07T06:58:29.7897024Z Running dynamo/test_skip_guard_eval_unsafe 1/1 ... [2025-09-07 06:58:29.786950] 2025-09-07T06:58:29.7897206Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:29.7902980Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_skip_guard_eval_unsafe.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:29.787155] 2025-09-07T06:58:36.6148768Z 2025-09-07T06:58:36.6150676Z dynamo/test_skip_guard_eval_unsafe 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_skip_guard_eval_unsafe_1.1_c925fe1a5f2c9bf5_.log 2025-09-07T06:58:36.6153416Z Running 5 items in this shard: test/dynamo/test_skip_guard_eval_unsafe.py::RunDiffGuardTests::test_bool_recompile, test/dynamo/test_skip_guard_eval_unsafe.py::RunDiffGuardTests::test_cache_line_pickup, test/dynamo/test_skip_guard_eval_unsafe.py::RunDiffGuardTests::test_fail_on_tensor_shape_change, test/dynamo/test_skip_guard_eval_unsafe.py::RunDiffGuardTests::test_post_recompile, test/dynamo/test_skip_guard_eval_unsafe.py::RunDiffGuardTests::test_tensor_recompile 2025-09-07T06:58:36.6154439Z 2025-09-07T06:58:36.6154576Z Running dynamo/test_skip_non_tensor 1/1 ... [2025-09-07 06:58:36.614829] 2025-09-07T06:58:36.6154796Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:36.6155304Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_skip_non_tensor.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:36.615130] 2025-09-07T06:58:39.1344565Z 2025-09-07T06:58:39.1345882Z dynamo/test_skip_non_tensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_skip_non_tensor_1.1_be8ab3271c8fd95e_.log 2025-09-07T06:58:39.1347438Z Running 8 items in this shard: test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_add_skip, test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_add_tensor1, test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_add_tensor2, test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_add_tensor_dict, test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_add_tensor_list, test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_custom_list, test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_do_not_skip_side_effects, test/dynamo/test_skip_non_tensor.py::SkipNonTensorTests::test_recursive_list 2025-09-07T06:58:39.1348345Z 2025-09-07T06:58:39.1348438Z Running dynamo/test_sources 1/1 ... [2025-09-07 06:58:39.134365] 2025-09-07T06:58:39.1348608Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:39.1348991Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_sources.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:39.134570] 2025-09-07T06:58:41.2530519Z 2025-09-07T06:58:41.2531622Z dynamo/test_sources 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_sources_1.1_050fc420581ff50c_.log 2025-09-07T06:58:41.2541337Z Running 3 items in this shard: test/dynamo/test_sources.py::SourceTests::test_is_local, test/dynamo/test_sources.py::SourceTests::test_property_closure, test/dynamo/test_sources.py::SourceTests::test_supported_nodes 2025-09-07T06:58:41.2541990Z 2025-09-07T06:58:41.2542184Z Running dynamo/test_structured_trace 1/1 ... [2025-09-07 06:58:41.252879] 2025-09-07T06:58:41.2542539Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:58:41.2543365Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_structured_trace.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:58:41.253108] 2025-09-07T06:59:03.0139258Z 2025-09-07T06:59:03.0142375Z dynamo/test_structured_trace 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_structured_trace_1.1_f4bacfbb4875117a_.log 2025-09-07T06:59:03.0147222Z Running 29 items in this shard: test/dynamo/test_structured_trace.py::StructuredTraceTest::test_chromium_event, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_codecache, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_collective_schedule_empty, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_collective_schedule_real, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_compile_id_serialization_deserialization, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_compiled_autograd_attribution, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_compiled_autograd_chromium, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_compiled_autograd_id, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_cudagraphs, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_ddp_graphs, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_dump_file, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_dynamo_error, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_example_fn, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_example_training_fn, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_graph_breaks, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_graph_execution_order, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_graph_sizes_dynamic, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_guards_recompiles, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_inductor_error, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_make_fx_fail_partial, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_recompile_user_contexts, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_recompile_user_contexts_iteration, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_recompiles, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_runtime_estimates_mixed, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_runtime_estimates_simple, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_schedule, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_tensor_metadata_logging, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_tensor_metadata_logging_dynamic_shapes, test/dynamo/test_structured_trace.py::StructuredTraceTest::test_tensor_metadata_logging_multiple_ops 2025-09-07T06:59:03.0150724Z 2025-09-07T06:59:03.0150811Z Running dynamo/test_subclasses 1/1 ... [2025-09-07 06:59:03.013836] 2025-09-07T06:59:03.0151090Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:59:03.0151470Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_subclasses.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:59:03.014096] 2025-09-07T06:59:34.3880512Z 2025-09-07T06:59:34.3881724Z dynamo/test_subclasses 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_subclasses_1.1_9041b5c8f4a48142_.log 2025-09-07T06:59:34.3905744Z Running 125 items in this shard: test/dynamo/test_subclasses.py::SubclassTests::test_as_subclass_attr_mutation, test/dynamo/test_subclasses.py::SubclassTests::test_base_torch_function_tracing, test/dynamo/test_subclasses.py::SubclassTests::test_compile_higher_order_with_functionalization, test/dynamo/test_subclasses.py::SubclassTests::test_compile_with_fake_tensor_automatic_dynamic, test/dynamo/test_subclasses.py::SubclassTests::test_compile_with_fake_tensor_dynamic_dim, test/dynamo/test_subclasses.py::SubclassTests::test_compile_with_functionalization, test/dynamo/test_subclasses.py::SubclassTests::test_disable_all_torch_function, test/dynamo/test_subclasses.py::SubclassTests::test_disable_all_torch_function_restore_values, test/dynamo/test_subclasses.py::SubclassTests::test_disable_all_torch_function_restore_values_graph_break, test/dynamo/test_subclasses.py::SubclassTests::test_has_torch_function, test/dynamo/test_subclasses.py::SubclassTests::test_make_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_mark_static_with_subclass_desugaring_dynamic_False, test/dynamo/test_subclasses.py::SubclassTests::test_mark_static_with_subclass_desugaring_dynamic_True, test/dynamo/test_subclasses.py::SubclassTests::test_newly_constructed_tensor_subclass_attr_mutation, test/dynamo/test_subclasses.py::SubclassTests::test_njt_subclass_from_buffer, test/dynamo/test_subclasses.py::SubclassTests::test_njt_subclass_from_cat, test/dynamo/test_subclasses.py::SubclassTests::test_njt_subclass_simple, test/dynamo/test_subclasses.py::SubclassTests::test_no_call_to_new, test/dynamo/test_subclasses.py::SubclassTests::test_no_torch_function_on_size_bytecode, test/dynamo/test_subclasses.py::SubclassTests::test_no_torch_function_recompiles, test/dynamo/test_subclasses.py::SubclassTests::test_nontraceable_tensor_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_overridden_method_guarding, test/dynamo/test_subclasses.py::SubclassTests::test_parameter_subclass_custom_torch_func_and_dynamic_attr, test/dynamo/test_subclasses.py::SubclassTests::test_parameter_subclass_with_old_torch_function, test/dynamo/test_subclasses.py::SubclassTests::test_recompile_with_symbool_inputs, test/dynamo/test_subclasses.py::SubclassTests::test_recompiles_with_optional_inner_tensor, test/dynamo/test_subclasses.py::SubclassTests::test_return_as_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_return_local_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_return_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_TwoTensor_TwoTensor_TwoTensor, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_TwoTensor_nested_diff_sizes, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_constructor_proxying, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_dont_invoke_torch_function_on_overridden_attr, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_dont_invoke_torch_function_on_overridden_method, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_override_shape_and_to, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_views_dynamic_False, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_views_dynamic_True, test/dynamo/test_subclasses.py::SubclassTests::test_subclass_with_disabled_torch_function, test/dynamo/test_subclasses.py::SubclassTests::test_support_bases, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_automatic_dynamic_shapes, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_clone_view, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_different_shape, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_mark_dynamic_shapes, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_mul, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_nested, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_return_multiple, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_return_shape, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_return_tensor_and_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_simple, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_view, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_TwoTensor_view_mul, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_attr_codegen_tos, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_ctx_custom_guards_error_arg_num, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_ctx_custom_guards_error_not_classmethod, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_ctx_custom_guards_override, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_ctx_guards, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_ctx_recursive_guards, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_custom_attr, test/dynamo/test_subclasses.py::SubclassTests::test_tensor_subclass_with_non_classmethod_torch_function, test/dynamo/test_subclasses.py::SubclassTests::test_torch_dispatch_subclass_guard_recompile, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_call_on_attr, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_call_on_method, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_call_on_method_arg, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_list_args, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_state_graph_break, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_state_guards, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_state_nested, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_state_tracing, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_subclass_survives_into_aot_autograd, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_wrapper_class, test/dynamo/test_subclasses.py::SubclassTests::test_torch_function_wrapper_class_with_kwargs, test/dynamo/test_subclasses.py::SubclassTests::test_type_check_equality_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_type_check_equality_tensor, test/dynamo/test_subclasses.py::SubclassTests::test_type_check_identity_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_type_check_identity_tensor, test/dynamo/test_subclasses.py::SubclassTests::test_type_check_isinstance_subclass, test/dynamo/test_subclasses.py::SubclassTests::test_type_check_isinstance_tensor, test/dynamo/test_subclasses.py::SubclassTests::test_user_overridden_attr_unsupported, test/dynamo/test_subclasses.py::SubclassTests::test_user_overridden_method_unsupported, test/dynamo/test_subclasses.py::SubclassTests::test_user_overridden_property_unsupported, test/dynamo/test_subclasses.py::SubclassTests::test_wrapper_subclass_dynamo_attribute_access_on_intermediate, test/dynamo/test_subclasses.py::SubclassTests::test_wrapper_subclass_guards_on_inner_tensor, test/dynamo/test_subclasses.py::SubclassTests::test_wrapper_subclass_with_differently_sized_inner_tensor, test/dynamo/test_subclasses.py::SubclassTests::test_wrapper_subclass_with_same_sized_inner_tensor, test/dynamo/test_subclasses.py::TestNestedTensor::test_basic_autograd, test/dynamo/test_subclasses.py::TestNestedTensor::test_basic_autograd_inductor, test/dynamo/test_subclasses.py::TestNestedTensor::test_binary_does_not_recompile, test/dynamo/test_subclasses.py::TestNestedTensor::test_binary_recompiles, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_input, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_input_2, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_input_4, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_input_5, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_input_6, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_intermediate, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_intermediate_2, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_intermediate_3, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_intermediate_4, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_from_intermediate_5, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_mixed, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_mixed_2, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_construction_mixed_3, test/dynamo/test_subclasses.py::TestNestedTensor::test_in_graph_is_nested_call, test/dynamo/test_subclasses.py::TestNestedTensor::test_inference_tensor, test/dynamo/test_subclasses.py::TestNestedTensor::test_inline_nested_tensor_from_jagged, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_False_basic, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_False_leaf_False_False, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_False_leaf_False_True, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_False_leaf_True_False, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_False_leaf_True_True, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_False_obscure, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_True_basic, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_True_leaf_False_False, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_True_leaf_False_True, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_True_leaf_True_False, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_True_leaf_True_True, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_base_is_nt_True_obscure, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_dense_subclass_dense_subclass, test/dynamo/test_subclasses.py::TestNestedTensor::test_inputs_to_compiled_fn_are_views_nt_view_name_subclass_dense, test/dynamo/test_subclasses.py::TestNestedTensor::test_param_subclass_isinstance_input, test/dynamo/test_subclasses.py::TestNestedTensor::test_return_shape, test/dynamo/test_subclasses.py::TestNestedTensor::test_subclass_dense_subclass_dense_view, test/dynamo/test_subclasses.py::TestNestedTensor::test_subclass_gives_static_shapes_when_dynamic_false, test/dynamo/test_subclasses.py::TestNestedTensor::test_subclass_with_mutation_in_graph, test/dynamo/test_subclasses.py::TestNestedTensor::test_unary_does_not_recompile, test/dynamo/test_subclasses.py::TestNestedTensor::test_unbind 2025-09-07T06:59:34.3926852Z 2025-09-07T06:59:34.3926932Z Running dynamo/test_utils 1/1 ... [2025-09-07 06:59:34.388242] 2025-09-07T06:59:34.3927182Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:59:34.3927557Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:59:34.388467] 2025-09-07T06:59:52.3969961Z 2025-09-07T06:59:52.3971126Z dynamo/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_utils_1.1_1e50b53b9e112818_.log 2025-09-07T06:59:52.3976052Z Running 15 items in this shard: test/dynamo/test_utils.py::TestUtils::test_graph_break_counting, test/dynamo/test_utils.py::TestUtils::test_larger_multiplier_for_even_smaller_tensor, test/dynamo/test_utils.py::TestUtils::test_larger_multiplier_for_smaller_tensor, test/dynamo/test_utils.py::TestUtils::test_nan, test/dynamo/test_utils.py::TestUtils::test_traced_code_query, test/dynamo/test_utils.py::TestDynamoTimed::test_dynamic_shape_feature_use, test/dynamo/test_utils.py::TestDynamoTimed::test_dynamo_timed, test/dynamo/test_utils.py::TestDynamoTimed::test_exception_stack_trace, test/dynamo/test_utils.py::TestDynamoTimed::test_graph_node_shapes, test/dynamo/test_utils.py::TestDynamoTimed::test_ir_count, test/dynamo/test_utils.py::TestDynamoTimed::test_log_dynamo_start, test/dynamo/test_utils.py::TestDynamoTimed::test_num_params, test/dynamo/test_utils.py::TestDynamoTimed::test_stack_trace, test/dynamo/test_utils.py::TestInductorConfigParsingForLogging::test_inductor_config_jsonify, test/dynamo/test_utils.py::TestInductorConfigParsingForLogging::test_inductor_config_parsing_non_conforming_items 2025-09-07T06:59:52.3980277Z 2025-09-07T06:59:52.3980368Z Running dynamo/test_verify_correctness 1/1 ... [2025-09-07 06:59:52.396710] 2025-09-07T06:59:52.3980544Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:59:52.3980941Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_verify_correctness.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:59:52.396926] 2025-09-07T06:59:54.7665499Z 2025-09-07T06:59:54.7666855Z dynamo/test_verify_correctness 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_verify_correctness_1.1_f82fbab1918ed9af_.log 2025-09-07T06:59:54.7670366Z Running 4 items in this shard: test/dynamo/test_verify_correctness.py::TestVerifyCorrectness::test_example_inputs, test/dynamo/test_verify_correctness.py::TestVerifyCorrectness::test_incorrect_verify_false, test/dynamo/test_verify_correctness.py::TestVerifyCorrectness::test_incorrect_verify_true, test/dynamo/test_verify_correctness.py::TestVerifyCorrectness::test_torchscript 2025-09-07T06:59:54.7670929Z 2025-09-07T06:59:54.7671029Z Running dynamo/test_view 1/1 ... [2025-09-07 06:59:54.766364] 2025-09-07T06:59:54.7671196Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:59:54.7671880Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_view.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:59:54.766580] 2025-09-07T06:59:57.2864576Z 2025-09-07T06:59:57.2866592Z dynamo/test_view 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_view_1.1_6254fbe9730878d5_.log 2025-09-07T06:59:57.2868770Z Running 6 items in this shard: test/dynamo/test_view.py::ViewTests::test_tensor_view_with_tensor_args, test/dynamo/test_view.py::ViewTests::test_tensor_view_with_tensor_shape_params, test/dynamo/test_view.py::ViewTests::test_torch_reshape_with_tensor_shape_params, test/dynamo/test_view.py::ViewTests::test_view_to_1d, test/dynamo/test_view.py::ViewTests::test_view_to_2d, test/dynamo/test_view.py::ViewTests::test_view_with_tensor_shape_params 2025-09-07T06:59:57.2870358Z 2025-09-07T06:59:57.2871058Z Running export/test_converter 1/1 ... [2025-09-07 06:59:57.286327] 2025-09-07T06:59:57.2879477Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T06:59:57.2880257Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'export/test_converter.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 06:59:57.286583] 2025-09-07T07:00:05.5700145Z 2025-09-07T07:00:05.5701325Z export/test_converter 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_converter_1.1_20e2be750682300c_.log 2025-09-07T07:00:05.5712369Z Running 48 items in this shard: test/export/test_converter.py::TestConverter::test_aten___getitem___dict, test/export/test_converter.py::TestConverter::test_aten___getitem___list, test/export/test_converter.py::TestConverter::test_aten___is__, test/export/test_converter.py::TestConverter::test_aten___isnot__, test/export/test_converter.py::TestConverter::test_aten___not__, test/export/test_converter.py::TestConverter::test_aten_add_t, test/export/test_converter.py::TestConverter::test_aten_append_t, test/export/test_converter.py::TestConverter::test_aten_dim, test/export/test_converter.py::TestConverter::test_aten_floordiv, test/export/test_converter.py::TestConverter::test_aten_len, test/export/test_converter.py::TestConverter::test_aten_tensor_dtype_int, test/export/test_converter.py::TestConverter::test_aten_tensor_dynamic, test/export/test_converter.py::TestConverter::test_aten_tensor_prim_dtype, test/export/test_converter.py::TestConverter::test_aten_to_dtype_with_mutating_storage, test/export/test_converter.py::TestConverter::test_context_manager, test/export/test_converter.py::TestConverter::test_convert_func_without_param, test/export/test_converter.py::TestConverter::test_convert_if_basic, test/export/test_converter.py::TestConverter::test_convert_if_duplicate_attr_names, test/export/test_converter.py::TestConverter::test_convert_if_multiple_out, test/export/test_converter.py::TestConverter::test_convert_if_tuple_out, test/export/test_converter.py::TestConverter::test_convert_nn_module_with_nested_buffer, test/export/test_converter.py::TestConverter::test_convert_nn_module_with_nested_if_and_buffer, test/export/test_converter.py::TestConverter::test_convert_nn_module_with_nested_if_and_param, test/export/test_converter.py::TestConverter::test_convert_nn_module_with_nested_param, test/export/test_converter.py::TestConverter::test_convert_retrace_nested_scripted_modules, test/export/test_converter.py::TestConverter::test_convert_script_object, test/export/test_converter.py::TestConverter::test_get_tensor_constants, test/export/test_converter.py::TestConverter::test_hidden_input_name, test/export/test_converter.py::TestConverter::test_implicit_constant_to_tensor_handling, test/export/test_converter.py::TestConverter::test_prim_SetAttr, test/export/test_converter.py::TestConverter::test_prim_device, test/export/test_converter.py::TestConverter::test_prim_device_cuda, test/export/test_converter.py::TestConverter::test_prim_dtype, test/export/test_converter.py::TestConverter::test_prim_max, test/export/test_converter.py::TestConverter::test_prim_min, test/export/test_converter.py::TestConverter::test_prim_tolist, test/export/test_converter.py::TestConverter::test_profiler__record_function, test/export/test_converter.py::TestConverter::test_raise_exception, test/export/test_converter.py::TestConverter::test_ts2ep_convert_quantized_model, test/export/test_converter.py::TestConverter::test_ts2ep_convert_quantized_model_with_opcontext, test/export/test_converter.py::TestConverter::test_ts2ep_convert_quantized_model_with_opcontext_and_constant, test/export/test_converter.py::TestConverter::test_ts2ep_converter_basic, test/export/test_converter.py::TestConverter::test_ts2ep_converter_container_output, test/export/test_converter.py::TestConverter::test_ts2ep_converter_contains, test/export/test_converter.py::TestConverter::test_ts2ep_converter_custom_op, test/export/test_converter.py::TestConverter::test_ts2ep_converter_unpack, test/export/test_converter.py::TestConverter::test_ts2ep_multi_outputs_on_call_ops, test/export/test_converter.py::TestConverter::test_ts2ep_with_loop 2025-09-07T07:00:05.5718142Z 2025-09-07T07:00:05.5724056Z Running export/test_db 1/1 ... [2025-09-07 07:00:05.570082] 2025-09-07T07:00:05.5724223Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:00:05.5724591Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'export/test_db.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:00:05.570323] 2025-09-07T07:00:19.0603769Z 2025-09-07T07:00:19.0605745Z export/test_db 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_db_1.1_8e5990533e3380f9_.log 2025-09-07T07:00:19.0614063Z Running 36 items in this shard: test/export/test_db.py::ExampleTests::test_exportdb_not_supported_case_dynamic_shape_round, test/export/test_db.py::ExampleTests::test_exportdb_not_supported_case_model_attr_mutation, test/export/test_db.py::ExampleTests::test_exportdb_not_supported_case_optional_input, test/export/test_db.py::ExampleTests::test_exportdb_not_supported_case_unsupported_operator, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_assume_constant_result, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_autograd_function, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_class_method, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_cond_branch_class_method, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_cond_branch_nested_function, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_cond_branch_nonlocal_variables, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_cond_closed_over_variable, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_cond_operands, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_cond_predicate, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_constrain_as_size_example, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_constrain_as_value_example, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_decorator, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_dictionary, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_dynamic_shape_assert, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_dynamic_shape_constructor, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_dynamic_shape_if_guard, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_dynamic_shape_map, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_dynamic_shape_slicing, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_dynamic_shape_view, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_fn_with_kwargs, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_list_contains, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_list_unpack, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_nested_function, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_null_context_manager, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_pytree_flatten, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_scalar_output, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_specialized_attribute, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_static_for_loop, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_static_if, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_tensor_setattr, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_type_reflection_method, test/export/test_db.py::ExampleTests::test_exportdb_supported_case_user_input_mutation 2025-09-07T07:00:19.0624155Z 2025-09-07T07:00:19.0624259Z Running export/test_experimental 1/1 ... [2025-09-07 07:00:19.060170] 2025-09-07T07:00:19.0624427Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:00:19.0624818Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'export/test_experimental.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:00:19.060414] 2025-09-07T07:00:25.2368863Z 2025-09-07T07:00:25.2371150Z export/test_experimental 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_experimental_1.1_9d0f86e7823d9f81_.log 2025-09-07T07:00:25.2374977Z Running 10 items in this shard: test/export/test_experimental.py::TestExperiment::test_export_add_in_out_info, test/export/test_experimental.py::TestExperiment::test_export_leaf, test/export/test_experimental.py::TestExperiment::test_joint_basic, test/export/test_experimental.py::TestExperiment::test_joint_buffer_input_mutations, test/export/test_experimental.py::TestExperiment::test_joint_cifar10_backwards, test/export/test_experimental.py::TestExperiment::test_joint_dynamic, test/export/test_experimental.py::TestExperiment::test_joint_loss_index, test/export/test_experimental.py::TestExperiment::test_sticky_export, test/export/test_experimental.py::TestExperiment::test_sticky_export_dynamic, test/export/test_experimental.py::TestExperiment::test_sticky_export_nested_inp 2025-09-07T07:00:25.2377934Z 2025-09-07T07:00:25.2378257Z Running export/test_export_training_ir_to_run_decomp 1/1 ... [2025-09-07 07:00:25.236917] 2025-09-07T07:00:25.2385375Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:00:25.2385786Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'export/test_export_training_ir_to_run_decomp.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:00:25.237204] 2025-09-07T07:05:08.6315766Z 2025-09-07T07:05:08.6317291Z export/test_export_training_ir_to_run_decomp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_export_training_ir_to_run_decomp_1.1_283501314dc895e0_.log 2025-09-07T07:05:08.6556301Z Running 832 items in this shard: test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_export_assume_static_by_default_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_export_constraints_error_not_in_range_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_export_constraints_error_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_export_inline_constraints_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_export_slice_maxsize_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_export_slice_unbacked_dim1_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_export_strict_narrow_unbacked_expr_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_no_grad_param_inplace_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestDynamismExpression::test_reshape_view_backed_size_oblivious_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_export_assume_static_by_default_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_export_constraints_error_not_in_range_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_export_constraints_error_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_export_inline_constraints_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_export_slice_maxsize_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_export_slice_unbacked_dim1_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_export_strict_narrow_unbacked_expr_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_no_grad_param_inplace_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestDynamismExpression::test_reshape_view_backed_size_oblivious_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test__scaled_dot_product_flash_attention_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_additional_inputs_constants_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_allow_explicit_guards_as_runtime_asserts_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_args_type_checked_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_aten_lift_fresh_copy_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_attention_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_attr_assignment_extra_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_automatic_constrain_size_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_automatic_dynamic_shapes_constant_relation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_automatic_dynamic_shapes_linear_relation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_automatic_dynamic_shapes_simple_equality_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_baddbmm_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_basic_non_strict_fake_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_basic_non_strict_real_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_basic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_bincount_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_buffer_util_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_capture_subclass_constructor_torch_ir_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_capture_subclass_constructor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_capture_subclass_wrong_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_ccode_python_mod_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_check_specialized_int_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_checks_to_constrain_range_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cleanup_dynamic_markers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_colin_unbacked_backed_vr_sub_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_colon_parameter_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_compiling_state_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_access_identical_symint_closure_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_branches_return_constant_int_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_branches_return_same_int_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_buffers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_contains_unbacked_no_escape_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_int_closure_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_unflatten_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_with_module_stack_export_with_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cond_with_module_stack_export_with_unflatten_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_aliasing_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_input_naming_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_no_user_inp_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_output_dup_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_output_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_requires_grad_const_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_return_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_tensor_mutation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_tensor_with_non_functional_nested_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constant_tensor_with_non_functional_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constrain_decomp_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constrain_size_in_eager_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constrain_size_with_constrain_value_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_constrain_size_with_various_cases_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_conv_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_crop_like_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_cse_for_symint_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_custom_op_auto_functionalize_pre_dispatch_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_custom_op_auto_functionalize_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_custom_op_auto_warn_pre_dispatch_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_custom_op_preserve_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_custom_pytree_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_custom_tag_metadata_re_export_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_decomp_batch_norm_functional_predispatch_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_decomp_item_in_prim_after_decomposition_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_decomp_item_in_prim_before_decomposition_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_default_decomposition_core_cia_ops_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_1_2_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_basic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_integer_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_nested_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_out_of_order_repeat_derived_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_out_of_order_simplified_repeat_non_derived_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_out_of_order_simplified_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_out_of_order_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_derived_dim_repeat_derived_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_detect_leak_nonstrict_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_detect_leak_nonstrict_with_stacktrace_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_detect_leak_strict_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_device_to_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_device_to_gpu_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_device_to_mutation_float_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_device_to_mutation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_device_to_static_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dim_1_2_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dim_auto_and_dim_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dim_dynamic_divisibility_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dim_dynamic_specialization_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dim_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dim_hint_range_violations_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dim_hint_ranges_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_disable_forced_specializations_errors_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_disable_forced_specializations_ok_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_distributed_all_gather_into_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_distributed_all_gather_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_distributed_all_reduce_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_distributed_all_to_all_single_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_distributed_reduce_scatter_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dont_duck_size_for_auto_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_double_lifted_constants_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_draft_export_checks_aliasing_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_draft_export_checks_mutation_list_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_draft_export_checks_mutation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_draft_export_checks_mutation_with_nan_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_draft_export_fake_kernel_inference_errors_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_draft_export_infers_fake_kernel_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_duplicate_modules_with_non_persistent_buffers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_lr_shift_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_bounds_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_builder_basic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_builder_kwargs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_builder_pytree_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_dataclass_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_inferred_basic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_serdes_generic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_serdes_user_errors_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_serdes_various_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_shapes_spec_with_pytree_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_dynamic_sym_round_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_ends_of_bounds_oblivious_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_error_does_not_reference_eager_fallback_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_error_when_passing_mutating_primitive_op_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_exception_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_expand_copy_export_handles_implicit_true_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_api_with_dynamic_shapes_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_as_backend_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_associative_scan_lifted_buffers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_associative_scan_symbol_dim_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_associative_scan_symbol_scandim_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_aten_to_unflatten_subclass_pre_dispatch_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_aten_to_unflatten_subclass_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_aten_to_unflatten_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_cond_preserve_torch_fn_for_subgraphs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_cond_symbool_pred_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_cond_warns_constant_pred_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_custom_decomp_table_basic_pop_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_custom_decomp_table_container_methods_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_custom_op_lib_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_custom_triton_kernel_mutable_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_custom_triton_kernel_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_cyclic_reference_leak_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_decomp_torture_case_1_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_decomp_torture_case_2_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_decomps_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_decomps_simple_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_dynamo_config_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_for_training_run_decomp_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_for_training_with_container_type_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_for_training_with_dynamic_shapes_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_for_training_with_mutation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_for_training_with_state_dict_hooks_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_func_with_default_kwargs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_func_with_keyword_only_args_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_func_with_kwargs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_func_with_pytree_kwargs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_func_with_var_keyword_args_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_func_with_var_keyword_pytree_args_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_func_with_var_postional_args_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_function_schema_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_graph_with_no_inputs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_input_mutation_bug_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_input_mutation_dynamic_shape_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_input_mutation_static_shape_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_linear_preserve_dynamic_shape_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_max_nonstrict_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_max_onnx_reported_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_method_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_mod_constraints_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_module_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_preserve_linear_at_aot_level_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_preserve_linear_but_not_custom_op_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_scan_pytree_output_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_script_module_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_statically_known_true_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_then_compile_tensor_ctor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_with_autocast_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_with_fake_tensor_inputs_on_cuda_devices_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_with_fake_tensor_inputs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_with_inline_constraints_complex_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_with_inline_constraints_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_with_set_grad_enabled_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_export_with_wrong_inputs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_external_call_non_strict_real_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_fake_inputs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_fake_weights_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_filter_traceback_frames_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_float_conversion_from_int_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_float_conversion_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_fqn_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_from_node_metadata_export_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_full_on_scalar_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_function_holding_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_hints_wrapper_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_hoo_inline_users_issue_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_if_functional_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_if_post_autograd_op_preserved_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_inline_script_class_method_recursive_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_inline_script_class_method_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_inline_script_function_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_inline_script_method_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_int_shape_specialization_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_intermediate_shape_comp_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_is_exporting_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_is_non_negative_check_function_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_is_nonzero_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_isnonzero_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_issue_113041_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_issue_157289_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_istft_op_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_keep_composite_ops_invalid_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_keep_composite_ops_linear_convd_for_training_ir_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_keep_composite_ops_linear_convd_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_kwarg_dynamic_shapes_diff_order_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_kwargs_reorder_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_layer_norm_unbacked_normalized_shape_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_layer_sharing_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_lazy_module_kwargs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_lifted_constants_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_linear_conv_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_malformed_fqn_from_source_name_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_map_buffers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_map_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_mask_nonzero_static_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_masked_select_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_math_pow_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_mismatched_dynamic_shapes_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_mixed_input_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_module_dict_key_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_module_input_subclasses_parameterization_nested_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_module_input_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_module_list_slice_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_module_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_module_with_dict_container_inp_out_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_modules_access_for_deleted_submodule_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_more_multidimensional_slicing_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_multidimensional_slicing_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_multinomial_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_multiple_definitions_same_name_dim_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nested_dynamic_shapes_spec_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nested_module_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nested_module_with_constant_buffer_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nested_module_with_init_buffer_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nested_module_with_parameter_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nn_module_stack_shared_submodule_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nn_module_stack_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_no_check_is_size_error_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_no_suggested_fixes_for_data_dependent_errors_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_no_tensor_computation_2_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_no_tensor_computation_3_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_no_tensor_computation_4_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_no_tensor_computation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_non_arg_name_dynamic_shapes_api_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_non_arg_name_dynamic_shapes_api_with_container_type_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_non_arg_name_dynamic_shapes_api_with_kwarg_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_non_persistent_buffer_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_non_strict_dynamic_shapes_suggested_fixes_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_non_strict_dynamic_shapes_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_none_buffers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nonstrict_retrace_preserves_metadata_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nonzero_2_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_nonzero_dynamic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_not_registered_parameter_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_operator_aten_tensor_mode_variant_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_output_node_name_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_pad_sequence_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_param_util_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_partial_patched_forward_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_placeholder_naming_collisions_hoo_subgraphs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_placeholder_naming_collisions_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_placeholder_naming_order_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_placeholder_naming_order_variadic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_placeholder_update_preserving_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_predispatch_cond_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_predispatch_grad_wrappers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_preserve_module_call_signature_unflatten_specialization_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_preserve_requires_grad_placeholders_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_preserve_shape_dynamism_for_unused_inputs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_profiling_code_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_python_asserts_with_sym_int_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_pytree_register_data_class_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_pytree_register_nested_data_class_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_raise_user_error_when_guard_on_data_dependent_operation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_range_constraints_with_replacement_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_real_tensor_alias_dtype_mismatch_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_real_tensor_bool_cast_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_real_tensor_errors_on_aliasing_custom_op_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_real_tensor_for_max_op_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_real_tensor_size_mismatch_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_redundant_assert_max_upper_bound_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_redundant_asserts_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_refine_dynamic_shapes_from_suggested_fixes_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_register_constant_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_repeat_interleave_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_replace_unbacked_with_very_large_upperbound_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_replaced_unbacked_bindings_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_reshape_view_helper_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_retracable_ep_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_retrace_pre_autograd_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_run_decomposition_supports_user_input_mutation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_run_decompositions_keep_metadata_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_run_decompositions_keep_tensor_constant_metadata_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_runtime_assert_for_prim_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_runtime_assert_for_prm_str_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_runtime_assert_with_size_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_sdpa_gqa_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_sequential_slicing_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_set_example_inputs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_set_grad_as_side_effect_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_set_grad_empty_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_set_grad_unflatten_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_setgrad_lifted_tensor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_shared_submodule_nn_module_stack_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_simple_export_for_training_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_simple_unbacked_view_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_size_input_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_slice_nn_module_stack_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_solver_unsupported_sympy_function_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_specialize_derived_dim_roots_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_split_const_gm_with_lifted_constants_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_stack_trace_make_fx_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_stack_trace_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_state_primitives_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_state_shape_attribute_assignment_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_state_tensors_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_static_dim_constraints_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_subclass_nested_attr_access_complicated_metadata_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_subclass_nested_attr_access_const_metadata_not_top_level_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_subclass_nested_attr_access_const_metadata_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_subclass_nested_attr_access_submodule_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_subclass_nested_attr_access_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_subclasses_parameterization_nested_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_subclasses_parameterization_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_suggest_torch_checks_with_non_negative_check_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_suggest_torch_checks_with_regular_check_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_suggested_fixes_for_data_dependent_errors_basic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_suggested_fixes_for_data_dependent_errors_puzzlers_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_suggested_fixes_new_roots_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_sym_float_operators_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_sym_or_sym_and_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_sym_sqrt_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symbool_item_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symfloat_item_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_input_additional_inputs_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_input_basic_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_input_ranges_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_input_shapes_collection_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_input_specialization_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_item_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_output_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_symint_tensor_return_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_tensor_attribute_zero_args_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_tensor_constant_aten_to_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_tensor_constant_with_wrapped_method_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_to_module_with_mutated_buffer_multiple_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_to_module_with_mutated_buffer_multiple_update_sub_later_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_to_module_with_mutated_buffer_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_tolist_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_torch_check_eq_commutativity_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_torch_fn_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_trace_under_fake_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_train_eval_on_exported_preautograd_module_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_3d_matmul_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_bincount_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_bindings_for_divisible_u_symint_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_deferred_runtime_retrace_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_expand_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_infer_size_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_kth_value_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_linear_layer_norm_input_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_noncontig_lin_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_pad_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_scalar_constructor_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_slice_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_to_cond_passthrough_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_to_cond_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unbacked_unsqueeze_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_asserts_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_buffer_update_child2parent_swap_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_closure_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_isinstance_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_multiple_graphs_dispatch_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_multiple_graphs_preserve_signature_no_error_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_multiple_graphs_shared_submodule_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_multiple_graphs_state_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_no_unroll_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_placeholder_update_child2parent_swap_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_placeholder_update_grandchild2cousin_swap_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_5_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_6_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_buf_8_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_const_preserving_3_1_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_const_preserving_3_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_4_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_6_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_9_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_preserving_10_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_preserving_4_1_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_preserving_4_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_preserving_5_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_mutating_buf_preserving_7_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unflatten_random_dag_preserving_4_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unused_aliases_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_unused_constant_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_use_embedding_twice_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_user_input_and_buffer_mutation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_vmap_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_while_loop_assert_separation_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_while_loop_index_assertions_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_while_loop_simple_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_while_loop_tensor_constant_idx_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportTestExport::test_wrapper_module_training_ir_to_decomp_strict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test__scaled_dot_product_flash_attention_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_additional_inputs_constants_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_allow_explicit_guards_as_runtime_asserts_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_args_type_checked_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_aten_lift_fresh_copy_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_attention_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_attr_assignment_extra_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_automatic_constrain_size_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_automatic_dynamic_shapes_constant_relation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_automatic_dynamic_shapes_linear_relation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_automatic_dynamic_shapes_simple_equality_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_baddbmm_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_basic_non_strict_fake_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_basic_non_strict_real_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_basic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_bincount_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_buffer_util_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_capture_subclass_constructor_torch_ir_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_capture_subclass_constructor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_capture_subclass_wrong_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_ccode_python_mod_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_check_specialized_int_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_checks_to_constrain_range_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cleanup_dynamic_markers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_colin_unbacked_backed_vr_sub_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_colon_parameter_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_compiling_state_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_access_identical_symint_closure_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_branches_return_constant_int_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_branches_return_same_int_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_buffers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_contains_unbacked_no_escape_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_int_closure_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_unflatten_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_with_module_stack_export_with_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cond_with_module_stack_export_with_unflatten_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_aliasing_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_input_naming_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_no_user_inp_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_output_dup_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_output_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_requires_grad_const_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_return_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_tensor_mutation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_tensor_with_non_functional_nested_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constant_tensor_with_non_functional_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constrain_decomp_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constrain_size_in_eager_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constrain_size_with_constrain_value_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_constrain_size_with_various_cases_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_conv_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_crop_like_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_cse_for_symint_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_custom_op_auto_functionalize_pre_dispatch_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_custom_op_auto_functionalize_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_custom_op_auto_warn_pre_dispatch_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_custom_op_preserve_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_custom_pytree_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_custom_tag_metadata_re_export_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_decomp_batch_norm_functional_predispatch_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_decomp_item_in_prim_after_decomposition_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_decomp_item_in_prim_before_decomposition_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_default_decomposition_core_cia_ops_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_1_2_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_basic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_integer_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_nested_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_out_of_order_repeat_derived_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_out_of_order_simplified_repeat_non_derived_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_out_of_order_simplified_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_out_of_order_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_derived_dim_repeat_derived_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_detect_leak_nonstrict_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_detect_leak_nonstrict_with_stacktrace_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_detect_leak_strict_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_device_to_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_device_to_gpu_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_device_to_mutation_float_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_device_to_mutation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_device_to_static_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dim_1_2_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dim_auto_and_dim_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dim_dynamic_divisibility_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dim_dynamic_specialization_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dim_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dim_hint_range_violations_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dim_hint_ranges_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_disable_forced_specializations_errors_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_disable_forced_specializations_ok_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_distributed_all_gather_into_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_distributed_all_gather_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_distributed_all_reduce_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_distributed_all_to_all_single_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_distributed_reduce_scatter_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dont_duck_size_for_auto_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_double_lifted_constants_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_draft_export_checks_aliasing_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_draft_export_checks_mutation_list_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_draft_export_checks_mutation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_draft_export_checks_mutation_with_nan_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_draft_export_fake_kernel_inference_errors_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_draft_export_infers_fake_kernel_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_duplicate_modules_with_non_persistent_buffers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_lr_shift_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_bounds_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_builder_basic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_builder_kwargs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_builder_pytree_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_dataclass_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_inferred_basic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_serdes_generic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_serdes_user_errors_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_serdes_various_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_shapes_spec_with_pytree_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_dynamic_sym_round_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_ends_of_bounds_oblivious_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_error_does_not_reference_eager_fallback_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_error_when_passing_mutating_primitive_op_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_exception_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_expand_copy_export_handles_implicit_true_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_api_with_dynamic_shapes_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_as_backend_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_associative_scan_lifted_buffers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_associative_scan_symbol_dim_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_associative_scan_symbol_scandim_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_aten_to_unflatten_subclass_pre_dispatch_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_aten_to_unflatten_subclass_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_aten_to_unflatten_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_cond_preserve_torch_fn_for_subgraphs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_cond_symbool_pred_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_cond_warns_constant_pred_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_custom_decomp_table_basic_pop_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_custom_decomp_table_container_methods_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_custom_op_lib_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_custom_triton_kernel_mutable_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_custom_triton_kernel_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_cyclic_reference_leak_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_decomp_torture_case_1_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_decomp_torture_case_2_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_decomps_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_decomps_simple_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_dynamo_config_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_for_training_run_decomp_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_for_training_with_container_type_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_for_training_with_dynamic_shapes_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_for_training_with_mutation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_for_training_with_state_dict_hooks_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_func_with_default_kwargs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_func_with_keyword_only_args_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_func_with_kwargs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_func_with_pytree_kwargs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_func_with_var_keyword_args_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_func_with_var_keyword_pytree_args_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_func_with_var_postional_args_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_function_schema_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_graph_with_no_inputs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_input_mutation_bug_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_input_mutation_dynamic_shape_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_input_mutation_static_shape_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_linear_preserve_dynamic_shape_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_max_nonstrict_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_max_onnx_reported_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_method_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_mod_constraints_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_module_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_preserve_linear_at_aot_level_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_preserve_linear_but_not_custom_op_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_scan_pytree_output_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_script_module_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_statically_known_true_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_then_compile_tensor_ctor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_with_autocast_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_with_fake_tensor_inputs_on_cuda_devices_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_with_fake_tensor_inputs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_with_inline_constraints_complex_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_with_inline_constraints_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_with_set_grad_enabled_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_export_with_wrong_inputs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_external_call_non_strict_real_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_fake_inputs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_fake_weights_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_filter_traceback_frames_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_float_conversion_from_int_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_float_conversion_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_fqn_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_from_node_metadata_export_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_full_on_scalar_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_function_holding_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_hints_wrapper_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_hoo_inline_users_issue_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_if_functional_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_if_post_autograd_op_preserved_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_inline_script_class_method_recursive_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_inline_script_class_method_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_inline_script_function_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_inline_script_method_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_int_shape_specialization_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_intermediate_shape_comp_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_is_exporting_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_is_non_negative_check_function_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_is_nonzero_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_isnonzero_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_issue_113041_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_issue_157289_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_istft_op_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_keep_composite_ops_invalid_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_keep_composite_ops_linear_convd_for_training_ir_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_keep_composite_ops_linear_convd_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_kwarg_dynamic_shapes_diff_order_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_kwargs_reorder_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_layer_norm_unbacked_normalized_shape_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_layer_sharing_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_lazy_module_kwargs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_lifted_constants_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_linear_conv_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_malformed_fqn_from_source_name_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_map_buffers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_map_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_mask_nonzero_static_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_masked_select_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_math_pow_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_mismatched_dynamic_shapes_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_mixed_input_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_module_dict_key_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_module_input_subclasses_parameterization_nested_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_module_input_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_module_list_slice_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_module_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_module_with_dict_container_inp_out_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_modules_access_for_deleted_submodule_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_more_multidimensional_slicing_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_multidimensional_slicing_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_multinomial_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_multiple_definitions_same_name_dim_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nested_dynamic_shapes_spec_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nested_module_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nested_module_with_constant_buffer_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nested_module_with_init_buffer_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nested_module_with_parameter_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nn_module_stack_shared_submodule_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nn_module_stack_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_no_check_is_size_error_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_no_suggested_fixes_for_data_dependent_errors_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_no_tensor_computation_2_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_no_tensor_computation_3_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_no_tensor_computation_4_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_no_tensor_computation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_non_arg_name_dynamic_shapes_api_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_non_arg_name_dynamic_shapes_api_with_container_type_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_non_arg_name_dynamic_shapes_api_with_kwarg_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_non_persistent_buffer_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_non_strict_dynamic_shapes_suggested_fixes_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_non_strict_dynamic_shapes_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_none_buffers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nonstrict_retrace_preserves_metadata_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nonzero_2_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_nonzero_dynamic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_not_registered_parameter_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_operator_aten_tensor_mode_variant_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_output_node_name_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_pad_sequence_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_param_util_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_partial_patched_forward_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_placeholder_naming_collisions_hoo_subgraphs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_placeholder_naming_collisions_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_placeholder_naming_order_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_placeholder_naming_order_variadic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_placeholder_update_preserving_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_predispatch_cond_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_predispatch_grad_wrappers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_preserve_module_call_signature_unflatten_specialization_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_preserve_requires_grad_placeholders_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_preserve_shape_dynamism_for_unused_inputs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_profiling_code_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_python_asserts_with_sym_int_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_pytree_register_data_class_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_pytree_register_nested_data_class_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_raise_user_error_when_guard_on_data_dependent_operation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_range_constraints_with_replacement_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_real_tensor_alias_dtype_mismatch_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_real_tensor_bool_cast_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_real_tensor_errors_on_aliasing_custom_op_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_real_tensor_for_max_op_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_real_tensor_size_mismatch_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_redundant_assert_max_upper_bound_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_redundant_asserts_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_refine_dynamic_shapes_from_suggested_fixes_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_register_constant_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_repeat_interleave_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_replace_unbacked_with_very_large_upperbound_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_replaced_unbacked_bindings_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_reshape_view_helper_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_retracable_ep_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_retrace_pre_autograd_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_run_decomposition_supports_user_input_mutation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_run_decompositions_keep_metadata_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_run_decompositions_keep_tensor_constant_metadata_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_runtime_assert_for_prim_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_runtime_assert_for_prm_str_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_runtime_assert_with_size_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_sdpa_gqa_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_sequential_slicing_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_set_example_inputs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_set_grad_as_side_effect_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_set_grad_empty_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_set_grad_unflatten_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_setgrad_lifted_tensor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_shared_submodule_nn_module_stack_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_simple_export_for_training_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_simple_unbacked_view_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_size_input_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_slice_nn_module_stack_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_solver_unsupported_sympy_function_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_specialize_derived_dim_roots_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_split_const_gm_with_lifted_constants_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_stack_trace_make_fx_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_stack_trace_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_state_primitives_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_state_shape_attribute_assignment_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_state_tensors_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_static_dim_constraints_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_subclass_nested_attr_access_complicated_metadata_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_subclass_nested_attr_access_const_metadata_not_top_level_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_subclass_nested_attr_access_const_metadata_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_subclass_nested_attr_access_submodule_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_subclass_nested_attr_access_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_subclasses_parameterization_nested_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_subclasses_parameterization_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_suggest_torch_checks_with_non_negative_check_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_suggest_torch_checks_with_regular_check_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_suggested_fixes_for_data_dependent_errors_basic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_suggested_fixes_for_data_dependent_errors_puzzlers_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_suggested_fixes_new_roots_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_sym_float_operators_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_sym_or_sym_and_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_sym_sqrt_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symbool_item_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symfloat_item_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_input_additional_inputs_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_input_basic_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_input_ranges_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_input_shapes_collection_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_input_specialization_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_item_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_output_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_symint_tensor_return_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_tensor_attribute_zero_args_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_tensor_constant_aten_to_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_tensor_constant_with_wrapped_method_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_to_module_with_mutated_buffer_multiple_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_to_module_with_mutated_buffer_multiple_update_sub_later_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_to_module_with_mutated_buffer_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_tolist_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_torch_check_eq_commutativity_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_torch_fn_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_trace_under_fake_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_train_eval_on_exported_preautograd_module_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_3d_matmul_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_bincount_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_bindings_for_divisible_u_symint_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_deferred_runtime_retrace_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_expand_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_infer_size_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_kth_value_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_linear_layer_norm_input_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_noncontig_lin_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_pad_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_scalar_constructor_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_slice_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_to_cond_passthrough_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_to_cond_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unbacked_unsqueeze_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_asserts_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_buffer_update_child2parent_swap_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_closure_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_isinstance_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_multiple_graphs_dispatch_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_multiple_graphs_preserve_signature_no_error_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_multiple_graphs_shared_submodule_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_multiple_graphs_state_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_no_unroll_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_placeholder_update_child2parent_swap_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_placeholder_update_grandchild2cousin_swap_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_5_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_6_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_buf_8_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_const_preserving_3_1_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_const_preserving_3_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_4_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_6_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_9_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_preserving_10_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_preserving_4_1_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_preserving_4_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_preserving_5_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_mutating_buf_preserving_7_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unflatten_random_dag_preserving_4_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unused_aliases_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_unused_constant_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_use_embedding_twice_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_user_input_and_buffer_mutation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_vmap_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_while_loop_assert_separation_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_while_loop_index_assertions_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_while_loop_simple_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_while_loop_tensor_constant_idx_training_ir_to_decomp_nonstrict, test/export/test_export_training_ir_to_run_decomp.py::TrainingIRToRunDecompExportNonStrictTestExport::test_wrapper_module_training_ir_to_decomp_nonstrict 2025-09-07T07:05:08.6741656Z 2025-09-07T07:05:08.6741747Z Running functorch/test_ac 1/1 ... [2025-09-07 07:05:08.637800] 2025-09-07T07:05:08.6741922Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:05:08.6747620Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'functorch/test_ac.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:05:08.638139] 2025-09-07T07:05:14.6755405Z 2025-09-07T07:05:14.6756307Z functorch/test_ac 1/1 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_ac_1.1_4913afe80e81a738_.log 2025-09-07T07:05:14.6756567Z 2025-09-07T07:05:14.6759039Z Running functorch/test_ops 2/4 ... [2025-09-07 07:05:14.675638] 2025-09-07T07:05:14.6759218Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:05:14.6761510Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'functorch/test_ops.py', '--shard-id=2', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:05:14.675947] 2025-09-07T07:13:16.0902557Z 2025-09-07T07:13:16.0903451Z functorch/test_ops 2/4 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_ops_2.4_f8753151da5e448a_.log 2025-09-07T07:13:16.1225177Z Running 2549 items in this shard: test/functorch/test_ops.py::TestOperatorsCUDA::test_extremal_numerics_binary_cross_entropy_cuda, test/functorch/test_ops.py::TestOperatorsCUDA::test_extremal_numerics_log_softmax_cuda, test/functorch/test_ops.py::TestOperatorsCUDA::test_extremal_numerics_nll_loss_cuda, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_ForwardHasDefaultArgsAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_MulGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_ZeroGradientsGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad___rmul___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad__native_batch_norm_legit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad__segment_reduce_offsets_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad__unsafe_masked_index_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad__upsample_bilinear2d_aa_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_abs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_argmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_argsort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_asin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_atanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_bool_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_bool_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_broadcast_shapes_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_byte_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_byte_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_cat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_cauchy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_cdouble_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_chalf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_combinations_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_cos_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_diagflat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_diagonal_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_dist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_double_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_dstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_empty_permuted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_exp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_expand_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_expand_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_expand_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_expm1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_fft_fft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_fft_fftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_fft_fftshift_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_fft_ifft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_fft_irfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_fft_rfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_frexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_gather_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_half_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_hsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_hypot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_igamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_index_put_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_index_reduce_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_index_reduce_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_inner_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_int_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_isclose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_isfinite_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_isin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_isneginf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_item_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_jiterator_binary_return_by_ref_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_kthvalue_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_cross_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_eig_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_eigvalsh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_lstsq_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_pinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_solve_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_solve_triangular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_tensorsolve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_linalg_vector_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_log_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_logdet_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_logical_not_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_logical_xor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_logsumexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_long_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_masked_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_masked_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_masked_normalize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_masked_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_matrix_exp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_max_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_max_pool2d_with_indices_backward_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_minimum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_mm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_movedim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_mul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_multinomial_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_mv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_mvlgamma_mvlgamma_p_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nanmedian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nanquantile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_ne_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_new_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_new_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_adaptive_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_binary_cross_entropy_with_logits_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_channel_shuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_conv2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_conv2d_stride_depthwise_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_conv2d_stride_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_conv2d_strided_padding_dilation_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_conv3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_conv_transpose1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_cosine_embedding_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_cross_entropy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_fractional_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_gelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_grid_sample_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_hardsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_huber_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_instance_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_interpolate_bicubic_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_interpolate_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_logsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_max_unpool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_max_unpool2d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_max_unpool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_mse_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_multilabel_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_normalize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_pad_constant_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_pad_replicate_negative_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_pdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_poisson_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_prelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_tanhshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_upsample_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_nn_functional_upsample_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_norm_fro_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_ormqr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_randint_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_real_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_remainder_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_repeat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_reshape_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_round_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_round_decimals_0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_round_decimals_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_rsub_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_scalar_tensor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_sgn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_signal_windows_general_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_special_chebyshev_polynomial_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_special_chebyshev_polynomial_v_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_special_chebyshev_polynomial_w_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_special_legendre_polynomial_p_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_special_shifted_chebyshev_polynomial_u_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_special_shifted_chebyshev_polynomial_w_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_split_list_args_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_std_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_stft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_sub_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_sum_to_size_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_svd_lowrank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_torch_ops_aten__efficient_attention_forward_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_trace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_transpose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_triangular_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_tril_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_unbind_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_unbind_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_unflatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_unique_consecutive_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_unsqueeze_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_var_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_vdot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_view_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_where_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_grad_xlogy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_ForwardHasDefaultArgsAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_ScaleGradGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_ZeroGradientsGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp__chunk_cat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp__softmax_backward_data_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp__upsample_bilinear2d_aa_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_addr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_argmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_argsort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_as_strided_partial_views_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_bfloat16_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_broadcast_to_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_byte_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cauchy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cfloat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cholesky_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_conj_physical_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cov_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_cumulative_trapezoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_diag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_diagonal_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_diff_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_div_floor_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_div_trunc_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_empty_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_expand_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_expand_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fft_hfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fft_ifft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fft_ifftshift_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fft_ihfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fft_ihfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fft_irfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fft_rfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_flatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_flip_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_fmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_frexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_full_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_ge_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_gradient_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_grid_sampler_2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_histc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_index_fill_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_index_reduce_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_index_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_isfinite_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_isnan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_isneginf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_isposinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_jiterator_2inputs_2outputs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_cholesky_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_eigvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_eigvalsh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_householder_product_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_lu_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_matrix_rank_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_norm_subgradients_at_zero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_qr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linalg_svdvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_linspace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_log_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_log_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_log_softmax_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_logaddexp2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_mH_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_masked_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_masked_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_masked_normalize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_masked_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_masked_std_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_matmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_matrix_exp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_meshgrid_list_of_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_min_reduction_no_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_min_reduction_with_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_mul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_mvlgamma_mvlgamma_p_5_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nanmean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_native_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_ne_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_new_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_adaptive_avg_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_adaptive_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_alpha_dropout_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_avg_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_conv2d_stride_groups_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_conv2d_stride_padding_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_conv2d_stride_padding_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_conv2d_stride_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_conv2d_strided_padding_dilation_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_conv_transpose2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_cross_entropy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_fractional_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_grid_sample_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_hinge_embedding_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_interpolate_nearest-exact_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_interpolate_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_l1_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_max_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_max_unpool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_max_unpool3d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_mse_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_pad_constant_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_pad_replicate_negative_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_pairwise_distance_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_pixel_shuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_prelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_silu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_softshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_threshold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nn_functional_upsample_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_nonzero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_norm_inf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_norm_nuc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_normal_in_place_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_ops_aten_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_ormqr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_permute_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_pow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_quantile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_real_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_reshape_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_reshape_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_rot90_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_round_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_scatter_reduce_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_scatter_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_scatter_reduce_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_select_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_sgn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_short_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_sigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_sign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_signal_windows_gaussian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_signal_windows_general_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_signal_windows_hann_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_softmax_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_special_bessel_j0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_special_bessel_j1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_special_chebyshev_polynomial_w_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_special_modified_bessel_k0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_special_ndtri_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_special_scaled_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_split_with_sizes_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_sqrt_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_std_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_std_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_svd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_t_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_to_sparse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_tril_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_unflatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_unsafe_chunk_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_unsafe_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_var_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_var_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_var_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_view_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_view_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvp_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpjvpvmap_NumpyCubeNotComposableAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpjvpvmap_NumpyExpMarkDirtyAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpjvpvmap_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_CubeGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_NumpyTakeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp___getitem___functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_addbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_addcmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_addmv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_addr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_aminmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_argsort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_as_strided_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_atan2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_atleast_1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_atleast_3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_bucketize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_byte_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cartesian_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_char_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cholesky_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cholesky_inverse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_clamp_min_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_column_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_conj_physical_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_constant_pad_nd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_corrcoef_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cos_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_count_nonzero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cross_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cummin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_deg2rad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_diagonal_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_dsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_dstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_einsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_empty_permuted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_erf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_erfc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_erfinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_expand_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_expand_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_fft_fftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_fft_hfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_fft_rfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_fft_rfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_float_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_float_power_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_floor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_fmod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_full_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_grid_sampler_2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_igammac_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_index_reduce_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_isin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_jiterator_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_jiterator_binary_return_by_ref_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_lerp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_cross_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_eig_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_lstsq_grad_oriented_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_lu_factor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_lu_factor_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_matrix_rank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_linalg_svd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_log10_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_log_softmax_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_logspace_tensor_overload_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_long_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_long_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_mT_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_masked_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_masked_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_masked_fill_functorch_Scalar_only_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_masked_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_masked_normalize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_masked_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_masked_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_max_pool2d_with_indices_backward_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_meshgrid_variadic_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_min_reduction_with_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_msort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_mul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_narrow_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_new_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nextafter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_adaptive_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_adaptive_max_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_adaptive_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_celu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_conv1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_conv2d_stride_groups_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_conv2d_stride_padding_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_conv2d_stride_padding_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_conv3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_conv_transpose2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_cosine_similarity_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_ctc_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_dropout2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_elu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_embedding_bag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_embedding_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_gaussian_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_gelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_glu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_hardsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_interpolate_bicubic_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_interpolate_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_interpolate_nearest-exact_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_interpolate_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_interpolate_trilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_kl_div_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_l1_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_logsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_margin_ranking_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_max_unpool1d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_max_unpool3d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_mse_loss_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_pad_circular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_prelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_scaled_dot_product_attention_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_selu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_softmin_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_nn_functional_softplus_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_norm_fro_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_polygamma_polygamma_n_0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_pow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_real_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_repeat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_repeat_interleave_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_round_decimals_0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_round_decimals_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_round_decimals_neg_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_rsqrt_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_scatter_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_scatter_reduce_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_sgn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_sigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_sign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_signal_windows_hamming_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_signbit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_sinc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_sort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_airy_ai_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_hermite_polynomial_h_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_i1e_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_laguerre_polynomial_l_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_modified_bessel_i1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_modified_bessel_k0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_polygamma_special_polygamma_n_0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_scaled_modified_bessel_k0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_scaled_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_shifted_chebyshev_polynomial_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_special_zeta_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_split_list_args_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_square_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_std_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_std_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_stft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_tanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_tensordot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_tile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_transpose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_trapezoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_trunc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_unflatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_var_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_view_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_zero__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjp_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjpvmap_CubeGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjpvmap_NumpyCubeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjpvmap_NumpyExpMarkDirtyAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjpvmap_ScaleGradGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvjpvmap_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvmap_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvmap_ScaleGradGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvmap_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvmapvmap_SelectAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_jvpvmapvmap_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_bool_raises_argmin_cuda_bool, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_amin_cuda_complex128, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_amin_cuda_complex64, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_argmin_cuda_complex128, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_argmin_cuda_complex64, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_clamp_cuda_complex128, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_clamp_cuda_complex32, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_gt_cuda_complex32, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_le_cuda_complex128, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_le_cuda_complex64, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_maximum_cuda_complex32, test/functorch/test_ops.py::TestOperatorsCUDA::test_ordered_complex_raises_sort_cuda_complex128, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_T_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_broadcast_to_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_conj_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_contiguous_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_diagonal_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_list_return_dsplit_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_list_return_split_list_args_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_list_return_split_list_args_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_permute_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_real_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_reshape_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_resolve_neg_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_select_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_squeeze_multiple_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_unflatten_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_view_as_complex_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_view_as_grad_op_jvp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_view_then_inplace_view_as_grad_op_vjp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_ForwardHasDefaultArgsAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_ScaleGradGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_T_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_ZeroGradientsGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp__native_batch_norm_legit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp__unsafe_masked_index_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp__upsample_bilinear2d_aa_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_abs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_acosh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_allclose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_aminmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_arange_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_as_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_as_strided_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_asin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_baddbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_bool_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_byte_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_cholesky_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_cholesky_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_conj_physical_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_constant_pad_nd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_copysign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_cos_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_diagflat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_diagonal_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_diagonal_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_div_floor_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_einsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_erfc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_expand_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_fft_fft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_fft_fftshift_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_fft_ifft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_fft_rfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_flipud_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_fmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_frac_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_gather_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_ge_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_grid_sampler_3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_half_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_index_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_isnan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_isneginf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_jiterator_4inputs_with_extra_args_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_lgamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_linalg_cond_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_linalg_eig_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_linalg_eigvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_linalg_matrix_rank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_linalg_matrix_rank_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_linalg_multi_dot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_linalg_qr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_log10_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_log2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_logaddexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_logdet_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_logit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_masked_log_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_masked_logaddexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_masked_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_masked_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_masked_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_masked_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_masked_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_max_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_maximum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_mul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_mvlgamma_mvlgamma_p_5_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nansum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_narrow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_native_layer_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_new_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nextafter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_adaptive_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_adaptive_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_adaptive_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_alpha_dropout_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_celu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_conv2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_conv2d_stride_groups_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_conv2d_strided_padding_dilation_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_cosine_similarity_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_ctc_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_dropout_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_embedding_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_fractional_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_gaussian_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_gelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_glu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_group_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_hardsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_hardswish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_hardtanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_interpolate_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_interpolate_trilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_margin_ranking_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_max_unpool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_mish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_multilabel_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_pad_constant_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_pad_replicate_negative_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_poisson_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_smooth_l1_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_upsample_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_nn_functional_upsample_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_norm_fro_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_norm_nuc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_pca_lowrank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_polygamma_polygamma_n_4_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_pow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_put_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_qr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_randn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_repeat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_reshape_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_resize__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_roll_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_round_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_scatter_reduce_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_scatter_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_sgn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_short_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_sparse_sampled_addmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_special_hermite_polynomial_h_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_special_hermite_polynomial_he_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_special_ndtri_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_special_shifted_chebyshev_polynomial_u_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_special_shifted_chebyshev_polynomial_w_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_stft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_sum_to_size_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_to_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_torch_ops_aten__safe_softmax_default_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_trace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_transpose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_triangular_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_triu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_unbind_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_unbind_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_uniform_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_unique_consecutive_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_var_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_view_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_where_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjp_zero__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_NumpyCubeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_NumpyCubeNotComposableAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_NumpySortAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_ScaleGradGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_SelectAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp___getitem___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp___rdiv___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp___rmatmul___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp__unsafe_masked_index_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_addcmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_addr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_alias_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_angle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_argmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_argwhere_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_as_strided_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_atan2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_block_diag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_bucketize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_char_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_constant_pad_nd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_cos_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_deg2rad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_diag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_diagonal_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_dstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_empty_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_erfc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_exp2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_eye_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_fft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_hfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_ifft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_ifftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_ifftshift_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_ihfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_ihfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fft_irfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_fill_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_flatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_flip_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_full_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_geqrf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_gradient_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_grid_sampler_3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_half_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_hash_tensor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_heaviside_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_index_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_index_put_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_index_reduce_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_index_reduce_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_inner_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_int_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_isfinite_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_isneginf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_item_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_jiterator_4inputs_with_extra_args_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_le_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_cholesky_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_inv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_ldl_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_lu_factor_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_matrix_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_qr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_tensorinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_linalg_vector_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_log1p_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_log_softmax_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_logaddexp2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_logaddexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_logical_or_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_logit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_logsumexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_long_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_long_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_lu_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_masked_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_masked_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_masked_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_masked_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_matmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_matrix_exp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_max_reduction_no_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_meshgrid_list_of_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_min_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_mm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_mode_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_msort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_multinomial_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_mv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_mvlgamma_mvlgamma_p_1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nansum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_native_layer_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_new_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nextafter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_adaptive_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_adaptive_max_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_adaptive_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_adaptive_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_conv2d_stride_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_conv2d_stride_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_conv2d_strided_padding_dilation_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_conv_transpose3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_dropout2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_dropout_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_embedding_bag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_grid_sample_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_hardswish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_hardtanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_instance_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_interpolate_area_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_interpolate_bicubic_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_interpolate_nearest-exact_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_layer_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_max_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_max_unpool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_max_unpool2d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_max_unpool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_max_unpool3d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_multi_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_pdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_pixel_unshuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_relu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_softplus_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_threshold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_nn_functional_unfold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_norm_fro_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_norm_inf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_outer_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_polygamma_polygamma_n_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_pow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_reshape_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_resolve_conj_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_resolve_neg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_roll_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_rsub_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_scatter_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_select_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_signal_windows_kaiser_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_signbit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_sinc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_sinh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_airy_ai_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_bessel_j0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_bessel_j1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_bessel_y0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_bessel_y1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_chebyshev_polynomial_u_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_chebyshev_polynomial_v_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_hermite_polynomial_h_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_hermite_polynomial_he_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_special_i1e_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_squeeze_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_std_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_t_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_take_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_to_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_trapz_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_triangular_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_triu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_unsafe_chunk_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_var_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_vdot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_where_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_xlogy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjp_zeros_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjpvmap_CubeGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjpvmap_NumpyTakeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjpvmap_SelectAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvjpvmap_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_ForwardHasDefaultArgsAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_H_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_NumpySortAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap___radd___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap___rdiv___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap__upsample_bilinear2d_aa_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_addbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_any_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_argmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_as_strided_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_atanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_broadcast_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_byte_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_cdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_cfloat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_char_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_clamp_max_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_conj_physical_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_cummin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_diag_embed_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_diagonal_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_diagonal_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_div_floor_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_dot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_dstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_eq_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_erfinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fft_hfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fft_hfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fft_ihfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fft_irfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fft_rfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fill_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_fmod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_frac_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_frexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_geometric_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_geqrf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_grid_sampler_2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_hash_tensor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_i0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_igamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_index_put_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_index_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_isinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_isreal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_jiterator_2inputs_2outputs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_jiterator_unary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_kthvalue_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_ldexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_ldl_factor_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_lu_factor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_matrix_rank_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_multi_dot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_pinv_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_solve_triangular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_svdvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_linalg_tensorsolve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_log_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_log_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_logaddexp2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_logical_not_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_logit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_logspace_tensor_overload_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_masked_std_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_matrix_exp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_min_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_minimum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nanquantile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_narrow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_new_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_new_full_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_new_ones_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nextafter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_adaptive_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_celu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_channel_shuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_conv2d_stride_depthwise_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_conv2d_stride_padding_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_conv2d_stride_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_group_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_interpolate_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_l1_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_local_response_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_margin_ranking_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_max_unpool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_mse_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_pad_constant_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_pairwise_distance_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_relu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_softshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_tanhshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_nn_functional_triplet_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_norm_inf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_ops_aten__new_zeros_with_same_feature_meta_functorchonly_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_permute_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_polar_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_polygamma_polygamma_n_2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_polygamma_polygamma_n_4_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_quantile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_reciprocal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_reshape_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_reshape_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_resize__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_resolve_neg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_round_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_scatter_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_scatter_reduce_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_scatter_reduce_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_short_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_short_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_sin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_sinc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_sinh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_slice_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_sparse_mm_reduce_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_special_bessel_j0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_special_bessel_y0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_special_bessel_y1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_special_chebyshev_polynomial_u_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_special_i0e_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_special_modified_bessel_i1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_split_with_sizes_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_squeeze_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_std_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_sum_to_size_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_tensordot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_to_sparse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_tril_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_unbind_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_unsafe_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_unsqueeze_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_var_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_var_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_view_as_complex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_view_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_view_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmap_where_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmapvmap_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vjpvmapvmap_SelectAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_ForwardHasDefaultArgsAutogradFunction_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_NumpyCubeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_NumpyExpMarkDirtyAutogradFunction_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_NumpyTakeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_T_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_ZeroGradientsGenVmapAutogradFunction_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad___radd___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad___rdiv___cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad___rpow___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__batch_norm_with_update_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__native_batch_norm_legit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__native_batch_norm_legit_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__segment_reduce_lengths_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__segment_reduce_offsets_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__segment_reduce_offsets_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__unsafe_masked_index_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad__unsafe_masked_index_put_accumulate_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_abs_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_addbmm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_addcdiv_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_addmm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_addmm_decomposed_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_addr_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_alias_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_amin_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_aminmax_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_any_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_as_strided_copy_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_asinh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_atleast_1d_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_atleast_2d_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_baddbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_bfloat16_functorch_no_channels_last_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_block_diag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_bmm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_bool_functorch_no_channels_last_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_broadcast_tensors_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_byte_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_ceil_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_ceil_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_cfloat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_char_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_clamp_max_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_clone_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_column_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_combinations_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_complex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_conj_physical_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_cos_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_cross_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_diag_embed_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_diagonal_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_diff_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_div_no_rounding_mode_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_dot_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_double_functorch_no_channels_last_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_dstack_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_einsum_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_empty_permuted_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_eq_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_equal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_erf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_erfinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_exp2_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_exp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_expand_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_expm1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_exponential_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_fft2_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_fft_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_fftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_fftn_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_hfftn_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_ifft2_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_ifft_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_ifftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_ihfft_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_ihfftn_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_irfftn_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fft_rfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_flatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_flatten_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fliplr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_float_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_fmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_frexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_full_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_geometric_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_geqrf_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_gradient_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_gt_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_half_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_heaviside_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_histc_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_hstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_i0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_index_copy_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_index_reduce_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_index_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_inner_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_int_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_isin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_isinf_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_isnan_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_isreal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_jiterator_2inputs_2outputs_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_jiterator_unary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_kron_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_le_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_lgamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_cholesky_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_cholesky_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_eig_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_eigvalsh_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_ldl_factor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_ldl_factor_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_lstsq_grad_oriented_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_lu_solve_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_multi_dot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_multi_dot_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_pinv_hermitian_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_solve_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_svd_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_tensorinv_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_tensorsolve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_tensorsolve_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_linalg_vecdot_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_log1p_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_log2_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_log_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_log_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_log_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_logaddexp2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_logical_not_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_logical_xor_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_long_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_lu_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_mH_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_mT_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_cumprod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_fill_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_fill_functorch_Scalar_only_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_logaddexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_logaddexp_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_mean_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_norm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_masked_sum_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_matmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_matmul_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_max_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_max_binary_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_median_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_meshgrid_list_of_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_meshgrid_variadic_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_min_reduction_no_dim_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_minimum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_minimum_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_msort_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_multinomial_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_mv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_mvlgamma_mvlgamma_p_1_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nan_to_num_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nanmean_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nanmedian_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nansum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_native_layer_norm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_new_zeros_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_adaptive_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_adaptive_avg_pool1d_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_adaptive_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_adaptive_avg_pool3d_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_alpha_dropout_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_avg_pool2d_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_avg_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_batch_norm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_stride_depthwise_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_stride_depthwise_with_bias_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_stride_groups_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_stride_no_bias_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_stride_padding_no_bias_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_stride_padding_with_bias_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_strided_padding_dilation_with_bias_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv2d_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_conv3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_cosine_embedding_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_ctc_loss_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_dropout3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_dropout3d_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_embedding_bag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_feature_alpha_dropout_without_train_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_fractional_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_fractional_max_pool2d_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_fractional_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_gelu_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_grid_sample_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_grid_sample_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_group_norm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_hardshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_hardshrink_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_hardswish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_interpolate_bicubic_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_interpolate_trilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_kl_div_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_local_response_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_max_unpool1d_grad_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_multi_head_attention_forward_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_multi_margin_loss_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_multilabel_soft_margin_loss_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_normalize_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_pad_replicate_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_pad_replicate_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_pixel_unshuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_pixel_unshuffle_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_rrelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_selu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_softplus_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_threshold_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_triplet_margin_with_distance_loss_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nn_functional_upsample_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nonzero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_nonzero_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_norm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_normal_in_place_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_normal_in_place_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_ones_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_ops_aten__new_zeros_with_same_feature_meta_functorchonly_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_ormqr_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_pca_lowrank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_pca_lowrank_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_pinverse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_pinverse_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_polar_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_polar_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_polygamma_polygamma_n_0_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_polygamma_polygamma_n_2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_positive_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_put_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_qr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_randint_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_randn_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_reciprocal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_remainder_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_repeat_interleave_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_reshape_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_resolve_neg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_roll_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_roll_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_round_decimals_0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_round_decimals_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_scatter_reduce_sum_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_select_scatter_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_short_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_short_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_short_functorch_no_channels_last_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sign_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signal_windows_gaussian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signal_windows_general_hamming_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signal_windows_general_hamming_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signal_windows_hamming_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signal_windows_hann_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signal_windows_hann_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signal_windows_nuttall_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_signbit_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sinc_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sinh_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_slice_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_slice_scatter_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_softmax_with_dtype_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sparse_mm_reduce_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sparse_sampled_addmm_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_airy_ai_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_bessel_j0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_bessel_j0_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_bessel_j1_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_bessel_y1_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_chebyshev_polynomial_u_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_chebyshev_polynomial_v_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_i0e_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_i1_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_laguerre_polynomial_l_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_laguerre_polynomial_l_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_legendre_polynomial_p_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_log_ndtr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_modified_bessel_i1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_modified_bessel_i1_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_modified_bessel_k0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_modified_bessel_k0_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_modified_bessel_k1_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_ndtri_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_ndtri_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_polygamma_special_polygamma_n_0_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_shifted_chebyshev_polynomial_u_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_shifted_chebyshev_polynomial_u_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_shifted_chebyshev_polynomial_w_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_special_xlog1py_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_split_with_sizes_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_square_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_std_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_std_mean_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_std_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_stft_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_sum_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_t_copy_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_tanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_tensordot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_tensordot_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_tile_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_torch_ops_aten__efficient_attention_forward_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_torch_ops_aten__safe_softmax_default_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_trace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_transpose_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_trapz_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_triangular_solve_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_tril_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_true_divide_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_unbind_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_unbind_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_unbind_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_unfold_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_unfold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_unsafe_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_var_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_var_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_vdot_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_view_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_vsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_vstack_cuda_float64, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmap_autograd_grad_xlogy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_NumpyCubeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_SelectAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall___getitem___functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall___rdiv___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall___rmatmul___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall___rmod___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall___rsub___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_addcdiv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_addcmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_addmv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_addr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_angle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_arange_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_argmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_argsort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_asinh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_atleast_1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_atleast_2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_atleast_3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_bernoulli_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_bfloat16_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_broadcast_to_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_cartesian_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_cauchy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_cfloat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_clamp_min_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_clone_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_column_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_complex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_constant_pad_nd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_copysign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_corrcoef_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_cosh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_cross_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_diagflat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_diagonal_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_dist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_div_no_rounding_mode_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_div_trunc_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_double_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_double_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_dstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_empty_permuted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_exp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_fft_hfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_fft_hfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_fft_ifftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_fft_ihfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_fft_rfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_fill_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_flip_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_float_power_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_floor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_fmod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_frac_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_gather_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_geometric_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_geqrf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_half_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_NumpyCubeNotComposableAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule__softmax_backward_data_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule__unsafe_masked_index_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule__unsafe_masked_index_put_accumulate_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_addcdiv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_argmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_argsort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_as_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_asin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_baddbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_bernoulli_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_bfloat16_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_bmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_bool_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_bucketize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cartesian_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cdouble_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cholesky_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_clamp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_column_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_conj_physical_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_contiguous_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cosh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cov_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cross_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cummin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_div_trunc_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_double_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_dsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_empty_permuted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_eye_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fft_hfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fft_hfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fft_ifft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fft_ifftshift_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fft_ihfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fft_rfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_flip_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_flipud_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_float_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_fmod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_frexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_full_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_full_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_hash_tensor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_index_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_index_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_inner_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_int_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_isclose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_jiterator_binary_return_by_ref_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_kthvalue_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_le_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_eigvalsh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_lu_factor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_matrix_rank_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_norm_subgradients_at_zero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_pinv_singular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_slogdet_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_svdvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_tensorinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_linalg_vander_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_log2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_log_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_logdet_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_logical_not_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_lu_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_masked_fill_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_masked_fill_functorch_Scalar_only_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_masked_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_masked_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_masked_var_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_mul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_mv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_mvlgamma_mvlgamma_p_5_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_narrow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_native_layer_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_new_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_adaptive_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_alpha_dropout_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_avg_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_binary_cross_entropy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_conv2d_stride_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_conv3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_ctc_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_embedding_bag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_embedding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_feature_alpha_dropout_without_train_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_glu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_grid_sample_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_hardswish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_hardtanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_hinge_embedding_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_interpolate_nearest-exact_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_interpolate_trilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_kl_div_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_margin_ranking_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_max_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_max_unpool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_multi_head_attention_forward_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_pad_circular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_pad_replicate_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_pdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_rms_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nn_functional_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_nonzero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_norm_inf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_norm_nuc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_ones_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_pinverse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_polygamma_polygamma_n_4_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_put_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_rand_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_repeat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_resolve_conj_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_scatter_reduce_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_signal_windows_bartlett_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_signal_windows_blackman_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_signal_windows_gaussian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_signal_windows_kaiser_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_signal_windows_nuttall_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_slice_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_sparse_mm_reduce_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_special_chebyshev_polynomial_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_special_chebyshev_polynomial_u_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_special_i1e_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_special_modified_bessel_i0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_special_scaled_modified_bessel_k0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_split_list_args_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_split_with_sizes_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_split_with_sizes_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_squeeze_multiple_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_std_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_std_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_trace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_triangular_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_unbind_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_unique_consecutive_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_unique_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_unsqueeze_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_var_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_view_as_complex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_has_batch_rule_where_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_hsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_hstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_index_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_index_reduce_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_index_reduce_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_index_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_isfinite_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_isposinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_jiterator_binary_return_by_ref_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_kthvalue_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_lerp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_lgamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_eigvalsh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_lstsq_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_matrix_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_norm_subgradients_at_zero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_qr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_solve_triangular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_svd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linalg_svdvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linspace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_linspace_tensor_overload_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_log1p_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_log_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_log_softmax_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_logaddexp2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_logical_or_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_logical_xor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_logspace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_masked_logsumexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_masked_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_masked_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_masked_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_masked_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_masked_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_max_reduction_no_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_meshgrid_list_of_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_min_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_mvlgamma_mvlgamma_p_1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nan_to_num_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nansum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_native_layer_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_new_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_new_full_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_new_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nextafter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_adaptive_max_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_adaptive_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_adaptive_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_batch_norm_without_cudnn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_binary_cross_entropy_with_logits_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_conv2d_stride_padding_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_conv_transpose3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_cosine_similarity_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_dropout_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_embedding_bag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_gaussian_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_glu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_instance_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_interpolate_bicubic_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_interpolate_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_interpolate_trilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_l1_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_leaky_relu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_linear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_max_unpool3d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_mse_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_pad_constant_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_pad_reflect_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_pixel_unshuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_prelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_rms_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_nn_functional_triplet_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_normal_in_place_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_ops_aten__new_zeros_with_same_feature_meta_functorchonly_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_ops_aten_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_polygamma_polygamma_n_4_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_rand_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_randint_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_randn_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_reshape_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_resize__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_round_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_rsqrt_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_scatter_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_sign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_signal_windows_gaussian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_signal_windows_nuttall_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_slice_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_special_airy_ai_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_special_bessel_y1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_special_hermite_polynomial_he_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_special_ndtri_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_special_scaled_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_special_xlog1py_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_square_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_squeeze_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_squeeze_multiple_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_stft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_tan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_triangular_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_unbind_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_unfold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_var_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_var_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_vdot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpall_view_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_NumpyCubeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_NumpyCubeNotComposableAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_NumpySortAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_ZeroGradientsGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp___radd___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp___rmul___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp__segment_reduce_offsets_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_abs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_acosh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_all_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_as_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_asin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_atan2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_atleast_2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_bernoulli_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_bfloat16_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_broadcast_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_cartesian_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_cdouble_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_char_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_char_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_chunk_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_clamp_max_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_column_stack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_combinations_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_constant_pad_nd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_contiguous_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_copysign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_cov_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_cummin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_diag_embed_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_digamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_div_no_rounding_mode_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_div_trunc_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_dot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_dsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_einsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_erfc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_erfinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_expand_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_expand_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_expm1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_exponential_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_eye_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_fft_ifftshift_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_fft_ihfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_fft_rfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_flip_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_float_power_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_floor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_frac_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_geqrf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_grid_sampler_2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_heaviside_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_hsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_isinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_isnan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_isneginf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_isreal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_jiterator_2inputs_2outputs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_cond_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_eigvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_householder_product_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_ldl_factor_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_lstsq_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_lu_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_svd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_linalg_vander_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_log_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_log_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_log_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_logdet_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_logical_xor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_logit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_logspace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_logsumexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_long_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_lu_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_lu_unpack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_masked_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_masked_fill_functorch_Scalar_only_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_masked_log_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_masked_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_masked_normalize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_masked_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_masked_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_max_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_minimum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_msort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_mv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nan_to_num_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nanquantile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_narrow_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_narrow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_native_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_native_dropout_backward_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_neg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_new_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_new_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_adaptive_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_adaptive_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_binary_cross_entropy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_channel_shuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_conv2d_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_conv2d_stride_padding_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_conv2d_strided_padding_dilation_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_conv2d_strided_padding_dilation_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_cosine_similarity_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_embedding_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_fractional_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_gelu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_hardswish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_huber_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_instance_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_interpolate_area_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_interpolate_nearest-exact_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_interpolate_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_interpolate_trilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_layer_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_logsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_max_unpool2d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_multi_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_multilabel_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_pad_replicate_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_pdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_pixel_unshuffle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_relu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_rms_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_silu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_softplus_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_nn_functional_tanhshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_norm_inf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_norm_nuc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_normal_number_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_ones_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_ones_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_ops_aten_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_outer_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_polygamma_polygamma_n_1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_polygamma_polygamma_n_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_put_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_randn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_real_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_reciprocal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_reshape_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_resolve_conj_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_rsqrt_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_scalar_tensor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_scatter_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_scatter_reduce_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_select_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_sgn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_short_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_sign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_signal_windows_exponential_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_signal_windows_gaussian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_signal_windows_nuttall_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_sin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_sinc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_sinh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_special_airy_ai_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_special_bessel_y0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_special_entr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_special_i1e_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_special_log_ndtr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_special_shifted_chebyshev_polynomial_v_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_split_with_sizes_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_squeeze_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_squeeze_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_std_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_svd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_torch_ops_aten__efficient_attention_forward_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_transpose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_trapz_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_triangular_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_unfold_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_uniform_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_var_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_vdot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_view_as_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_view_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_vsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvjp_where_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvmap_ForwardHasDefaultArgsAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvmap_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvmap_NumpySortAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvmap_NumpyTakeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapjvpvmap_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_NumpyCubeNotComposableAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp___rmod___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp___rmul___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp___rsub___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp__batch_norm_with_update_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_abs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_acosh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_addr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_aminmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_argsort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_as_strided_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_as_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_atleast_3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_baddbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_bmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_bool_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_broadcast_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_cauchy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_cdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_ceil_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_chalf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_cholesky_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_cholesky_inverse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_clamp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_combinations_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_corrcoef_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_cummin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_deg2rad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_diff_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_dist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_div_floor_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_div_trunc_rounding_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_empty_permuted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_equal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_erfc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_expand_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_expm1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fft_fft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fft_fftshift_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fft_hfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fft_ihfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fft_rfft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fft_rfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_flatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_flipud_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_float_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_float_power_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_fmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_frac_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_gather_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_grid_sampler_2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_H_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_MulGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_NumpyCubeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_NumpySortAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_SelectAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule___radd___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule___rmod___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule___rpow___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule__unsafe_masked_index_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_acosh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_addbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_addcmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_angle_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_arange_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_as_strided_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_atleast_3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_baddbmm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_byte_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_cfloat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_char_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_cholesky_inverse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_clamp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_complex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_constant_pad_nd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_count_nonzero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_cross_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_cummax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_cumprod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_diag_embed_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_diagflat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_dist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_double_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_dstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_empty_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_equal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fft_fft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fft_fft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fft_fftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fft_hfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fft_ifftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fft_irfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_flip_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fliplr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_float_power_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_floor_divide_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_fmod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_frexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_geometric_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_gradient_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_half_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_histc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_hsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_hstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_index_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_index_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_index_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_index_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_inner_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_int_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_lgamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_cholesky_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_cross_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_eigh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_householder_product_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_inv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_lu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_matrix_rank_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_pinv_singular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linalg_tensorinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_linspace_tensor_overload_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_log2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_log_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_logaddexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_logcumsumexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_logical_not_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_long_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_masked_argmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_masked_cumprod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_masked_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_masked_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_masked_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_matmul_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_max_reduction_no_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_median_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_min_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_min_reduction_no_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_msort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_mvlgamma_mvlgamma_p_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nan_to_num_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nanmean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nanmedian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nanquantile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_new_empty_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_new_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_new_full_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_new_ones_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nextafter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_adaptive_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_adaptive_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_adaptive_max_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_avg_pool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_batch_norm_without_cudnn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_conv2d_stride_depthwise_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_conv_transpose1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_conv_transpose3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_elu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_group_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_interpolate_nearest-exact_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_local_response_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_margin_ranking_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_max_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_multilabel_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_nll_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_pad_replicate_negative_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_relu6_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_nn_functional_upsample_nearest_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_norm_nuc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_ones_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_permute_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_polygamma_polygamma_n_2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_polygamma_polygamma_n_4_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_qr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_rand_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_randint_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_randn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_renorm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_repeat_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_reshape_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_resize_as__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_roll_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_round_decimals_neg_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_rsqrt_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_scatter_reduce_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_searchsorted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_short_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_sigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_signal_windows_bartlett_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_signal_windows_hann_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_sinc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_slice_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_slice_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_sparse_mm_reduce_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_special_airy_ai_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_special_bessel_j0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_special_chebyshev_polynomial_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_special_erfcx_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_special_hermite_polynomial_h_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_special_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_special_xlog1py_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_split_with_sizes_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_sqrt_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_square_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_squeeze_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_squeeze_multiple_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_std_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_svd_lowrank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_take_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_tensordot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_tile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_to_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_torch_ops_aten__safe_softmax_default_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_trace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_unsqueeze_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_var_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_var_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_vdot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_vsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_where_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_xlogy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_zero__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_has_batch_rule_zeros_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_i0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_index_put_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_index_reduce_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_isfinite_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_isinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_isnan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_isposinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_lgamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_cholesky_ex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_cond_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_diagonal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_ldl_factor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_lu_factor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_lu_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_matrix_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_matrix_power_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_matrix_rank_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_norm_subgradients_at_zero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_solve_triangular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_svd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_svdvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_linalg_tensorinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_log_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_log_softmax_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_logaddexp2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_logspace_tensor_overload_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_logsumexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_long_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_cumsum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_fill_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_fill_functorch_Scalar_only_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_logsumexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_normalize_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_masked_softmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_max_binary_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_max_reduction_no_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_mvlgamma_mvlgamma_p_1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_mvlgamma_mvlgamma_p_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nanmean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nanquantile_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_native_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_new_ones_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nextafter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_batch_norm_without_cudnn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_conv2d_strided_padding_dilation_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_conv2d_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_conv3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_conv_transpose1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_cosine_embedding_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_embedding_bag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_glu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_interpolate_bilinear_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_l1_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_logsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_max_unpool3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_mish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_multi_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_multilabel_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_pad_circular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_pairwise_distance_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_pdist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_relu6_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_selu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_softmin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_tanhshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_threshold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nn_functional_triplet_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_nonzero_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_norm_inf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_norm_nuc_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_normal_in_place_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_ops_aten_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_ormqr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_polygamma_polygamma_n_1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_polygamma_polygamma_n_2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_polygamma_polygamma_n_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_pow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_rad2deg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_randint_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_real_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_renorm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_resolve_neg_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_round_decimals_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_round_decimals_neg_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_scatter_reduce_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_scatter_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_searchsorted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_select_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_sgn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_sigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_slice_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_sparse_mm_reduce_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_special_bessel_y1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_special_hermite_polynomial_h_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_special_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_special_polygamma_special_polygamma_n_0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_special_scaled_modified_bessel_k1_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_special_zeta_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_split_with_sizes_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_std_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_stft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_sum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_t_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_to_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_trace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_transpose_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_unbind_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_unbind_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_unsafe_chunk_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_unsafe_split_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_unsqueeze_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_view_as_complex_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_view_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjp_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_ForwardHasDefaultArgsAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_H_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_NumpyExpMarkDirtyAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_NumpySortAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_NumpyTakeAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_ScaleGradGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_SortGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_T_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp___getitem___functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp___rpow___cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp__native_batch_norm_legit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp__upsample_bilinear2d_aa_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_alias_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_allclose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_aminmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_as_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_as_strided_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_atan_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_bernoulli_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_broadcast_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_byte_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_cartesian_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_cdouble_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_cholesky_inverse_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_cholesky_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_chunk_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_clamp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_clamp_max_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_clone_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_conj_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_copysign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_diag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_dist_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_double_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_dsplit_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_dstack_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_exponential_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_fft_fft_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_fft_fftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_fft_hfftn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_fft_rfft2_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_fill_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_flatten_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_fliplr_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_flipud_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_floor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_fmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_frexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_full_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_gradient_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_half_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_igamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_index_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_index_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_index_put_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_index_reduce_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_int_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_isclose_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_isin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_isinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_isposinf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_isreal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_jiterator_2inputs_2outputs_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_kthvalue_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_ldexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_lgamma_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_eigvals_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_ldl_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_lstsq_grad_oriented_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_multi_dot_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_pinv_hermitian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_pinv_singular_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_solve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_svd_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_tensorinv_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_tensorsolve_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_vander_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linalg_vector_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_linspace_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_logical_and_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_logical_xor_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_masked_amax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_masked_argmax_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_masked_cumprod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_masked_fill_functorch_Scalar_only_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_masked_logaddexp_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_masked_mean_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_meshgrid_list_of_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_meshgrid_variadic_tensors_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_min_reduction_with_dim_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_mvlgamma_mvlgamma_p_3_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nanmedian_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nansum_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_narrow_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_native_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_new_empty_strided_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_new_ones_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_adaptive_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_adaptive_max_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_alpha_dropout_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_avg_pool1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_avg_pool2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_batch_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_celu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_conv2d_stride_groups_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_conv2d_stride_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_conv2d_stride_padding_no_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_conv2d_stride_with_bias_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_conv3d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_conv_transpose1d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_conv_transpose2d_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_cross_entropy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_ctc_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_elu_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_embedding_bag_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_embedding_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_feature_alpha_dropout_without_train_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_group_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_hardsigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_instance_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_local_response_norm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_max_unpool2d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_max_unpool3d_grad_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_mish_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_mse_loss_functorch_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_pad_constant_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_pad_reflect_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_pad_replicate_negative_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_soft_margin_loss_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_softmin_with_dtype_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_softshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_softsign_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_tanhshrink_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_nn_functional_threshold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_norm_inf_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_normal_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_ones_like_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_ops_aten__new_zeros_with_same_feature_meta_functorchonly_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_outer_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_pca_lowrank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_permute_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_prod_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_randn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_renorm_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_repeat_interleave_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_resize_as__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_rot90_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_round_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_scatter_add_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_scatter_reduce_amin_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_searchsorted_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_sgn_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_short_functorch_no_channels_last_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_sigmoid_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_signal_windows_cosine_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_signal_windows_nuttall_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_sinh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_slice_scatter_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_sort_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_special_chebyshev_polynomial_w_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_special_hermite_polynomial_he_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_special_legendre_polynomial_p_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_special_modified_bessel_i0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_special_modified_bessel_k0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_special_polygamma_special_polygamma_n_0_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_split_with_sizes_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_split_with_sizes_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_squeeze_multiple_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_std_mean_unbiased_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_svd_lowrank_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_t_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_take_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_tanh_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_topk_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_torch_ops_aten__safe_softmax_default_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_unbind_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_unbind_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_unfold_copy_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_unfold_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_uniform_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_unique_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_view_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_zero__cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvjp_zeros_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvmap_CubeGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvmap_NumpyExpMarkDirtyAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvmap_NumpyMulAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvmap_SelectGenVmapAutogradFunction_cuda_float32, test/functorch/test_ops.py::TestOperatorsCUDA::test_vmapvjpvmap_SortGenVmapAutogradFunction_cuda_float32 2025-09-07T07:13:16.1543176Z 2025-09-07T07:13:16.1543309Z Running inductor/test_async_compile 1/1 ... [2025-09-07 07:13:16.092204] 2025-09-07T07:13:16.1543523Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:13:16.1543948Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_async_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:13:16.092407] 2025-09-07T07:13:52.3721708Z 2025-09-07T07:13:52.3722352Z inductor/test_async_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_async_compile_1.1_3ff0b99c45881eaf_.log 2025-09-07T07:13:52.3723810Z Running 8 items in this shard: test/inductor/test_async_compile.py::TestAsyncCompile::test_autotune_lookup_table_method_fork, test/inductor/test_async_compile.py::TestAsyncCompile::test_autotune_lookup_table_method_spawn, test/inductor/test_async_compile.py::TestAsyncCompile::test_autotune_lookup_table_method_subprocess, test/inductor/test_async_compile.py::TestAsyncCompile::test_bad_kernel, test/inductor/test_async_compile.py::TestAsyncCompile::test_pool_method_fork, test/inductor/test_async_compile.py::TestAsyncCompile::test_pool_method_spawn, test/inductor/test_async_compile.py::TestAsyncCompile::test_pool_method_subprocess, test/inductor/test_async_compile.py::TestAsyncCompile::test_wait_pool_ready 2025-09-07T07:13:52.3724804Z 2025-09-07T07:13:52.3729192Z Running inductor/test_binary_folding 1/1 ... [2025-09-07 07:13:52.372399] 2025-09-07T07:13:52.3730276Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:13:52.3730829Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_binary_folding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:13:52.372588] 2025-09-07T07:14:37.4144190Z 2025-09-07T07:14:37.4145343Z inductor/test_binary_folding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_binary_folding_1.1_8154ecfb0a9f23fb_.log 2025-09-07T07:14:37.4148580Z Running 6 items in this shard: test/inductor/test_binary_folding.py::FreezingCpuTests::test_conv_binary_folding_cpu, test/inductor/test_binary_folding.py::FreezingCpuTests::test_conv_bn_folding_cpu, test/inductor/test_binary_folding.py::FreezingCpuTests::test_linear_binary_folding_cpu, test/inductor/test_binary_folding.py::FreezingGpuTests::test_conv_binary_folding_cuda, test/inductor/test_binary_folding.py::FreezingGpuTests::test_conv_bn_folding_cuda, test/inductor/test_binary_folding.py::FreezingGpuTests::test_linear_binary_folding_cuda 2025-09-07T07:14:37.4152577Z 2025-09-07T07:14:37.4158348Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T07:14:37.4158573Z Uploading artifacts took 0.00 seconds 2025-09-07T07:14:37.4158775Z Running inductor/test_compile_subprocess 2/2 ... [2025-09-07 07:14:37.414377] 2025-09-07T07:14:37.4158966Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:14:37.4159403Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_compile_subprocess.py', '--shard-id=2', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:14:37.414567] 2025-09-07T07:20:13.5693593Z 2025-09-07T07:20:13.5695398Z inductor/test_compile_subprocess 2/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_compile_subprocess_2.2_4c009d9c7e95f70d_.log 2025-09-07T07:20:13.5771352Z Running 443 items in this shard: test/inductor/test_compile_subprocess.py::TestSubprocess::test_async, test/inductor/test_compile_subprocess.py::GPUTests::test__dyn_quant_matmul_4bit_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test__unsafe_masked_index_put_accumulate_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_adaptive_avg_pool2d1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_adaptive_avg_pool2d_low_prec_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_adaptive_max_pool2d2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_complex4_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_complex5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_complex6_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_complex7_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_complex9_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_complex_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_const_float_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_add_const_int_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_aliased_buffer_reuse_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_allow_reuse_active_if_under_peak_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_any_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_aoti_eager_cache_hit_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_aoti_eager_dtype_device_layout_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_aoti_eager_support_str_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_aoti_eager_with_persistent_cache_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_arange1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_arange2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_arange3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_arange5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_arange6_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_argmax_argmin_with_duplicates_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_argmax_argmin_with_nan_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_argmax_min_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_as_strided_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_assert_alignment_op_name_pass_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_assert_size_stride_op_name_fail_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_async, test/inductor/test_compile_subprocess.py::GPUTests::test_avg_pool2d2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_avg_pool2d3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_avg_pool2d7_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_avg_pool2d_backward2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_avg_pool2d_backward_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_avg_pool3d_backward_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_avg_pool_errors_with_uint_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_batch_norm_2d_2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_batch_norm_2d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bfloat16_to_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bitwise3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bmm2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_add_autotune_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_default_kwargs_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int16_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int16_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int16_int64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int16_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int32_int64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int32_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int64_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int64_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int64_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int8_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int8_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int8_int64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int8_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_int8_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_uint8_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_uint8_int64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_int_uint8_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_bucketize_nd_tiling_False_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_buffer_batch_norm_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_buffer_copied_in_graph_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_builtins_round_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_builtins_round_float_ndigits_pos_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_empty_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_empty_index_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_extern_kernel_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_of_loops_and_extern_kernel_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_unbacked_empty_1d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cat_upcasting_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cauchy_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_check_stack_no_cycles_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_clamp_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_clamp_type_promotion_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_clone_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_computed_buffer_inlining_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_concat_add_inplace_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_config_option_dont_assume_alignment_cudagraphs_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_config_option_dont_assume_alignment_recompiles_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_consecutive_split_cumprod_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_consecutive_split_cumsum_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_constant_pad_2d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_constant_pad_3d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_constant_pad_nd_inplace_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_conv2d_backward_channels_last_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_conv2d_channels_last_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_conv3d_channels_last_use_block_ptr_True_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_conv_functional_bn_fuse_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_convolution2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_convolution5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_copy_non_blocking_is_pinned_use_cat_False_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_copy_non_blocking_is_pinned_use_cat_True_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cos_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cudnn_rnn_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cummin_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cumprod_zero_dim_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cumsum_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cumsum_no_mask_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_cumsum_zero_dim_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_custom_op_3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_custom_scan_op_compiled_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_custom_scan_would_split_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_deterministic_codegen_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_deterministic_codegen_on_graph_break_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_device_assert_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dist_bf16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dist_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_div1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_div5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_div6_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_div7_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_div_zero_dim_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dropout2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dropout3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dropout_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dropout_trivial_0_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_bfloat16_float16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_bfloat16_float32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_bfloat16_float64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_bfloat16_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_bfloat16_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_bfloat16_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_float16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_float32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_float64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_int64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float16_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float32_bfloat16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float32_float32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float32_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float32_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float32_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float64_float16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float64_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float64_int64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_float64_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int16_float32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int16_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int16_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int16_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int32_bfloat16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int32_float32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int32_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int32_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int32_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int32_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int64_bfloat16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int64_float16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int64_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int64_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int8_float32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int8_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_int8_int8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_uint8_float16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_uint8_float32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_uint8_float64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_dtypeview_uint8_int64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_embedding_bag_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_embedding_sparse_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_empty1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_empty2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_erfc_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_erfinv_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_expanded_reduction_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_expm1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fallback_mutable_op_basic_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fallback_mutable_op_list_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fallback_mutable_op_list_tensor_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fallback_mutable_op_no_mutated_tensors_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fallback_mutable_op_with_return_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fft_real_input_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fill1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_float16_to_int16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_float32_to_int32_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_float_index_expression_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_float_index_expression_type_promotion_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fmin_fmax_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fmod_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fmod_zero_dim_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fractional_max_pool2d1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fractional_max_pool2d2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fractional_max_pool2d4_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_full_like_sliced_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_full_like_transposed_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_full_truncation_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fuse_large_params_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fuse_tiled_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_fusing_write_into_disjoint_read_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_gather2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_gather3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_generate_rand_fp8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_generated_code_has_alignment_assert_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_generated_code_has_size_stride_assert_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_glu_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_arange1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_argmax_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_both_scalars_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_constant_tensor1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_constant_tensor2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_no_inputs_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_pad_dynamic_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_refcount_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_graph_partition_unbacked_symint_as_output_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_grid_sampler_2d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_hardsigmoid_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_hardswish_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_horizonal_fusion2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_dynamic_shapes_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_propagation_abs_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_propagation_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_propagation_device_assert_masked_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_propagation_flip_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_propagation_floordiv_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_propagation_nested_indirect_indexing_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_propagation_remainder_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_put2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_put_fallback1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_put_fallback2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_select_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_index_tensor_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inductor_assert_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inductor_layout_optimization_input_mutations_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inductor_multiple_specializations_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inductor_triton_bucketize_respects_masking_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inner_fn_str_and_stride_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inplace_activations_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inplace_mixed_dtype_ops_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_inplace_where_pointwise_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_input_mutation1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_input_mutation3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_input_mutation4_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_int_input_dynamic_shapes_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_invalid_operand_issue1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_isinf2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_isinf_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_large_grid_use_block_ptr_False_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_large_grid_use_block_ptr_True_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_large_pointwise_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_large_strided_reduction_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_layer_norm_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_leaky_relu_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_lerp_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_lgamma_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_like_channels_last_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_like_rands2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_like_rands3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_like_rands_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_like_rands_sliced_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_linear1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_linear2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_linear_dynamic_maxautotune_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_linear_float64_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_linear_mixed_dtype_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_linspace1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_linspace3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_log1p_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_log_softmax_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_long_tensor_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_low_memory_max_pool_dilation_1_dim_2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_mark_dynamic_with_hint_override_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_masked_fill_promotion_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_matmul_layer_norm_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_max_min_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_max_pool2d2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_max_pool2d6_dilation_2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_max_pool2d7_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_max_pool2d8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_max_pool2d_with_indices_backward5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_min_max_reduction_nan_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_mixed_mm2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_mm_mixed_dtype_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_mm_views_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_multi_device_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_multi_gpu_device_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_multilayer_any_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_multilayer_sum_low_prec_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_multilayer_var_lowp_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_mutable_custom_op_fixed_layout2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_mutable_custom_op_fixed_layout_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_mutations_loop_fusion_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_nan_sort_stable_False_descending_False_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_nan_sort_stable_False_descending_True_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_nan_to_num_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_narrow_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_neg_max_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_nll_loss_backward_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_nll_loss_forward_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_no_specization_over_symbolic_value_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_nonzero_unbacked_refinement_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_output_strides_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pad_cast_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pad_view_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pattern_matcher_multi_user_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_permute2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pixel_shuffle_channels_last_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_airy_ai_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_chebyshev_polynomial_v_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_chebyshev_polynomial_w_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_erf_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_erfcx_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_expit_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_gammaincc_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_hermite_polynomial_he_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_i0_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_i0e_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_i1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_i1e_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_log_ndtr_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_logit_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_multigammaln_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_ndtr_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_psi_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_t_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_u_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_v_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pointwise_shifted_chebyshev_polynomial_w_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_polar_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pow1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pow2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_pow_by_natural_log2_dynamic_shapes_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_prepare_softmax_with_fast_math_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_progressive, test/inductor/test_compile_subprocess.py::GPUTests::test_randint_distribution_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_randint_int64_mod_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_randint_kernel_count_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_randn_like_empty_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_randn_with_dtype_and_device_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_reduction2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_reduction4_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_reduction5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_remainder_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_remove_noop_clone_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_remove_noop_copy_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_remove_noop_slice1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_repeat_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_repeat_interleave_Tensor_decomp_int32_nd_1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_repeat_interleave_Tensor_decomp_int32_nd_2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_replication_pad_errors_with_bool_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_require_stride_expanded_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_resize_as_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_resize_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_roi_align_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_roll_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_round_correctness_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_round_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scalar_cpu_tensor_arg_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scalar_input_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scalar_output_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scaled_dot_product_attention_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scaled_dot_product_efficient_attention_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scatter1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scatter4_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scatter5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scatter_add2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scatter_add3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scatter_reduce2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_scheduler_vertical_fusion1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_False_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_True_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sdpa_prefer_nd_tiling_True_use_block_ptr_False_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sdpa_unaligned_mask_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sdpa_unaligned_mask_freezing_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_searchsorted_broadcast_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_shape_prop_torch_ones_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_should_pad_bench_for_bmm_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sigmoid_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sign_dtype_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_signbit_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_simplify_loops_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sin_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_single_elem_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_single_elem_indirect_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sizehint_issue1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_slice1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_slice3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_slice_mutation1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_slice_mutation2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_slice_scatter2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_slice_scatter5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_slice_scatter_reinplace_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_softmax_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_softmax_one_kernel_persist_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_cumprod_low_prec_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_cumsum_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_cumsum_index_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_reduction_dynamic_shape_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_reduction_with_int64_size_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_with_integer_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_split_with_unbacked_symints_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sqrt_dynamic_shapes_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_squeeze1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_squeeze2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_squeeze_varargs_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_stack_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sum2_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sum4_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_sum5_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_tan_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_tensor_index_slice_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_to_device_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_to_dtype_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_torch_device_split_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_transpose_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_uint_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_unbind_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_unfold_zero_dimension_tensor_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_unsigned_constant_tensors_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_unspec_inputs_bfloat16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_unspec_inputs_float16_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_unspec_inputs_uint8_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_unsqueeze_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_upsample_bicubic2d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_upsample_bilinear2d_b_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_upsample_nearest2d_backward_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_upsample_nearest2d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_upsample_nearest3d_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_var_mean_div_by_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_vectorized_ops_masked_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_vectorized_ops_masked_var_novec_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_vertical_fusion1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_view_on_aliased_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_view_uint8_through_differing_bitwidths_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_views1_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_views3_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_views7_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_xblock_divides_xnumel_cuda, test/inductor/test_compile_subprocess.py::GPUTests::test_zeros_cuda 2025-09-07T07:20:13.5850653Z 2025-09-07T07:20:13.5850762Z Running inductor/test_control_flow 2/2 ... [2025-09-07 07:20:13.570611] 2025-09-07T07:20:13.5850951Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:20:13.5851349Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_control_flow.py', '--shard-id=2', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:20:13.570859] 2025-09-07T07:33:27.3186991Z 2025-09-07T07:33:27.3191558Z PRINTING LOG FILE of inductor/test_control_flow 2/2 (test/test-reports/inductor.test_control_flow_2.2_02da08eb26b3c1e5_.log) 2025-09-07T07:33:27.3199235Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.3199989Z import pkg_resources 2025-09-07T07:33:27.3200333Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-243a5eaba4cbe81e.xml 2025-09-07T07:33:27.3200733Z ============================= test session starts ============================== 2025-09-07T07:33:27.3201050Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.3201334Z cachedir: .pytest_cache 2025-09-07T07:33:27.3201686Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.3202031Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.3202217Z configfile: pytest.ini 2025-09-07T07:33:27.3202559Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.3202907Z collecting ... collected 467 items 2025-09-07T07:33:27.3203230Z stepcurrent: Cannot find last run test, not skipping 2025-09-07T07:33:27.3265374Z Running 221 items in this shard: test/inductor/test_control_flow.py::CondTests::test_cond_advanced_dynamic_shapes_device_cpu, test/inductor/test_control_flow.py::CondTests::test_cond_control_flow_with_precomputed_size, test/inductor/test_control_flow.py::CondTests::test_cond_decompose_ops_in_subgraph_device_cuda, test/inductor/test_control_flow.py::CondTests::test_cond_decompose_ops_in_subgraph_recursive_device_cpu, test/inductor/test_control_flow.py::CondTests::test_cond_decompose_ops_in_subgraph_recursive_device_cuda, test/inductor/test_control_flow.py::CondTests::test_cond_functional_call_device_cpu_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_functional_call_device_cuda_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_functional_call_device_cuda_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_mismatched_branch_output_size_device_cpu_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_multiple_outputs_device_cpu_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_multiple_outputs_device_cpu_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_nested_control_flow_device_cpu_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_nested_control_flow_device_cpu_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_nested_control_flow_device_cuda_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_non_tensor_predicates_device_cpu_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_non_tensor_predicates_device_cpu_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_outer_code_before_after_device_cpu_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_select_with_input_idx_device_cpu_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_select_with_input_idx_device_cuda_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_simple_control_flow_device_cpu_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_simple_control_flow_device_cuda_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_simple_control_flow_device_cuda_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_simple_with_int_closure_device_cuda, test/inductor/test_control_flow.py::CondTests::test_cond_subgraphs_with_parameters_device_cuda_dynamic_False, test/inductor/test_control_flow.py::CondTests::test_cond_subgraphs_with_parameters_device_cuda_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_unbacked_symint_closure_device_cpu_dynamic_True, test/inductor/test_control_flow.py::CondTests::test_cond_unbacked_symint_inner_device_cpu, test/inductor/test_control_flow.py::CondTests::test_cond_unbacked_symint_outer_to_inner_device_cpu, test/inductor/test_control_flow.py::CondTests::test_cond_use_buffers_from_outer_scope, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_models_with_mixed_device_device_cuda, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_stack_output_simple_device_cpu_dynamic_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_conv_device_cuda_dynamic_False_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cpu_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cuda_dynamic_False_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cuda_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_mismatch_dynamic_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_mismatch_dynamic_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_ops_device_cpu_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_ops_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_ops_device_cuda_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cpu_dynamic_False_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cpu_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cuda_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cpu_dynamic_True_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_zero_loop_device_cuda_dynamic_False, test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_zero_loop_device_cuda_dynamic_True, test/inductor/test_control_flow.py::AssociativeScanTests::test_associative_scan_CUDA_flip_combine_mode_generic_backend_inductor_device_cuda, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_False_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_False_dim_1_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_True_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_False_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_False_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_False_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_False_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_True_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_True_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_True_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_compare_chunked_ce_with_no_scan_device_cpu_dynamic_False, test/inductor/test_control_flow.py::ScanTests::test_scan_compare_chunked_ce_with_no_scan_device_cuda_dynamic_True, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_1_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_True_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_True_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_False_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_True_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_True_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_0_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_0_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_0_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_1_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_1_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_3_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_0_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_0_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_1_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_1_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_1_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_3_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_0_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_0_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_3_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_3_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_3_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_0_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_0_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_1_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_1_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_3_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_0_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_0_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_1_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_1_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_3_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_3_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_1_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_1_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_3_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_3_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_0_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_0_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_1_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_1_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_0_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_0_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_0_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_1_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_1_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_1_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_False_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_False_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_True_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_True_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_False_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_False_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_False_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_False_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_True_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_True_dim_3_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_False_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_True_dim_0_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_True_dim_0_scan_length_5, test/inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_True_dim_1_scan_length_1, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_False_reverse_False_dim_1, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_False_reverse_False_dim_2, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_False_reverse_True_dim_1, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_True_reverse_False_dim_0, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_True_reverse_False_dim_2, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_True_reverse_True_dim_0, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_False_reverse_False_dim_2, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_False_reverse_True_dim_1, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_False_reverse_True_dim_2, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_True_reverse_False_dim_0, test/inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_True_reverse_False_dim_2, test/inductor/test_control_flow.py::ScanTests::test_scan_with_clamp_device_cpu_dynamic_False, test/inductor/test_control_flow.py::ScanTests::test_scan_with_clamp_device_cpu_dynamic_True, test/inductor/test_control_flow.py::MapTests::test_map_nested_with_cond_device_cpu_dynamic_True_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_nested_with_cond_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_nested_with_cond_device_cuda_dynamic_True_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cpu_dynamic_False_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cpu_dynamic_True_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_False_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_True_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_True_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_simple_device_cpu_dynamic_False_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_simple_device_cpu_dynamic_True_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_simple_device_cuda_dynamic_False_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_simple_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cpu_dynamic_False_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cpu_dynamic_True_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cpu_dynamic_True_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cuda_dynamic_False_autograd_False, test/inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cuda_dynamic_False_autograd_True, test/inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cuda_dynamic_True_autograd_False 2025-09-07T07:33:27.3311852Z 2025-09-07T07:33:27.3311999Z inductor/test_control_flow.py::CondTests::test_cond_advanced_dynamic_shapes_device_cpu PASSED [2.6659s] [ 0%] 2025-09-07T07:33:27.3312583Z inductor/test_control_flow.py::CondTests::test_cond_control_flow_with_precomputed_size W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] failed to eagerly compile backwards for dynamic, suppressing in case backwards not needed 2025-09-07T07:33:27.3318158Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] Traceback (most recent call last): 2025-09-07T07:33:27.3318677Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 1774, in aot_stage2_autograd 2025-09-07T07:33:27.3319189Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] compiled_bw_func = aot_config.bw_compiler( 2025-09-07T07:33:27.3319565Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3320048Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/schemas.py", line 1267, in __call__ 2025-09-07T07:33:27.3320541Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return self.compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3320911Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3321393Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 82, in _wrapped_bw_compiler 2025-09-07T07:33:27.3321849Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] disable( 2025-09-07T07:33:27.3322351Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3322797Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return fn(*args, **kwargs) 2025-09-07T07:33:27.3323214Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3323667Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_utils_internal.py", line 92, in wrapper_function 2025-09-07T07:33:27.3324132Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return function(*args, **kwargs) 2025-09-07T07:33:27.3324540Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3324998Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2596, in bw_compiler 2025-09-07T07:33:27.3325449Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return compile_fx_backward( 2025-09-07T07:33:27.3325806Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3326266Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2321, in compile_fx_backward 2025-09-07T07:33:27.3326802Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return inner_compile( 2025-09-07T07:33:27.3327131Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3327580Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 782, in compile_fx_inner 2025-09-07T07:33:27.3328095Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return wrap_compiler_debug(_compile_fx_inner, compiler_name="inductor")( 2025-09-07T07:33:27.3328514Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3328990Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_aot.py", line 144, in debug_wrapper 2025-09-07T07:33:27.3329481Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] inner_compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3329862Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3330332Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 963, in _compile_fx_inner 2025-09-07T07:33:27.3330813Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] mb_compiled_graph = fx_codegen_and_compile( 2025-09-07T07:33:27.3331233Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3331710Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 1695, in fx_codegen_and_compile 2025-09-07T07:33:27.3332251Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return scheme.codegen_and_compile(gm, example_inputs, inputs_to_check, graph_kwargs) 2025-09-07T07:33:27.3332677Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3333257Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 1420, in codegen_and_compile 2025-09-07T07:33:27.3333768Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] graph.run(*example_inputs) 2025-09-07T07:33:27.3334195Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/graph.py", line 937, in run 2025-09-07T07:33:27.3334618Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return super().run(*args) 2025-09-07T07:33:27.3334950Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3335369Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/interpreter.py", line 174, in run 2025-09-07T07:33:27.3335805Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] self.env[node] = self.run_node(node) 2025-09-07T07:33:27.3336154Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3336592Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/graph.py", line 1624, in run_node 2025-09-07T07:33:27.3337025Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] result = super().run_node(n) 2025-09-07T07:33:27.3337358Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3337789Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/interpreter.py", line 256, in run_node 2025-09-07T07:33:27.3338246Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] return getattr(self, n.op)(n.target, args, kwargs) 2025-09-07T07:33:27.3338613Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3339056Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/graph.py", line 1420, in output 2025-09-07T07:33:27.3339479Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] assert isinstance( 2025-09-07T07:33:27.3339793Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] ^^^^^^^^^^^ 2025-09-07T07:33:27.3340261Z W0907 07:20:25.784000 473387 site-packages/torch/_functorch/_aot_autograd/graph_compile.py:1794] [0/1] AssertionError: Unsupported inductor graph input type: 2025-09-07T07:33:27.3340586Z PASSED [3.4718s] [ 0%] 2025-09-07T07:33:27.3340784Z inductor/test_control_flow.py::CondTests::test_cond_decompose_ops_in_subgraph_device_cuda PASSED [0.6060s] [ 1%] 2025-09-07T07:33:27.3341096Z inductor/test_control_flow.py::CondTests::test_cond_decompose_ops_in_subgraph_recursive_device_cpu PASSED [0.5743s] [ 1%] 2025-09-07T07:33:27.3341417Z inductor/test_control_flow.py::CondTests::test_cond_decompose_ops_in_subgraph_recursive_device_cuda PASSED [0.7188s] [ 2%] 2025-09-07T07:33:27.3341729Z inductor/test_control_flow.py::CondTests::test_cond_functional_call_device_cpu_dynamic_True PASSED [2.6149s] [ 2%] 2025-09-07T07:33:27.3342037Z inductor/test_control_flow.py::CondTests::test_cond_functional_call_device_cuda_dynamic_False PASSED [1.1393s] [ 3%] 2025-09-07T07:33:27.3342376Z inductor/test_control_flow.py::CondTests::test_cond_functional_call_device_cuda_dynamic_True PASSED [2.7140s] [ 3%] 2025-09-07T07:33:27.3342698Z inductor/test_control_flow.py::CondTests::test_cond_mismatched_branch_output_size_device_cpu_dynamic_False PASSED [0.7695s] [ 4%] 2025-09-07T07:33:27.3343020Z inductor/test_control_flow.py::CondTests::test_cond_multiple_outputs_device_cpu_dynamic_False PASSED [0.6600s] [ 4%] 2025-09-07T07:33:27.3343434Z inductor/test_control_flow.py::CondTests::test_cond_multiple_outputs_device_cpu_dynamic_True PASSED [1.5867s] [ 4%] 2025-09-07T07:33:27.3343747Z inductor/test_control_flow.py::CondTests::test_cond_nested_control_flow_device_cpu_dynamic_False PASSED [0.8222s] [ 5%] 2025-09-07T07:33:27.3344058Z inductor/test_control_flow.py::CondTests::test_cond_nested_control_flow_device_cpu_dynamic_True PASSED [2.1275s] [ 5%] 2025-09-07T07:33:27.3344378Z inductor/test_control_flow.py::CondTests::test_cond_nested_control_flow_device_cuda_dynamic_True PASSED [2.3000s] [ 6%] 2025-09-07T07:33:27.3344692Z inductor/test_control_flow.py::CondTests::test_cond_non_tensor_predicates_device_cpu_dynamic_False PASSED [0.8006s] [ 6%] 2025-09-07T07:33:27.3345008Z inductor/test_control_flow.py::CondTests::test_cond_non_tensor_predicates_device_cpu_dynamic_True PASSED [1.4631s] [ 7%] 2025-09-07T07:33:27.3345325Z inductor/test_control_flow.py::CondTests::test_cond_outer_code_before_after_device_cpu_dynamic_True PASSED [1.8485s] [ 7%] 2025-09-07T07:33:27.3345639Z inductor/test_control_flow.py::CondTests::test_cond_select_with_input_idx_device_cpu_dynamic_True PASSED [1.4455s] [ 8%] 2025-09-07T07:33:27.3345949Z inductor/test_control_flow.py::CondTests::test_cond_select_with_input_idx_device_cuda_dynamic_True PASSED [1.5663s] [ 8%] 2025-09-07T07:33:27.3346416Z inductor/test_control_flow.py::CondTests::test_cond_simple_control_flow_device_cpu_dynamic_False PASSED [0.5346s] [ 9%] 2025-09-07T07:33:27.3346732Z inductor/test_control_flow.py::CondTests::test_cond_simple_control_flow_device_cuda_dynamic_False PASSED [0.6003s] [ 9%] 2025-09-07T07:33:27.3347045Z inductor/test_control_flow.py::CondTests::test_cond_simple_control_flow_device_cuda_dynamic_True PASSED [1.5742s] [ 9%] 2025-09-07T07:33:27.3347346Z inductor/test_control_flow.py::CondTests::test_cond_simple_with_int_closure_device_cuda PASSED [1.1122s] [ 10%] 2025-09-07T07:33:27.3347657Z inductor/test_control_flow.py::CondTests::test_cond_subgraphs_with_parameters_device_cuda_dynamic_False PASSED [0.8796s] [ 10%] 2025-09-07T07:33:27.3347991Z inductor/test_control_flow.py::CondTests::test_cond_subgraphs_with_parameters_device_cuda_dynamic_True PASSED [2.6328s] [ 11%] 2025-09-07T07:33:27.3348316Z inductor/test_control_flow.py::CondTests::test_cond_unbacked_symint_closure_device_cpu_dynamic_True PASSED [0.9904s] [ 11%] 2025-09-07T07:33:27.3348622Z inductor/test_control_flow.py::CondTests::test_cond_unbacked_symint_inner_device_cpu PASSED [2.2857s] [ 12%] 2025-09-07T07:33:27.3348974Z inductor/test_control_flow.py::CondTests::test_cond_unbacked_symint_outer_to_inner_device_cpu PASSED [1.6877s] [ 12%] 2025-09-07T07:33:27.3349266Z inductor/test_control_flow.py::CondTests::test_cond_use_buffers_from_outer_scope PASSED [0.5551s] [ 13%] 2025-09-07T07:33:27.3349672Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_models_with_mixed_device_device_cuda W0907 07:21:03.749000 473387 site-packages/torch/_inductor/utils.py:2298] [1/0] DeviceCopy in input program 2025-09-07T07:33:27.3349998Z PASSED [1.9399s] [ 13%] 2025-09-07T07:33:27.3350257Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5890s] [ 14%] 2025-09-07T07:33:27.3350679Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5503s] [ 14%] 2025-09-07T07:33:27.3351114Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True FAILED [0.5434s] [ 14%] 2025-09-07T07:33:27.3351321Z 2025-09-07T07:33:27.3351378Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.3351585Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3351781Z Traceback (most recent call last): 2025-09-07T07:33:27.3352015Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3352239Z self._run_test( 2025-09-07T07:33:27.3352412Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3352618Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3352749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3352962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3353259Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3353382Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3353608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3353842Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3353964Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3354174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3354391Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3354509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3354728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3354991Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3355152Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3355375Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3355611Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3355837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3356079Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3356208Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3356428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3356658Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3356784Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3356978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3357283Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3357432Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3357641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3357866Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3358009Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3358455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3358725Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3358891Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3359173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3359434Z return aot_autograd( 2025-09-07T07:33:27.3359599Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3359868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3360162Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3360363Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3360767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3361084Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3361304Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3361613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3361901Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3362224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3362528Z fx_g = _create_graph( 2025-09-07T07:33:27.3362674Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3362942Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3363406Z fx_g = make_fx( 2025-09-07T07:33:27.3363799Z ^^^^^^^^ 2025-09-07T07:33:27.3364029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3364297Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3364474Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3364729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3364987Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3365163Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3365432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3365715Z t = dispatch_trace( 2025-09-07T07:33:27.3365853Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3366056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3366299Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3366452Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3366752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3366994Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3367144Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3367406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3367789Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3367989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3368235Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3368475Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3369058Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3369301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3369546Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3369686Z ^^^^^^^^^ 2025-09-07T07:33:27.3369935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3370186Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3370312Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3370634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3370907Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3371067Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3371324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3371612Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3371800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3372090Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3372369Z outs_pair = fn(*args) 2025-09-07T07:33:27.3372529Z ^^^^^^^^^ 2025-09-07T07:33:27.3372798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3373225Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3373412Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3373700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3374002Z outs_pair = fn(*args) 2025-09-07T07:33:27.3374121Z ^^^^^^^^^ 2025-09-07T07:33:27.3374394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3374718Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3374893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3375205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3375560Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3375752Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3376049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3376338Z outs_pair = fn(*args) 2025-09-07T07:33:27.3376473Z ^^^^^^^^^ 2025-09-07T07:33:27.3376774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3377085Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3377228Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3377522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3377812Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3377952Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3378263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3378502Z return handle_torch_function( 2025-09-07T07:33:27.3378654Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3378913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3379197Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3379406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3380556Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3380832Z return func(*args, **kwargs) 2025-09-07T07:33:27.3381009Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3381236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3400205Z result = _engine_run_backward( 2025-09-07T07:33:27.3400354Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3400590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3400904Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3401110Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3401322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3401524Z return user_fn(self, *args) 2025-09-07T07:33:27.3401630Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3401847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3402077Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3402193Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3402420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3402659Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3402774Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3402968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3403284Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3403388Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3403615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3403867Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3403993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3404210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3404429Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3404549Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3404786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3405026Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3405144Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3405372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3405601Z t = dispatch_trace( 2025-09-07T07:33:27.3405698Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3405869Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3406062Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3406270Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3406463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3406661Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3406827Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3407048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3407322Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3407473Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3407671Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3407867Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3407966Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3408151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3408398Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3408504Z ^^^^^^^^^ 2025-09-07T07:33:27.3408717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3408950Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3409066Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3409164Z File "", line 1, in 2025-09-07T07:33:27.3409383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3409636Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3409793Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3410009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3410231Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3410352Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3410613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3410882Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3410992Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3411231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3411478Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3411590Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3411804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3412023Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3412135Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3412338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3412590Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3412756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3412966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3413282Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3413419Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3413620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3413820Z leaves = list(leaves) 2025-09-07T07:33:27.3413916Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3414096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3414337Z return func(x) 2025-09-07T07:33:27.3414423Z ^^^^^^^ 2025-09-07T07:33:27.3414613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3414849Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3414986Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3415229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3415470Z return func(*args, **kwargs) 2025-09-07T07:33:27.3415574Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3415817Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3416113Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3416272Z 2025-09-07T07:33:27.3416478Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3416714Z 2025-09-07T07:33:27.3416716Z 2025-09-07T07:33:27.3416790Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3417092Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3417320Z 2025-09-07T07:33:27.3417404Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3417600Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3417847Z inline_call [] 2025-09-07T07:33:27.3417979Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3418172Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3418424Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3418828Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3419266Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3419546Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3419857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3420180Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3420470Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3420790Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3421114Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3421340Z Traceback (most recent call last): 2025-09-07T07:33:27.3421612Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3421871Z self._run_test( 2025-09-07T07:33:27.3422072Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3422328Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3422493Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3422725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3422997Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3423247Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3423550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3423837Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3423998Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3424245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3424502Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3424656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3424921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3425215Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3425399Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3425676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3425993Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3426258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3426528Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3426692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3426950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3427227Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3427387Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3427626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3427879Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3428054Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3428331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3428593Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3428779Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3429041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3429297Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3429463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3429693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3429940Z return aot_autograd( 2025-09-07T07:33:27.3430096Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3430324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3430607Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3430817Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3431093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3431415Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3431620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3431925Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3432235Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3432527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3432891Z fx_g = _create_graph( 2025-09-07T07:33:27.3433167Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3433519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3433847Z fx_g = make_fx( 2025-09-07T07:33:27.3433956Z ^^^^^^^^ 2025-09-07T07:33:27.3434292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3434580Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3434803Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3435074Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3435399Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3435585Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3435881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3436247Z t = dispatch_trace( 2025-09-07T07:33:27.3436464Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3436685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3436952Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3437124Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3437394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3437659Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3438312Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3438631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3439032Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3439285Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3439563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3439857Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3440042Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3440310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3440587Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3440732Z ^^^^^^^^^ 2025-09-07T07:33:27.3441028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3441336Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3441487Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3441790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3442106Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3442276Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3442577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3442882Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3443190Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3443552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3443870Z outs_pair = fn(*args) 2025-09-07T07:33:27.3444082Z ^^^^^^^^^ 2025-09-07T07:33:27.3444389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3444787Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3445025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3445400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3445742Z outs_pair = fn(*args) 2025-09-07T07:33:27.3445968Z ^^^^^^^^^ 2025-09-07T07:33:27.3446249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3446613Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3446976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3447365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3447775Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3448004Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3448460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3448823Z outs_pair = fn(*args) 2025-09-07T07:33:27.3449055Z ^^^^^^^^^ 2025-09-07T07:33:27.3449421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3449813Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3450077Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3450403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3450880Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3451154Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3451486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3451830Z return handle_torch_function( 2025-09-07T07:33:27.3452042Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3452364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3502412Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3502699Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3502991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3503417Z return func(*args, **kwargs) 2025-09-07T07:33:27.3503538Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3503748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3503970Z result = _engine_run_backward( 2025-09-07T07:33:27.3504098Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3504340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3504655Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3504875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3505102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3505322Z return user_fn(self, *args) 2025-09-07T07:33:27.3505434Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3505674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3505910Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3506029Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3506340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3506620Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3506769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3506999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3507209Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3507329Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3507602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3507862Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3508014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3508236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3508482Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3508693Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3508937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3509189Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3509316Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3509552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3509825Z t = dispatch_trace( 2025-09-07T07:33:27.3509925Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3510145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3510343Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3510462Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3510662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3510905Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3511014Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3511243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3511522Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3511685Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3511895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3512096Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3512206Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3512410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3512622Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3512740Z ^^^^^^^^^ 2025-09-07T07:33:27.3512963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3513303Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3513430Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3513535Z File "", line 1, in 2025-09-07T07:33:27.3513763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3514030Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3514199Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3514501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3514734Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3514860Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3515165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3515449Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3515569Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3515828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3516096Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3516221Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3516433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3516652Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3516763Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3516966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3517264Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3517430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3517637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3517855Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3517991Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3518195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3518394Z leaves = list(leaves) 2025-09-07T07:33:27.3518490Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3518672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3518863Z return func(x) 2025-09-07T07:33:27.3518949Z ^^^^^^^ 2025-09-07T07:33:27.3519142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3519378Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3519516Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3519759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3519998Z return func(*args, **kwargs) 2025-09-07T07:33:27.3520104Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3520353Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3520653Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3520775Z 2025-09-07T07:33:27.3520982Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3521224Z 2025-09-07T07:33:27.3521227Z 2025-09-07T07:33:27.3521316Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3521627Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3521859Z 2025-09-07T07:33:27.3521951Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3522150Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3522305Z inline_call [] 2025-09-07T07:33:27.3522424Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3522595Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3522785Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3523291Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3523697Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3523938Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3524221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3524497Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3524760Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3525054Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3525286Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3525478Z inline_call [] 2025-09-07T07:33:27.3525595Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3525766Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3525953Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3526319Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3526803Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3527042Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3527320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3527595Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3527856Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3528147Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3528361Z =================================== FAILURES =================================== 2025-09-07T07:33:27.3528572Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3528776Z Traceback (most recent call last): 2025-09-07T07:33:27.3529012Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3529239Z self._run_test( 2025-09-07T07:33:27.3529410Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3529622Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3529765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3529989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3530213Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3530344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3530575Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3530818Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3530948Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3531165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3531389Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3531509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3531731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3532038Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3532202Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3532433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3532673Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3532905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3533252Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3533390Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3533617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3533855Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3534036Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3534237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3534460Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3534615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3534831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3535066Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3535217Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3535446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3535675Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3535799Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3536018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3536247Z return aot_autograd( 2025-09-07T07:33:27.3536357Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3536562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3536807Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3536964Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3537213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3537500Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3537673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3537944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3538217Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3538480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3538751Z fx_g = _create_graph( 2025-09-07T07:33:27.3538861Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3539091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3539331Z fx_g = make_fx( 2025-09-07T07:33:27.3539427Z ^^^^^^^^ 2025-09-07T07:33:27.3539634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3539875Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3540002Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3540276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3540509Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3540633Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3565371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3565672Z t = dispatch_trace( 2025-09-07T07:33:27.3565778Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3565961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3566163Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3566283Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3566492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3566762Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3566871Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3567191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3567477Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3567640Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3567848Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3568052Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3568156Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3568349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3568555Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3568667Z ^^^^^^^^^ 2025-09-07T07:33:27.3568868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3569083Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3569198Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3569419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3569661Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3569785Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3570006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3570266Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3570409Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3570666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3570918Z outs_pair = fn(*args) 2025-09-07T07:33:27.3571022Z ^^^^^^^^^ 2025-09-07T07:33:27.3571262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3571539Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3571690Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3571946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3572200Z outs_pair = fn(*args) 2025-09-07T07:33:27.3572302Z ^^^^^^^^^ 2025-09-07T07:33:27.3572536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3572815Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3572959Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3573380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3573689Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3573843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3574100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3574357Z outs_pair = fn(*args) 2025-09-07T07:33:27.3574457Z ^^^^^^^^^ 2025-09-07T07:33:27.3574709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3574983Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3575105Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3575351Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3575650Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3575773Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3575974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3576182Z return handle_torch_function( 2025-09-07T07:33:27.3576293Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3576507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3576761Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3576921Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3577176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3577429Z return func(*args, **kwargs) 2025-09-07T07:33:27.3577542Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3577737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3577944Z result = _engine_run_backward( 2025-09-07T07:33:27.3578057Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3578276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3578584Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3578792Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3579008Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3579215Z return user_fn(self, *args) 2025-09-07T07:33:27.3579325Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3579543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3579772Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3579889Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3580121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3580358Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3580472Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3580669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3580869Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3580973Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3581204Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3581461Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3581720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3581935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3582161Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3582284Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3582522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3582766Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3582888Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3583197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3583430Z t = dispatch_trace( 2025-09-07T07:33:27.3583525Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3583736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3583929Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3584041Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3584235Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3584436Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3584538Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3584770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3585050Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3585206Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3585404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3585608Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3585709Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3585905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3586109Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3586218Z ^^^^^^^^^ 2025-09-07T07:33:27.3586430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3586664Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3586784Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3586882Z File "", line 1, in 2025-09-07T07:33:27.3587100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3587360Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3587523Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3587747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3587974Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3588097Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3588360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3588641Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3588755Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3588997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3589250Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3589367Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3589585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3589859Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3589974Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3590181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3590438Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3590607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3590817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3591039Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3591177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3591385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3591635Z leaves = list(leaves) 2025-09-07T07:33:27.3591738Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3591923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3592117Z return func(x) 2025-09-07T07:33:27.3592208Z ^^^^^^^ 2025-09-07T07:33:27.3592396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3592637Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3592779Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3593024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3593360Z return func(*args, **kwargs) 2025-09-07T07:33:27.3593470Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3593721Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3594032Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3594154Z 2025-09-07T07:33:27.3594363Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3594601Z 2025-09-07T07:33:27.3594605Z 2025-09-07T07:33:27.3594682Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3594990Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3595220Z 2025-09-07T07:33:27.3595308Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3595509Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3595662Z inline_call [] 2025-09-07T07:33:27.3595769Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3595936Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3596114Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3596482Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3596883Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3597119Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3597392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3597661Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3597960Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3598245Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3598469Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3598612Z inline_call [] 2025-09-07T07:33:27.3598719Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3598880Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3599058Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3599415Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3599809Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3600077Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3600348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3600613Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3600862Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3601145Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3601367Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3601508Z inline_call [] 2025-09-07T07:33:27.3601612Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3601776Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3601957Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3602317Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3602708Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3602937Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3603265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3603530Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3603779Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3604058Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3604430Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-243a5eaba4cbe81e.xml - 2025-09-07T07:33:27.3604736Z =========================== short test summary info ============================ 2025-09-07T07:33:27.3605199Z FAILED [0.5434s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3605679Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3605799Z 2025-09-07T07:33:27.3606003Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3606240Z 2025-09-07T07:33:27.3606244Z 2025-09-07T07:33:27.3606360Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3606663Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3606942Z 2025-09-07T07:33:27.3607027Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3607206Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.3607364Z ==================== 1 failed, 30 passed, 2 rerun in 46.66s ==================== 2025-09-07T07:33:27.3607499Z Got exit code 1 2025-09-07T07:33:27.3607589Z Retrying single test... 2025-09-07T07:33:27.3608077Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.3608600Z import pkg_resources 2025-09-07T07:33:27.3608830Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-6329c0e73809402b.xml 2025-09-07T07:33:27.3609085Z ============================= test session starts ============================== 2025-09-07T07:33:27.3609291Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.3609473Z cachedir: .pytest_cache 2025-09-07T07:33:27.3609688Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.3609921Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.3610032Z configfile: pytest.ini 2025-09-07T07:33:27.3610252Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.3610526Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.3610864Z stepcurrent: skipping 30 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3611168Z Running 1 items in this shard 2025-09-07T07:33:27.3611239Z 2025-09-07T07:33:27.3611434Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.6875s] [100%] 2025-09-07T07:33:27.3611854Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5175s] [100%] 2025-09-07T07:33:27.3612250Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True FAILED [0.5598s] [100%] 2025-09-07T07:33:27.3612457Z 2025-09-07T07:33:27.3612509Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.3612711Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3612901Z Traceback (most recent call last): 2025-09-07T07:33:27.3613202Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3613422Z self._run_test( 2025-09-07T07:33:27.3613588Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3613790Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3613919Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3614126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3614341Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3614460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3614736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3614967Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3615085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3615291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3615504Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3615619Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3615831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3616085Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3616239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3616464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3616735Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3616960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3617197Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3617324Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3617539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3617765Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3617888Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3618076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3618293Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3618437Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3618647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3618870Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3619006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3619223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3619442Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3619556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3619762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3619973Z return aot_autograd( 2025-09-07T07:33:27.3620071Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3620264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3620508Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3620655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3620895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3621169Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3621332Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3621598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3621859Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3622112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3622375Z fx_g = _create_graph( 2025-09-07T07:33:27.3626936Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3627231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3627468Z fx_g = make_fx( 2025-09-07T07:33:27.3627554Z ^^^^^^^^ 2025-09-07T07:33:27.3627758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3627990Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3628109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3628327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3628552Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3628664Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3628890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3639068Z t = dispatch_trace( 2025-09-07T07:33:27.3639183Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3639440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3639666Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3639786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3639990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3640205Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3640314Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3640546Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3640827Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3640988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3651396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3651629Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3651739Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3651938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3652148Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3652261Z ^^^^^^^^^ 2025-09-07T07:33:27.3652463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3652676Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3652785Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3653009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3653324Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3653457Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3656439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3656715Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3656860Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3657116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3657382Z outs_pair = fn(*args) 2025-09-07T07:33:27.3657483Z ^^^^^^^^^ 2025-09-07T07:33:27.3657717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3657989Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3658136Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3658480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3658726Z outs_pair = fn(*args) 2025-09-07T07:33:27.3660762Z ^^^^^^^^^ 2025-09-07T07:33:27.3661019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3661295Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3661452Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3661731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3662033Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3662189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3662514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3662763Z outs_pair = fn(*args) 2025-09-07T07:33:27.3662865Z ^^^^^^^^^ 2025-09-07T07:33:27.3663175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3665158Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3685966Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3686232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3686489Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3686641Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3686904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3687117Z return handle_torch_function( 2025-09-07T07:33:27.3687237Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3687448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3687700Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3687861Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3690207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3690454Z return func(*args, **kwargs) 2025-09-07T07:33:27.3690562Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3690751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3690952Z result = _engine_run_backward( 2025-09-07T07:33:27.3691060Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3691282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3691582Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3691783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3691995Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3692196Z return user_fn(self, *args) 2025-09-07T07:33:27.3693844Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3694056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3694279Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3694389Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3694683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3694923Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3695038Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3695230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3695428Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3695531Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3697167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3697420Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3697546Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3697757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3697977Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3698150Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3698391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3698634Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3698754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3698983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3699213Z t = dispatch_trace( 2025-09-07T07:33:27.3700687Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3700861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3701052Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3701164Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3701356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3701563Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3701665Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3701887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3702158Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3702312Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3702509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3704139Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3704242Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3704432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3704635Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3704742Z ^^^^^^^^^ 2025-09-07T07:33:27.3704961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3705192Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3705308Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3705405Z File "", line 1, in 2025-09-07T07:33:27.3705621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3705875Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3707395Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3707617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3707835Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3707955Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3708282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3708551Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3708663Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3708901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3709148Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3709258Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3709469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3711079Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3711191Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3711391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3711688Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3711862Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3712066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3712283Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3712419Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3712623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3712821Z leaves = list(leaves) 2025-09-07T07:33:27.3712918Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3714561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3714759Z return func(x) 2025-09-07T07:33:27.3714844Z ^^^^^^^ 2025-09-07T07:33:27.3715040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3715275Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3715413Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3715656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3715896Z return func(*args, **kwargs) 2025-09-07T07:33:27.3716001Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3716181Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3716268Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3716272Z 2025-09-07T07:33:27.3716477Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3716482Z 2025-09-07T07:33:27.3716488Z 2025-09-07T07:33:27.3716561Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3718505Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3718509Z 2025-09-07T07:33:27.3718598Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3718677Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3718713Z inline_call [] 2025-09-07T07:33:27.3718772Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3718807Z inductor [] 2025-09-07T07:33:27.3718880Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3718954Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3719268Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3719383Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3719469Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3719621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3719705Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3719836Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3719956Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3720069Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3720153Z Traceback (most recent call last): 2025-09-07T07:33:27.3720305Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3720340Z self._run_test( 2025-09-07T07:33:27.3720452Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3720507Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3720548Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3722027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3722076Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3722117Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3722267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3722323Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3722363Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3722496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3722541Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3722578Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3722719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3722799Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3722839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3722988Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3723035Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3723292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3723346Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3723386Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3723526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3723576Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3723615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3723731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3725116Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3725162Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3725289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3725422Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3725465Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3725604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3725649Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3725687Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3725822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3725863Z return aot_autograd( 2025-09-07T07:33:27.3725899Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3726033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3726102Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3726197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3726362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3726446Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3726492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3726673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3726770Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3726954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3726994Z fx_g = _create_graph( 2025-09-07T07:33:27.3727030Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3728518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3728559Z fx_g = make_fx( 2025-09-07T07:33:27.3728591Z ^^^^^^^^ 2025-09-07T07:33:27.3728743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3728789Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3728829Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3728972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3729016Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3729052Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3729209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3729247Z t = dispatch_trace( 2025-09-07T07:33:27.3729282Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3729397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3729438Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3729475Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3729599Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3729640Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3729676Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3729836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3729916Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3729958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3730082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3731423Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3731494Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3731621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3731663Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3731698Z ^^^^^^^^^ 2025-09-07T07:33:27.3731829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3731870Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3731905Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3732053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3732102Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3732137Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3732292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3732388Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3732432Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3732605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3732645Z outs_pair = fn(*args) 2025-09-07T07:33:27.3732679Z ^^^^^^^^^ 2025-09-07T07:33:27.3732849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3732915Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3732960Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3733191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3734547Z outs_pair = fn(*args) 2025-09-07T07:33:27.3734587Z ^^^^^^^^^ 2025-09-07T07:33:27.3734763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3734822Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3734866Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3735060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3735131Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3735177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3735348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3735390Z outs_pair = fn(*args) 2025-09-07T07:33:27.3735428Z ^^^^^^^^^ 2025-09-07T07:33:27.3735614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3735660Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3735696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3735862Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3735908Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3735946Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3736069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3736111Z return handle_torch_function( 2025-09-07T07:33:27.3736147Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3736357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3736432Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3737781Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3737947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3737989Z return func(*args, **kwargs) 2025-09-07T07:33:27.3738024Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3738146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3738188Z result = _engine_run_backward( 2025-09-07T07:33:27.3738223Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3738367Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3738535Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3738585Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3738710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3738752Z return user_fn(self, *args) 2025-09-07T07:33:27.3738788Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3738930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3738974Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3739011Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3739166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3739212Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3739248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3739372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3739412Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3740739Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3740906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3740958Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3740999Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3741134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3741183Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3741222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3741382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3741435Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3741473Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3741628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3741666Z t = dispatch_trace( 2025-09-07T07:33:27.3741701Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3741812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3741855Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3741891Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3742013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3742053Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3742091Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3742285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3742364Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3742406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3743937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3743978Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3744012Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3744137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3744179Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3744214Z ^^^^^^^^^ 2025-09-07T07:33:27.3744363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3744457Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3744495Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3744538Z File "", line 1, in 2025-09-07T07:33:27.3744677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3744756Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3744801Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3744935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3744982Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3745021Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3745208Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3745254Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3745292Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3745459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3745503Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3745541Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3747013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3747056Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3747093Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3747224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3747312Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3747357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3747487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3747547Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3747593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3747717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3747757Z leaves = list(leaves) 2025-09-07T07:33:27.3747792Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3747912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3747947Z return func(x) 2025-09-07T07:33:27.3747980Z ^^^^^^^ 2025-09-07T07:33:27.3748115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3748183Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3748267Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3748433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3748473Z return func(*args, **kwargs) 2025-09-07T07:33:27.3748509Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3749988Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3750074Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3750077Z 2025-09-07T07:33:27.3750281Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3750284Z 2025-09-07T07:33:27.3750286Z 2025-09-07T07:33:27.3750603Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3750801Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3750804Z 2025-09-07T07:33:27.3750889Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3750963Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3750998Z inline_call [] 2025-09-07T07:33:27.3751054Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3751090Z inductor [] 2025-09-07T07:33:27.3751163Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3751236Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3751493Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3751612Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3751697Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3751847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3751930Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3752060Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3752178Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3752248Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3752283Z inline_call [] 2025-09-07T07:33:27.3753743Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3753827Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3753897Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3754147Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3754257Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3754341Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3754488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3754571Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3754701Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3754863Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3754915Z =================================== FAILURES =================================== 2025-09-07T07:33:27.3755025Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3755069Z Traceback (most recent call last): 2025-09-07T07:33:27.3755219Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3755254Z self._run_test( 2025-09-07T07:33:27.3755365Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3755419Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3755461Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3755641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3755688Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3755728Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3755876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3757249Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3757290Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3757426Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3757471Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3757508Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3757648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3757728Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3757776Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3757927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3757973Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3758121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3758175Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3758216Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3758357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3758407Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3758447Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3758560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3758630Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3758675Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3758799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3758863Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3760204Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3760345Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3760390Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3760427Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3760562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3760605Z return aot_autograd( 2025-09-07T07:33:27.3760640Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3760814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3760883Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3760930Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3761089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3761172Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3761218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3761399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3761442Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3761665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3761704Z fx_g = _create_graph( 2025-09-07T07:33:27.3761740Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3761900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3761935Z fx_g = make_fx( 2025-09-07T07:33:27.3761967Z ^^^^^^^^ 2025-09-07T07:33:27.3762116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3763535Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3763575Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3763720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3763767Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3763808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3763965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3764003Z t = dispatch_trace( 2025-09-07T07:33:27.3764038Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3764149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3764191Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3764228Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3764350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3764391Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3764426Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3764586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3764670Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3764711Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3764834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3764874Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3764908Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3765034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3765074Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3766407Z ^^^^^^^^^ 2025-09-07T07:33:27.3766540Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3766580Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3766615Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3766878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3766929Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3766964Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3767122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3767184Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3767229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3767400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3767439Z outs_pair = fn(*args) 2025-09-07T07:33:27.3767473Z ^^^^^^^^^ 2025-09-07T07:33:27.3767641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3767777Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3767823Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3767995Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3768034Z outs_pair = fn(*args) 2025-09-07T07:33:27.3768069Z ^^^^^^^^^ 2025-09-07T07:33:27.3768243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3768302Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3769663Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3769857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3769937Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3769982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3770152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3770189Z outs_pair = fn(*args) 2025-09-07T07:33:27.3770225Z ^^^^^^^^^ 2025-09-07T07:33:27.3770411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3770456Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3770493Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3770660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3770708Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3770748Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3770873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3770916Z return handle_torch_function( 2025-09-07T07:33:27.3770952Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3771092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3771167Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3771213Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3771378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3771421Z return func(*args, **kwargs) 2025-09-07T07:33:27.3771456Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3772908Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3772952Z result = _engine_run_backward( 2025-09-07T07:33:27.3772988Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3773216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3773335Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3773385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3773509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3773549Z return user_fn(self, *args) 2025-09-07T07:33:27.3773584Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3773726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3773821Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3773859Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3774013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3774057Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3774093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3774215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3774255Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3774290Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3774453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3774504Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3774544Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3776007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3776058Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3776097Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3776256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3776304Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3776342Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3776498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3776536Z t = dispatch_trace( 2025-09-07T07:33:27.3776570Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3776681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3776728Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3776765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3776888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3776927Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3776961Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3777119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3777196Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3777238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3777358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3777397Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3777431Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3777602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3778946Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3778983Z ^^^^^^^^^ 2025-09-07T07:33:27.3779134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3779185Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3779219Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3779261Z File "", line 1, in 2025-09-07T07:33:27.3779401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3779480Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3779525Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3779659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3779752Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3779791Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3779978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3780022Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3780057Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3780225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3780269Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3780306Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3780447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3780489Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3780529Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3780663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3782044Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3782091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3782216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3782275Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3782319Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3782443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3782483Z leaves = list(leaves) 2025-09-07T07:33:27.3782517Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3782645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3782680Z return func(x) 2025-09-07T07:33:27.3782713Z ^^^^^^^ 2025-09-07T07:33:27.3782847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3782911Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3782952Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3783205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3783245Z return func(*args, **kwargs) 2025-09-07T07:33:27.3783282Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3783459Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3783544Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3783549Z 2025-09-07T07:33:27.3783791Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3783794Z 2025-09-07T07:33:27.3783796Z 2025-09-07T07:33:27.3783870Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3785387Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3785390Z 2025-09-07T07:33:27.3785476Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3785548Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3785584Z inline_call [] 2025-09-07T07:33:27.3785639Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3785714Z inductor [] 2025-09-07T07:33:27.3785791Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3785863Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3786117Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3786229Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3786314Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3786462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3786546Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3786677Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3786799Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3786869Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3786904Z inline_call [] 2025-09-07T07:33:27.3786960Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3787031Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3787099Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3787348Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3788753Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3788839Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3788991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3789074Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3789203Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3789320Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3789389Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3789424Z inline_call [] 2025-09-07T07:33:27.3789478Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3789549Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3789617Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3789902Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3790010Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3790095Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3790241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3790323Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3790451Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3790566Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3790806Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-6329c0e73809402b.xml - 2025-09-07T07:33:27.3790863Z =========================== short test summary info ============================ 2025-09-07T07:33:27.3791224Z FAILED [0.5598s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3791307Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3791309Z 2025-09-07T07:33:27.3792812Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3792814Z 2025-09-07T07:33:27.3792816Z 2025-09-07T07:33:27.3792890Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3793184Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3793186Z 2025-09-07T07:33:27.3793270Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3793330Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.3793396Z ================== 1 failed, 220 deselected, 2 rerun in 2.09s ================== 2025-09-07T07:33:27.3793432Z Got exit code 1 2025-09-07T07:33:27.3793470Z Retrying single test... 2025-09-07T07:33:27.3793891Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.3793933Z import pkg_resources 2025-09-07T07:33:27.3794099Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-8400466b498c8e68.xml 2025-09-07T07:33:27.3794155Z ============================= test session starts ============================== 2025-09-07T07:33:27.3794267Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.3794306Z cachedir: .pytest_cache 2025-09-07T07:33:27.3794460Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.3794505Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.3794544Z configfile: pytest.ini 2025-09-07T07:33:27.3794704Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.3794780Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.3795058Z stepcurrent: skipping 30 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3795102Z Running 1 items in this shard 2025-09-07T07:33:27.3795104Z 2025-09-07T07:33:27.3796625Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.6462s] [100%] 2025-09-07T07:33:27.3796819Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.4822s] [100%] 2025-09-07T07:33:27.3796989Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True FAILED [0.4489s] [100%] 2025-09-07T07:33:27.3796991Z 2025-09-07T07:33:27.3797041Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.3797199Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3797243Z Traceback (most recent call last): 2025-09-07T07:33:27.3797396Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3797431Z self._run_test( 2025-09-07T07:33:27.3797541Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3797597Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3797638Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3797771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3797818Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3797859Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3798006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3798059Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3798097Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3798232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3798276Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3798313Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3798456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3798537Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3799905Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3800055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3800105Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3800255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3800310Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3800350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3800490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3800541Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3800580Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3800695Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3800765Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3800809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3800935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3801042Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3801086Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3801223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3801268Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3801305Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3801441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3801480Z return aot_autograd( 2025-09-07T07:33:27.3801516Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3802950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3803022Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3803208Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3803368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3803452Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3803498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3803676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3803720Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3803902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3803942Z fx_g = _create_graph( 2025-09-07T07:33:27.3803977Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3804144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3804179Z fx_g = make_fx( 2025-09-07T07:33:27.3804212Z ^^^^^^^^ 2025-09-07T07:33:27.3804361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3804407Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3804446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3804591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3804635Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3804671Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3804828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3804870Z t = dispatch_trace( 2025-09-07T07:33:27.3806209Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3806325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3806367Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3806403Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3806529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3806569Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3806605Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3806827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3806906Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3806948Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3807072Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3807163Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3807199Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3807324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3807366Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3807401Z ^^^^^^^^^ 2025-09-07T07:33:27.3807531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3807573Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3807608Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3807754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3807803Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3809131Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3809331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3809394Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3809438Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3809610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3809649Z outs_pair = fn(*args) 2025-09-07T07:33:27.3809685Z ^^^^^^^^^ 2025-09-07T07:33:27.3809853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3809919Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3809963Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3810136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3810179Z outs_pair = fn(*args) 2025-09-07T07:33:27.3810214Z ^^^^^^^^^ 2025-09-07T07:33:27.3810387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3810447Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3810489Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3810680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3810751Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3810799Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3810968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3811014Z outs_pair = fn(*args) 2025-09-07T07:33:27.3811049Z ^^^^^^^^^ 2025-09-07T07:33:27.3812538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3812584Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3812621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3812787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3812834Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3812871Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3812995Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3813038Z return handle_torch_function( 2025-09-07T07:33:27.3813171Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3813354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3813430Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3813477Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3813642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3813684Z return func(*args, **kwargs) 2025-09-07T07:33:27.3813720Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3813842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3813882Z result = _engine_run_backward( 2025-09-07T07:33:27.3813918Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3814061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3814217Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3814266Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3815696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3815739Z return user_fn(self, *args) 2025-09-07T07:33:27.3815775Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3815918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3815962Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3815998Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3816154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3816201Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3816244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3816365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3816405Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3816440Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3816601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3816652Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3816692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3816829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3816877Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3816917Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3817081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3817130Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3817168Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3817324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3818640Z t = dispatch_trace( 2025-09-07T07:33:27.3818677Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3818789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3818832Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3818868Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3818990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3819033Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3819068Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3819271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3819350Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3819391Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3819513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3819551Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3819589Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3819716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3819759Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3819795Z ^^^^^^^^^ 2025-09-07T07:33:27.3819944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3820032Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3820066Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3820110Z File "", line 1, in 2025-09-07T07:33:27.3820252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3821629Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3821676Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3821812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3821859Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3821899Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3822088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3822141Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3822177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3822345Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3822388Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3822426Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3822567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3822610Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3822646Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3822778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3822866Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3822919Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3823042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3823166Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3823210Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3823338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3824677Z leaves = list(leaves) 2025-09-07T07:33:27.3824714Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3824837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3824872Z return func(x) 2025-09-07T07:33:27.3824904Z ^^^^^^^ 2025-09-07T07:33:27.3825040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3825160Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3825203Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3825369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3825410Z return func(*args, **kwargs) 2025-09-07T07:33:27.3825448Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3825628Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3825713Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3825715Z 2025-09-07T07:33:27.3825918Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3825959Z 2025-09-07T07:33:27.3825961Z 2025-09-07T07:33:27.3826037Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3826230Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3826233Z 2025-09-07T07:33:27.3826318Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3826391Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3826426Z inline_call [] 2025-09-07T07:33:27.3826483Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3826519Z inductor [] 2025-09-07T07:33:27.3826592Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3827966Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3828224Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3828342Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3828427Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3828577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3828661Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3828793Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3828909Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3829022Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3829068Z Traceback (most recent call last): 2025-09-07T07:33:27.3829221Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3829256Z self._run_test( 2025-09-07T07:33:27.3829368Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3829422Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3829463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3829594Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3829640Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3829679Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3829826Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3829871Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3829947Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3831370Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3831417Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3831454Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3831596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3831675Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3831714Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3831864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3831910Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3832057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3832149Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3832189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3832329Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3832381Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3832420Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3832535Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3832601Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3832647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3832771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3832834Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3832881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3833019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3833111Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3834455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3834591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3834632Z return aot_autograd( 2025-09-07T07:33:27.3834667Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3834801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3834870Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3834918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3835084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3835168Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3835213Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3835393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3835436Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3835620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3835659Z fx_g = _create_graph( 2025-09-07T07:33:27.3835695Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3835856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3835893Z fx_g = make_fx( 2025-09-07T07:33:27.3835971Z ^^^^^^^^ 2025-09-07T07:33:27.3836121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3836168Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3836206Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3837651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3837696Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3837733Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3837889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3837927Z t = dispatch_trace( 2025-09-07T07:33:27.3837961Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3838074Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3838160Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3838197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3838321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3838362Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3838397Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3838556Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3838635Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3838678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3838801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3838841Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3838879Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3839008Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3839049Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3839084Z ^^^^^^^^^ 2025-09-07T07:33:27.3839214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3840546Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3840583Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3840731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3840781Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3840814Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3840970Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3841034Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3841081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3841252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3841292Z outs_pair = fn(*args) 2025-09-07T07:33:27.3841327Z ^^^^^^^^^ 2025-09-07T07:33:27.3841496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3841561Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3841606Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3841776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3841815Z outs_pair = fn(*args) 2025-09-07T07:33:27.3841852Z ^^^^^^^^^ 2025-09-07T07:33:27.3842063Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3842122Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3842166Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3842356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3843786Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3843833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3844004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3844042Z outs_pair = fn(*args) 2025-09-07T07:33:27.3844125Z ^^^^^^^^^ 2025-09-07T07:33:27.3844317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3844362Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3844398Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3844564Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3844610Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3844648Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3844771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3844814Z return handle_torch_function( 2025-09-07T07:33:27.3844850Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3844990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3845069Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3845115Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3845280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3845321Z return func(*args, **kwargs) 2025-09-07T07:33:27.3845357Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3845479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3845521Z result = _engine_run_backward( 2025-09-07T07:33:27.3846910Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3847057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3847177Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3847232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3847357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3847400Z return user_fn(self, *args) 2025-09-07T07:33:27.3847435Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3847578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3847621Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3847659Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3847813Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3847858Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3847893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3848060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3848101Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3848137Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3848299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3848351Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3848391Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3848525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3848574Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3849905Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3850065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3850151Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3850189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3850346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3850384Z t = dispatch_trace( 2025-09-07T07:33:27.3850418Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3850530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3850572Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3850609Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3850732Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3850771Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3850806Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3850967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3851047Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3851089Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3851210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3851249Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3851283Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3851408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3851448Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3851483Z ^^^^^^^^^ 2025-09-07T07:33:27.3852907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3852961Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3852998Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3853043Z File "", line 1, in 2025-09-07T07:33:27.3853227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3853306Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3853352Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3853486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3853532Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3853570Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3853759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3853802Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3853842Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3854055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3854101Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3854138Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3854280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3854321Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3854357Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3854489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3854577Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3854623Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3856093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3856154Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3856199Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3856324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3856363Z leaves = list(leaves) 2025-09-07T07:33:27.3856398Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3856519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3856553Z return func(x) 2025-09-07T07:33:27.3856587Z ^^^^^^^ 2025-09-07T07:33:27.3856722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3856786Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3856832Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3857001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3857042Z return func(*args, **kwargs) 2025-09-07T07:33:27.3857077Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3857257Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3857341Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3857344Z 2025-09-07T07:33:27.3857546Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3857549Z 2025-09-07T07:33:27.3857551Z 2025-09-07T07:33:27.3857624Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3857822Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3857825Z 2025-09-07T07:33:27.3857911Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3859263Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3859300Z inline_call [] 2025-09-07T07:33:27.3859357Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3859392Z inductor [] 2025-09-07T07:33:27.3859464Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3859538Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3859793Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3859945Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3860031Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3860180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3860264Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3860395Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3860512Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3860583Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3860617Z inline_call [] 2025-09-07T07:33:27.3860673Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3860781Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3860853Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3861103Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3861211Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3861296Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3861444Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3862829Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3862958Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3863171Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3863221Z =================================== FAILURES =================================== 2025-09-07T07:33:27.3863333Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.3863376Z Traceback (most recent call last): 2025-09-07T07:33:27.3863526Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3863561Z self._run_test( 2025-09-07T07:33:27.3863673Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3863727Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3863768Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3863898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3863952Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3863990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3864139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3864186Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3864226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3864359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3864404Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3864442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3864582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3865953Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3865997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3866193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3866240Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3866389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3866443Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3866484Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3866624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3866675Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3866714Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3866830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3866963Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3867009Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3867133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3867197Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3867238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3867377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3867421Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3867459Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3867597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3867637Z return aot_autograd( 2025-09-07T07:33:27.3867674Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3869110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3869180Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3869229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3869389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3869471Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3869516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3869699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3869741Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3869928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3869970Z fx_g = _create_graph( 2025-09-07T07:33:27.3870006Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3870166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3870202Z fx_g = make_fx( 2025-09-07T07:33:27.3870234Z ^^^^^^^^ 2025-09-07T07:33:27.3870383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3870428Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3870466Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3870611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3870654Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3870692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3870879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3872195Z t = dispatch_trace( 2025-09-07T07:33:27.3872231Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3872343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3872385Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3872422Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3872545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3872586Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3872621Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3872780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3872891Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3872936Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3873122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3873162Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3873197Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3873322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3873362Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3873398Z ^^^^^^^^^ 2025-09-07T07:33:27.3873529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3873570Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3873605Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3873750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3873806Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3875131Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3875286Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3875348Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3875393Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3875564Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3875604Z outs_pair = fn(*args) 2025-09-07T07:33:27.3875638Z ^^^^^^^^^ 2025-09-07T07:33:27.3875808Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3875876Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3875924Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3876096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3876135Z outs_pair = fn(*args) 2025-09-07T07:33:27.3876169Z ^^^^^^^^^ 2025-09-07T07:33:27.3876343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3876402Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3876445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3876635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3876704Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3876794Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3876964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3877002Z outs_pair = fn(*args) 2025-09-07T07:33:27.3878322Z ^^^^^^^^^ 2025-09-07T07:33:27.3878508Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3878554Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3878590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3878755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3878801Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3878839Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3879003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3879046Z return handle_torch_function( 2025-09-07T07:33:27.3879082Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3879221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3879293Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3879340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3879504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3879545Z return func(*args, **kwargs) 2025-09-07T07:33:27.3879580Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3879701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3879746Z result = _engine_run_backward( 2025-09-07T07:33:27.3879785Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3879929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3880046Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3880096Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3881500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3881543Z return user_fn(self, *args) 2025-09-07T07:33:27.3881579Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3881721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3881768Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3881808Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3881965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3882010Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3882046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3882168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3882208Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3882245Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3882407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3882460Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3882500Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3882667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3882719Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3882758Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3882918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3882967Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3883005Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3884528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3884567Z t = dispatch_trace( 2025-09-07T07:33:27.3884603Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3884715Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3884758Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3884834Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3884962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3885002Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3885039Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3885201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3885278Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3885320Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3885441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3885482Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3885516Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3885642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3885686Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3885726Z ^^^^^^^^^ 2025-09-07T07:33:27.3885872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3885922Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3885955Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3885997Z File "", line 1, in 2025-09-07T07:33:27.3887484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3887565Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3887611Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3887746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3887797Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3887837Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3888033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3888077Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3888112Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3888280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3888324Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3888360Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3888504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3888546Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3888583Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3888761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3888850Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3888899Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3889025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3889084Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3889128Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3889252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3890586Z leaves = list(leaves) 2025-09-07T07:33:27.3890622Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3890745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3890812Z return func(x) 2025-09-07T07:33:27.3890849Z ^^^^^^^ 2025-09-07T07:33:27.3890986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3891051Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3891093Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3891258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3891299Z return func(*args, **kwargs) 2025-09-07T07:33:27.3891335Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3891519Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3891604Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3891608Z 2025-09-07T07:33:27.3891813Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3891816Z 2025-09-07T07:33:27.3891817Z 2025-09-07T07:33:27.3891890Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3892087Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3892089Z 2025-09-07T07:33:27.3892174Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3892246Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3892281Z inline_call [] 2025-09-07T07:33:27.3892337Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3892372Z inductor [] 2025-09-07T07:33:27.3893818Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3893899Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3894153Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3894264Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3894350Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3894502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3894585Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3894716Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3894885Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3894956Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3894991Z inline_call [] 2025-09-07T07:33:27.3895048Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3895121Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3895192Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3895448Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3895556Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3895641Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3895829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3895913Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3896041Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3896157Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3897528Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3897564Z inline_call [] 2025-09-07T07:33:27.3897620Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3897694Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3897763Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3898017Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3898127Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3898211Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3898357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3898439Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3898566Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3898682Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3898897Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-8400466b498c8e68.xml - 2025-09-07T07:33:27.3898959Z =========================== short test summary info ============================ 2025-09-07T07:33:27.3899316Z FAILED [0.4489s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3899399Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3899401Z 2025-09-07T07:33:27.3899603Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3899606Z 2025-09-07T07:33:27.3899607Z 2025-09-07T07:33:27.3899678Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3899908Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.3899913Z 2025-09-07T07:33:27.3899997Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3900056Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.3900121Z ================== 1 failed, 220 deselected, 2 rerun in 1.76s ================== 2025-09-07T07:33:27.3901444Z Got exit code 1 2025-09-07T07:33:27.3901569Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.3901990Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.3902064Z import pkg_resources 2025-09-07T07:33:27.3902233Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-9b965b21629ee18b.xml 2025-09-07T07:33:27.3902287Z ============================= test session starts ============================== 2025-09-07T07:33:27.3902399Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.3902437Z cachedir: .pytest_cache 2025-09-07T07:33:27.3902591Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.3902636Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.3902675Z configfile: pytest.ini 2025-09-07T07:33:27.3902834Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.3902909Z collecting ... collected 467 items / 31 deselected / 436 selected 2025-09-07T07:33:27.3902962Z stepcurrent: skipping 31 already run items. 2025-09-07T07:33:27.3903005Z Running 190 items in this shard 2025-09-07T07:33:27.3903007Z 2025-09-07T07:33:27.3903292Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.3228s] [ 0%] 2025-09-07T07:33:27.3903484Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.0970s] [ 0%] 2025-09-07T07:33:27.3903654Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True FAILED [1.3092s] [ 0%] 2025-09-07T07:33:27.3903656Z 2025-09-07T07:33:27.3903705Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.3903814Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.3903861Z Traceback (most recent call last): 2025-09-07T07:33:27.3905322Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3905360Z self._run_test( 2025-09-07T07:33:27.3905471Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3905526Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3905567Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3905699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3905745Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3905785Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3905932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3905978Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3906066Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3906200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3906245Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3906283Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3906424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3906504Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3906543Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3906691Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3906738Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3906887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3907006Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3907046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3908487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3908540Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3908580Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3908695Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3908761Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3908805Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3908930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3908993Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3909043Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3909181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3909226Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3909264Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3909400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3909439Z return aot_autograd( 2025-09-07T07:33:27.3909473Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3909607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3909675Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3909723Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3909886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3909970Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3910015Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3911473Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3911518Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3911701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3911741Z fx_g = _create_graph( 2025-09-07T07:33:27.3911777Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3911937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3911974Z fx_g = make_fx( 2025-09-07T07:33:27.3912056Z ^^^^^^^^ 2025-09-07T07:33:27.3912206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3912252Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3912291Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3912436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3912479Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3912515Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3912672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3912709Z t = dispatch_trace( 2025-09-07T07:33:27.3912743Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3912854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3912932Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3912967Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3913142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3913182Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3914518Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3914678Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3914758Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3914801Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3914927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3914966Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3915005Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3915134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3915177Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3915213Z ^^^^^^^^^ 2025-09-07T07:33:27.3915344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3915385Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3915420Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3915568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3915618Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3915652Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3915806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3915871Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3915918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3916089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3916128Z outs_pair = fn(*args) 2025-09-07T07:33:27.3917444Z ^^^^^^^^^ 2025-09-07T07:33:27.3917614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3917680Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3917724Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3917895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3917933Z outs_pair = fn(*args) 2025-09-07T07:33:27.3917969Z ^^^^^^^^^ 2025-09-07T07:33:27.3918194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3918255Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3918297Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3918489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3918559Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3918605Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3918774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3918812Z outs_pair = fn(*args) 2025-09-07T07:33:27.3918884Z ^^^^^^^^^ 2025-09-07T07:33:27.3919073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3919119Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3919155Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3919322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3919367Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3919404Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3920814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3920859Z return handle_torch_function( 2025-09-07T07:33:27.3920896Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3921035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3921118Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3921166Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3921333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3921375Z return func(*args, **kwargs) 2025-09-07T07:33:27.3921410Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3921537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3921579Z result = _engine_run_backward( 2025-09-07T07:33:27.3921615Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3921758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3921877Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3921935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3922060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3922101Z return user_fn(self, *args) 2025-09-07T07:33:27.3922138Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3922279Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3922323Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3922360Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3923860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3923906Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3923943Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3924112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3924152Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3924189Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3924349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3924402Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3924442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3924576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3924624Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3924664Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3924824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3924918Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3924956Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3925117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3925155Z t = dispatch_trace( 2025-09-07T07:33:27.3925189Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3925300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3925343Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3925379Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3925502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3926888Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3926925Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3927087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3927170Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3927211Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3927333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3927372Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3927406Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3927531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3927572Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3927608Z ^^^^^^^^^ 2025-09-07T07:33:27.3927754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3927804Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3927840Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3927886Z File "", line 1, in 2025-09-07T07:33:27.3928025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3928103Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3928150Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3928290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3928336Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3928375Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3928563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3929887Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3929926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3930131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3930176Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3930214Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3930354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3930396Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3930432Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3930565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3930652Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3930699Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3930860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3930920Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3930964Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3931088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3931127Z leaves = list(leaves) 2025-09-07T07:33:27.3931161Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3931282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3931316Z return func(x) 2025-09-07T07:33:27.3931350Z ^^^^^^^ 2025-09-07T07:33:27.3931487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3932844Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3932891Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3933118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3933160Z return func(*args, **kwargs) 2025-09-07T07:33:27.3933196Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3933374Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3933458Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3933461Z 2025-09-07T07:33:27.3933662Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3933664Z 2025-09-07T07:33:27.3933666Z 2025-09-07T07:33:27.3933739Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3933939Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.3933941Z 2025-09-07T07:33:27.3934027Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3934100Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3934135Z inline_call [] 2025-09-07T07:33:27.3934191Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3934226Z inductor [] 2025-09-07T07:33:27.3934299Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3934370Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3934622Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3935170Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3935256Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3935406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3935491Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3936945Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3937063Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3937173Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.3937217Z Traceback (most recent call last): 2025-09-07T07:33:27.3937370Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3937452Z self._run_test( 2025-09-07T07:33:27.3937564Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3937619Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3937660Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3937790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3937837Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3937875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3938023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3938068Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3938108Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3938242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3938288Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3938326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3938464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3938545Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3938583Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3940013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3940063Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3940210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3940264Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3940309Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3940451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3940503Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3940542Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3940658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3940724Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3940769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3940893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3940956Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3940998Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3941170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3941215Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3941253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3941387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3941427Z return aot_autograd( 2025-09-07T07:33:27.3941462Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3941596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3941664Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3942985Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3943200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3943340Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3943385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3943571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3943613Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3943797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3943836Z fx_g = _create_graph( 2025-09-07T07:33:27.3943872Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3944032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3944067Z fx_g = make_fx( 2025-09-07T07:33:27.3944100Z ^^^^^^^^ 2025-09-07T07:33:27.3944253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3944300Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3944338Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3944483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3944525Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3944562Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3944718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3944756Z t = dispatch_trace( 2025-09-07T07:33:27.3944789Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3946196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3946239Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3946279Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3946406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3946447Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3946482Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3946643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3946720Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3946762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3946886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3946925Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3946959Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3947084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3947174Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3947210Z ^^^^^^^^^ 2025-09-07T07:33:27.3947341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3947381Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3947417Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3947563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3947613Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3947647Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3947804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3949146Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3949192Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3949404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3949444Z outs_pair = fn(*args) 2025-09-07T07:33:27.3949478Z ^^^^^^^^^ 2025-09-07T07:33:27.3949647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3949712Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3949757Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3949926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3949965Z outs_pair = fn(*args) 2025-09-07T07:33:27.3949998Z ^^^^^^^^^ 2025-09-07T07:33:27.3950176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3950239Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3950282Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3950474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3950545Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3950591Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3950760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3950799Z outs_pair = fn(*args) 2025-09-07T07:33:27.3950833Z ^^^^^^^^^ 2025-09-07T07:33:27.3951019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3952345Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3952383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3952550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3952596Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3952633Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3952755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3952798Z return handle_torch_function( 2025-09-07T07:33:27.3952834Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3952973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3953046Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3953209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3953376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3953416Z return func(*args, **kwargs) 2025-09-07T07:33:27.3953453Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3953574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3953616Z result = _engine_run_backward( 2025-09-07T07:33:27.3953652Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3953797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3953915Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3953965Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3954132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3954174Z return user_fn(self, *args) 2025-09-07T07:33:27.3955506Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3955650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3955692Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3955730Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3955884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3955928Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3955963Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3956086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3956131Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3956171Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3956332Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3956384Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3956424Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3956561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3956610Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3956649Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3956810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3956857Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3956900Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3957059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3957097Z t = dispatch_trace( 2025-09-07T07:33:27.3957131Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3958520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3958562Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3958600Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3958721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3958761Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3958796Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3958954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3959034Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3959112Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3959234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3959273Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3959308Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3959432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3959472Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3959508Z ^^^^^^^^^ 2025-09-07T07:33:27.3959653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3959702Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3959736Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3959777Z File "", line 1, in 2025-09-07T07:33:27.3959955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3960032Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3961357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3961496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3961544Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3961583Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3961772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3961815Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3961852Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3962019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3962071Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3962107Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3962249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3962291Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3962327Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3962459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3962547Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3962593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3962717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3962780Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3962827Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3962951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3962990Z leaves = list(leaves) 2025-09-07T07:33:27.3963024Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3964500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3964536Z return func(x) 2025-09-07T07:33:27.3964569Z ^^^^^^^ 2025-09-07T07:33:27.3964707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3964772Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3964814Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3964979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3965077Z return func(*args, **kwargs) 2025-09-07T07:33:27.3965114Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3965292Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3965375Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3965377Z 2025-09-07T07:33:27.3965580Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3965582Z 2025-09-07T07:33:27.3965584Z 2025-09-07T07:33:27.3965656Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3965851Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.3965889Z 2025-09-07T07:33:27.3965976Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.3966049Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3966085Z inline_call [] 2025-09-07T07:33:27.3966141Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3966174Z inductor [] 2025-09-07T07:33:27.3966248Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3966318Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3967914Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3968027Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3968117Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3968274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3968359Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3968488Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3968607Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3968678Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.3968714Z inline_call [] 2025-09-07T07:33:27.3968770Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.3968842Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.3968911Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.3969168Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.3969276Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.3969362Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.3969509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.3969592Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.3969721Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.3969838Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3969923Z =================================== FAILURES =================================== 2025-09-07T07:33:27.3970034Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.3970078Z Traceback (most recent call last): 2025-09-07T07:33:27.3971518Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.3971554Z self._run_test( 2025-09-07T07:33:27.3971668Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.3971721Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.3971762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3971893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.3971939Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.3971978Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3972164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.3972209Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.3972249Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3972383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.3972427Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.3972465Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3972607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.3972686Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.3972725Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3972873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.3972922Z raise BackendCompilerFailed( 2025-09-07T07:33:27.3973132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.3973186Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3974523Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3974666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.3974717Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.3974756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3974871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.3974936Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.3974984Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3975118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.3975181Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.3975222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3975360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.3975404Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.3975442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3975577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.3975616Z return aot_autograd( 2025-09-07T07:33:27.3975651Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.3975787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.3975907Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.3975954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3976112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.3976194Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.3976239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3977708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.3977752Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.3977936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.3978018Z fx_g = _create_graph( 2025-09-07T07:33:27.3978054Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3978219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.3978254Z fx_g = make_fx( 2025-09-07T07:33:27.3978286Z ^^^^^^^^ 2025-09-07T07:33:27.3978440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.3978486Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.3978524Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3978669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.3978712Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.3978749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3978904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3978946Z t = dispatch_trace( 2025-09-07T07:33:27.3978981Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3979092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3979133Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3979169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3979293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3980606Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3980643Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3980805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3980882Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3980924Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3981052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3981091Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3981126Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3981250Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3981291Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3981327Z ^^^^^^^^^ 2025-09-07T07:33:27.3981457Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.3981498Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.3981533Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3981681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3981731Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3981769Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3981953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.3982015Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.3982060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3982232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3982271Z outs_pair = fn(*args) 2025-09-07T07:33:27.3983654Z ^^^^^^^^^ 2025-09-07T07:33:27.3983825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.3983890Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.3983935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3984149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3984188Z outs_pair = fn(*args) 2025-09-07T07:33:27.3984222Z ^^^^^^^^^ 2025-09-07T07:33:27.3984396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.3984455Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.3984499Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3984689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.3984758Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.3984803Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3984976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.3985013Z outs_pair = fn(*args) 2025-09-07T07:33:27.3985048Z ^^^^^^^^^ 2025-09-07T07:33:27.3985236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3985281Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3985318Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3985484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.3985529Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.3986857Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3986982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.3987029Z return handle_torch_function( 2025-09-07T07:33:27.3987067Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3987206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.3987279Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.3987325Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3987489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3987529Z return func(*args, **kwargs) 2025-09-07T07:33:27.3987565Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3987687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.3987730Z result = _engine_run_backward( 2025-09-07T07:33:27.3987765Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3987950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.3988068Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.3988118Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3988242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.3988284Z return user_fn(self, *args) 2025-09-07T07:33:27.3988320Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3988463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.3988506Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.3988543Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3989986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.3990063Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.3990099Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3990223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3990263Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3990299Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3990461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.3990513Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.3990554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3990688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.3990737Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.3990781Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3990939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.3990986Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.3991025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3991180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.3991219Z t = dispatch_trace( 2025-09-07T07:33:27.3991253Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3991365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.3991407Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.3991444Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3991565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3992897Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3992932Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3993142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.3993221Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.3993262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3993385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.3993424Z return fn(*args, **kwargs) 2025-09-07T07:33:27.3993458Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3993582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.3993623Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.3993658Z ^^^^^^^^^ 2025-09-07T07:33:27.3993853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.3993903Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.3993937Z ^^^^^^^^^^^ 2025-09-07T07:33:27.3993981Z File "", line 1, in 2025-09-07T07:33:27.3994121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.3994199Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.3994245Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3994379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.3994426Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.3994464Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3995990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.3996034Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.3996071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3996239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.3996284Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.3996320Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3996464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.3996506Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.3996542Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3996674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.3996767Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.3996814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3996937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.3996997Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.3997042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3997166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.3997206Z leaves = list(leaves) 2025-09-07T07:33:27.3997240Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.3997361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.3997395Z return func(x) 2025-09-07T07:33:27.3997427Z ^^^^^^^ 2025-09-07T07:33:27.3997569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.3998905Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.3998948Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3999113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.3999154Z return func(*args, **kwargs) 2025-09-07T07:33:27.3999190Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.3999368Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.3999452Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.3999455Z 2025-09-07T07:33:27.3999662Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.3999669Z 2025-09-07T07:33:27.3999719Z 2025-09-07T07:33:27.3999793Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.3999987Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.3999989Z 2025-09-07T07:33:27.4000075Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4000147Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4000182Z inline_call [] 2025-09-07T07:33:27.4000239Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4000273Z inductor [] 2025-09-07T07:33:27.4000347Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4000418Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4000708Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4000819Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4000904Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4001052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4002430Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4002562Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4002679Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4002749Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4002793Z inline_call [] 2025-09-07T07:33:27.4002849Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4002922Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4002991Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4003314Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4003423Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4003508Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4003654Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4003745Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4003873Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4003990Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4004059Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4004094Z inline_call [] 2025-09-07T07:33:27.4004148Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4004219Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4004287Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4004539Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4004703Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4006086Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4006232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4006315Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4006442Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4006558Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4006838Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-9b965b21629ee18b.xml - 2025-09-07T07:33:27.4006896Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4007303Z FAILED [1.3092s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4007386Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4007388Z 2025-09-07T07:33:27.4007589Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4007593Z 2025-09-07T07:33:27.4007595Z 2025-09-07T07:33:27.4007665Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4007858Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4007863Z 2025-09-07T07:33:27.4007947Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4008007Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4008072Z ================== 1 failed, 31 deselected, 2 rerun in 3.93s =================== 2025-09-07T07:33:27.4008107Z Got exit code 1 2025-09-07T07:33:27.4008145Z Retrying single test... 2025-09-07T07:33:27.4008561Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4008599Z import pkg_resources 2025-09-07T07:33:27.4008766Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-f7e83c66a72e1b3c.xml 2025-09-07T07:33:27.4008824Z ============================= test session starts ============================== 2025-09-07T07:33:27.4010241Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4010281Z cachedir: .pytest_cache 2025-09-07T07:33:27.4010437Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4010482Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4010521Z configfile: pytest.ini 2025-09-07T07:33:27.4010679Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4010755Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.4010982Z stepcurrent: skipping 31 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4011029Z Running 1 items in this shard 2025-09-07T07:33:27.4011067Z 2025-09-07T07:33:27.4011260Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.5806s] [100%] 2025-09-07T07:33:27.4011450Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.1772s] [100%] 2025-09-07T07:33:27.4011614Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True FAILED [1.4786s] [100%] 2025-09-07T07:33:27.4011617Z 2025-09-07T07:33:27.4011666Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4011774Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.4011817Z Traceback (most recent call last): 2025-09-07T07:33:27.4012000Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4012036Z self._run_test( 2025-09-07T07:33:27.4012147Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4012203Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4012244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4012376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4013793Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4013835Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4013984Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4014030Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4014069Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4014213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4014258Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4014295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4014435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4014515Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4014554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4014703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4014749Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4014896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4014953Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4014995Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4015135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4015185Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4015225Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4015339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4015404Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4015448Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4016865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4016929Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4016971Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4017162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4017207Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4017245Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4017380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4017419Z return aot_autograd( 2025-09-07T07:33:27.4017454Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4017588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4017657Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4017703Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4017861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4017990Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4018035Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4018215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4018258Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4018442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4018482Z fx_g = _create_graph( 2025-09-07T07:33:27.4018518Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4018677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4020001Z fx_g = make_fx( 2025-09-07T07:33:27.4020038Z ^^^^^^^^ 2025-09-07T07:33:27.4020192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4020238Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4020277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4020424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4020467Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4020504Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4020660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4020697Z t = dispatch_trace( 2025-09-07T07:33:27.4020732Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4020843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4020886Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4020925Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4021049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4021089Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4021125Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4021283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4021361Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4021402Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4021525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4021564Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4022876Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4023004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4023157Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4023194Z ^^^^^^^^^ 2025-09-07T07:33:27.4023324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4023366Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4023401Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4023548Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4023597Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4023632Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4023786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4023849Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4023932Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4024108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4024147Z outs_pair = fn(*args) 2025-09-07T07:33:27.4024182Z ^^^^^^^^^ 2025-09-07T07:33:27.4024350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4024415Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4024459Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4024630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4024667Z outs_pair = fn(*args) 2025-09-07T07:33:27.4025999Z ^^^^^^^^^ 2025-09-07T07:33:27.4026183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4026243Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4026286Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4026477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4026546Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4026593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4026761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4026798Z outs_pair = fn(*args) 2025-09-07T07:33:27.4026833Z ^^^^^^^^^ 2025-09-07T07:33:27.4027022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4027070Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4027107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4027274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4027319Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4027357Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4027480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4027523Z return handle_torch_function( 2025-09-07T07:33:27.4027559Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4027699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4027775Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4027860Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4029311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4029355Z return func(*args, **kwargs) 2025-09-07T07:33:27.4029391Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4029513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4029555Z result = _engine_run_backward( 2025-09-07T07:33:27.4029592Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4029735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4029856Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4029945Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4030070Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4030111Z return user_fn(self, *args) 2025-09-07T07:33:27.4030149Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4030289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4030333Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4030370Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4030527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4030571Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4030607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4030730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4030773Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4030810Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4030971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4032309Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4032350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4032484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4032532Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4032571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4032730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4032778Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4032822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4032979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4033017Z t = dispatch_trace( 2025-09-07T07:33:27.4033052Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4033228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4033271Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4033307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4033429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4033468Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4033502Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4033661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4033785Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4033827Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4033949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4035286Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4035321Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4035447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4035488Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4035525Z ^^^^^^^^^ 2025-09-07T07:33:27.4035671Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4035721Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4035755Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4035839Z File "", line 1, in 2025-09-07T07:33:27.4035985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4036063Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4036109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4036243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4036290Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4036329Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4036515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4036558Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4036593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4036765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4036809Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4036846Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4036987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4038309Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4038345Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4038478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4038566Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4038613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4038737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4038803Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4038847Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4038971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4039011Z leaves = list(leaves) 2025-09-07T07:33:27.4039045Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4039166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4039200Z return func(x) 2025-09-07T07:33:27.4039233Z ^^^^^^^ 2025-09-07T07:33:27.4039369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4039434Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4039475Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4039672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4039713Z return func(*args, **kwargs) 2025-09-07T07:33:27.4039750Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4039928Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4041305Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4041308Z 2025-09-07T07:33:27.4041512Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4041515Z 2025-09-07T07:33:27.4041516Z 2025-09-07T07:33:27.4041590Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4041784Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4041848Z 2025-09-07T07:33:27.4041934Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4042006Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4042042Z inline_call [] 2025-09-07T07:33:27.4042099Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4042134Z inductor [] 2025-09-07T07:33:27.4042208Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4042282Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4042538Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4042649Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4042740Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4042889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4042973Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4043159Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4043280Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4043388Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.4043432Z Traceback (most recent call last): 2025-09-07T07:33:27.4043582Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4043621Z self._run_test( 2025-09-07T07:33:27.4045042Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4045098Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4045139Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4045269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4045316Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4045354Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4045501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4045547Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4045586Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4045719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4045768Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4045849Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4045990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4046070Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4046109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4046258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4046303Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4046452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4046504Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4046545Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4046803Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4048153Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4048193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4048310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4048374Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4048419Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4048542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4048606Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4048646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4048786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4048837Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4048875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4049009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4049048Z return aot_autograd( 2025-09-07T07:33:27.4049084Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4049218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4049286Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4049332Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4049491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4049574Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4049624Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4049804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4049847Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4051313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4051353Z fx_g = _create_graph( 2025-09-07T07:33:27.4051389Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4051551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4051585Z fx_g = make_fx( 2025-09-07T07:33:27.4051619Z ^^^^^^^^ 2025-09-07T07:33:27.4051767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4051851Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4051889Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4052035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4052077Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4052114Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4052269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4052308Z t = dispatch_trace( 2025-09-07T07:33:27.4052344Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4052455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4052496Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4052533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4052687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4052729Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4052765Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4054291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4054370Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4054413Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4054537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4054576Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4054611Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4054737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4054779Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4054818Z ^^^^^^^^^ 2025-09-07T07:33:27.4054955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4054995Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4055034Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4055180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4055230Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4055264Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4055419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4055481Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4055527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4055704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4055746Z outs_pair = fn(*args) 2025-09-07T07:33:27.4055782Z ^^^^^^^^^ 2025-09-07T07:33:27.4055950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4057301Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4057347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4057517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4057556Z outs_pair = fn(*args) 2025-09-07T07:33:27.4057589Z ^^^^^^^^^ 2025-09-07T07:33:27.4057765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4057827Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4057923Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4058114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4058184Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4058229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4058399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4058437Z outs_pair = fn(*args) 2025-09-07T07:33:27.4058471Z ^^^^^^^^^ 2025-09-07T07:33:27.4058656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4058738Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4058776Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4058941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4058988Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4059024Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4059148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4059191Z return handle_torch_function( 2025-09-07T07:33:27.4060546Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4060685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4060760Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4060807Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4060979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4061020Z return func(*args, **kwargs) 2025-09-07T07:33:27.4061057Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4061178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4061221Z result = _engine_run_backward( 2025-09-07T07:33:27.4061257Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4061401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4061520Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4061571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4061703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4061744Z return user_fn(self, *args) 2025-09-07T07:33:27.4061780Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4061920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4061963Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4062001Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4062155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4062199Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4063588Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4063713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4063753Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4063791Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4064018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4064070Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4064110Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4064244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4064293Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4064332Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4064492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4064539Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4064579Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4064737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4064817Z t = dispatch_trace( 2025-09-07T07:33:27.4064851Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4064965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4065007Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4065043Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4065166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4065205Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4065240Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4066697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4066775Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4066820Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4066948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4066988Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4067022Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4067147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4067188Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4067223Z ^^^^^^^^^ 2025-09-07T07:33:27.4067369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4067418Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4067452Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4067494Z File "", line 1, in 2025-09-07T07:33:27.4067635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4067718Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4067765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4067898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4067946Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4067984Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4068172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4068214Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4069533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4069702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4069749Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4069821Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4069964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4070006Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4070042Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4070173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4070260Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4070306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4070429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4070489Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4070561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4070688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4070727Z leaves = list(leaves) 2025-09-07T07:33:27.4070761Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4070882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4070917Z return func(x) 2025-09-07T07:33:27.4070949Z ^^^^^^^ 2025-09-07T07:33:27.4071084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4071148Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4071190Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4072637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4072684Z return func(*args, **kwargs) 2025-09-07T07:33:27.4072724Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4072904Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4072987Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4072990Z 2025-09-07T07:33:27.4073262Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4073265Z 2025-09-07T07:33:27.4073267Z 2025-09-07T07:33:27.4073340Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4073533Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4073535Z 2025-09-07T07:33:27.4073623Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4073699Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4073734Z inline_call [] 2025-09-07T07:33:27.4073790Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4073824Z inductor [] 2025-09-07T07:33:27.4073899Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4073969Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4074223Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4074334Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4074419Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4074614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4074700Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4074829Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4076252Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4076324Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4076360Z inline_call [] 2025-09-07T07:33:27.4076416Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4076489Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4076557Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4076812Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4076966Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4077050Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4077197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4077281Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4077409Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4077525Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4077574Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4077687Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.4077731Z Traceback (most recent call last): 2025-09-07T07:33:27.4077880Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4077914Z self._run_test( 2025-09-07T07:33:27.4078025Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4078079Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4078120Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4078250Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4079581Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4079623Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4079780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4079830Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4079869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4080003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4080048Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4080085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4080226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4080305Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4080343Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4080493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4080541Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4080720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4080774Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4080816Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4080955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4081007Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4081046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4081160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4081225Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4082556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4082682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4082782Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4082823Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4082962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4083006Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4083046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4083492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4083532Z return aot_autograd( 2025-09-07T07:33:27.4083567Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4083701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4083768Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4083820Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4083979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4084061Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4084106Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4084285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4084328Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4084511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4084550Z fx_g = _create_graph( 2025-09-07T07:33:27.4084586Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4084751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4086102Z fx_g = make_fx( 2025-09-07T07:33:27.4086135Z ^^^^^^^^ 2025-09-07T07:33:27.4086285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4086331Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4086369Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4086513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4086557Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4086594Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4086861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4086903Z t = dispatch_trace( 2025-09-07T07:33:27.4086937Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4087100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4087142Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4087178Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4087301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4087342Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4087377Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4087536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4087614Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4087655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4087778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4089162Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4089198Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4089324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4089365Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4089400Z ^^^^^^^^^ 2025-09-07T07:33:27.4089531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4089572Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4089607Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4089754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4089803Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4089837Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4089998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4090060Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4090105Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4090277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4090316Z outs_pair = fn(*args) 2025-09-07T07:33:27.4090350Z ^^^^^^^^^ 2025-09-07T07:33:27.4090518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4090582Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4090627Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4090795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4090841Z outs_pair = fn(*args) 2025-09-07T07:33:27.4092154Z ^^^^^^^^^ 2025-09-07T07:33:27.4092330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4092389Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4092432Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4092623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4092693Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4092738Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4092906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4092980Z outs_pair = fn(*args) 2025-09-07T07:33:27.4093017Z ^^^^^^^^^ 2025-09-07T07:33:27.4093268Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4093314Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4093350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4093519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4093564Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4093601Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4093725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4093767Z return handle_torch_function( 2025-09-07T07:33:27.4093842Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4093985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4094060Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4094105Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4095587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4095627Z return func(*args, **kwargs) 2025-09-07T07:33:27.4095664Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4095785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4095828Z result = _engine_run_backward( 2025-09-07T07:33:27.4095864Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4096007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4096134Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4096185Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4096309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4096351Z return user_fn(self, *args) 2025-09-07T07:33:27.4096387Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4096528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4096571Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4096608Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4096762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4096810Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4096851Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4096973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4097012Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4097048Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4098490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4098544Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4098584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4098719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4098767Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4098807Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4099023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4099071Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4099111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4099266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4099305Z t = dispatch_trace( 2025-09-07T07:33:27.4099340Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4099451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4099493Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4099530Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4099651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4099722Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4099757Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4099917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4099993Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4100034Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4100157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4101477Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4101513Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4101638Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4101678Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4101713Z ^^^^^^^^^ 2025-09-07T07:33:27.4101859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4101917Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4101950Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4101992Z File "", line 1, in 2025-09-07T07:33:27.4102133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4102211Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4102256Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4102391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4102438Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4102477Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4102666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4102713Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4102750Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4102918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4102962Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4102998Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4104496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4104540Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4104577Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4104709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4104797Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4104889Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4105014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4105074Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4105119Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4105242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4105281Z leaves = list(leaves) 2025-09-07T07:33:27.4105316Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4105437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4105471Z return func(x) 2025-09-07T07:33:27.4105504Z ^^^^^^^ 2025-09-07T07:33:27.4105639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4105748Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4105790Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4105954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4105997Z return func(*args, **kwargs) 2025-09-07T07:33:27.4106032Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4106216Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4107594Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4107598Z 2025-09-07T07:33:27.4107802Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4107809Z 2025-09-07T07:33:27.4107810Z 2025-09-07T07:33:27.4107889Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4108083Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4108085Z 2025-09-07T07:33:27.4108170Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4108242Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4108278Z inline_call [] 2025-09-07T07:33:27.4108334Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4108369Z inductor [] 2025-09-07T07:33:27.4108443Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4108514Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4108770Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4108883Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4108969Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4109118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4109202Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4109332Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4109450Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4109520Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4109557Z inline_call [] 2025-09-07T07:33:27.4109647Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4111020Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4111090Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4111342Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4111450Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4111535Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4111682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4111766Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4111933Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4112051Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4112120Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4112155Z inline_call [] 2025-09-07T07:33:27.4112209Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4112281Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4112348Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4112598Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4112705Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4112792Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4112939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4113021Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4113229Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4113345Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4113557Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-f7e83c66a72e1b3c.xml - 2025-09-07T07:33:27.4114934Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4115291Z FAILED [1.4786s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4115380Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4115382Z 2025-09-07T07:33:27.4115584Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4115587Z 2025-09-07T07:33:27.4115591Z 2025-09-07T07:33:27.4115661Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4115855Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4115858Z 2025-09-07T07:33:27.4115940Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4116054Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4116120Z ================== 1 failed, 220 deselected, 2 rerun in 4.46s ================== 2025-09-07T07:33:27.4116155Z Got exit code 1 2025-09-07T07:33:27.4116193Z Retrying single test... 2025-09-07T07:33:27.4116607Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4116647Z import pkg_resources 2025-09-07T07:33:27.4116814Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-4427bb6647e4698a.xml 2025-09-07T07:33:27.4116869Z ============================= test session starts ============================== 2025-09-07T07:33:27.4117021Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4117061Z cachedir: .pytest_cache 2025-09-07T07:33:27.4117217Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4117262Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4117300Z configfile: pytest.ini 2025-09-07T07:33:27.4117459Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4118834Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.4119063Z stepcurrent: skipping 31 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4119105Z Running 1 items in this shard 2025-09-07T07:33:27.4119113Z 2025-09-07T07:33:27.4119309Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.6053s] [100%] 2025-09-07T07:33:27.4119501Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.2009s] [100%] 2025-09-07T07:33:27.4119666Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True FAILED [1.2295s] [100%] 2025-09-07T07:33:27.4119668Z 2025-09-07T07:33:27.4119717Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4119826Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.4119870Z Traceback (most recent call last): 2025-09-07T07:33:27.4120023Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4120062Z self._run_test( 2025-09-07T07:33:27.4120175Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4120231Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4120273Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4120407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4120455Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4120494Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4120644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4120690Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4120729Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4120864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4122231Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4122271Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4122412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4122492Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4122532Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4122682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4122729Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4122876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4122930Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4123006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4123215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4123267Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4123307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4123420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4123487Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4123531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4123657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4123720Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4123762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4123903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4123950Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4123989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4125441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4125481Z return aot_autograd( 2025-09-07T07:33:27.4125518Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4125655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4125722Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4125768Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4125926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4126016Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4126067Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4126247Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4126291Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4126476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4126515Z fx_g = _create_graph( 2025-09-07T07:33:27.4126552Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4126800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4126836Z fx_g = make_fx( 2025-09-07T07:33:27.4126868Z ^^^^^^^^ 2025-09-07T07:33:27.4127068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4127117Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4127156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4127301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4128656Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4128694Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4128853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4128891Z t = dispatch_trace( 2025-09-07T07:33:27.4128926Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4129037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4129080Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4129159Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4129287Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4129329Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4129364Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4129523Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4129602Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4129644Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4129766Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4129806Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4129840Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4129966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4130011Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4130051Z ^^^^^^^^^ 2025-09-07T07:33:27.4130184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4130225Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4131554Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4131703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4131753Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4131788Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4131944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4132007Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4132051Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4132229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4132268Z outs_pair = fn(*args) 2025-09-07T07:33:27.4132304Z ^^^^^^^^^ 2025-09-07T07:33:27.4132473Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4132540Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4132584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4132755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4132794Z outs_pair = fn(*args) 2025-09-07T07:33:27.4132828Z ^^^^^^^^^ 2025-09-07T07:33:27.4133002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4133172Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4133216Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4133406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4133477Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4133522Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4135001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4135039Z outs_pair = fn(*args) 2025-09-07T07:33:27.4135074Z ^^^^^^^^^ 2025-09-07T07:33:27.4135260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4135353Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4135390Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4135555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4135601Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4135638Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4135762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4135804Z return handle_torch_function( 2025-09-07T07:33:27.4135840Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4135980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4136054Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4136102Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4136270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4136311Z return func(*args, **kwargs) 2025-09-07T07:33:27.4136346Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4136468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4136510Z result = _engine_run_backward( 2025-09-07T07:33:27.4136545Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4137992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4138112Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4138163Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4138294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4138335Z return user_fn(self, *args) 2025-09-07T07:33:27.4138372Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4138515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4138557Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4138594Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4138749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4138794Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4138830Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4138952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4138994Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4139061Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4139224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4139277Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4139317Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4139450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4139499Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4139539Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4139696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4141051Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4141091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4141283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4141321Z t = dispatch_trace( 2025-09-07T07:33:27.4141356Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4141468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4141510Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4141546Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4141670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4141708Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4141743Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4141907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4141985Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4142032Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4142155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4142194Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4142228Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4142354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4142395Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4142430Z ^^^^^^^^^ 2025-09-07T07:33:27.4142577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4144000Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4144036Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4144079Z File "", line 1, in 2025-09-07T07:33:27.4144224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4144307Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4144353Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4144487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4144534Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4144573Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4144760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4144804Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4144839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4145007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4145098Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4145137Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4145279Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4145321Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4145358Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4145490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4145578Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4145624Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4145748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4147108Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4147201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4147326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4147365Z leaves = list(leaves) 2025-09-07T07:33:27.4147400Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4147522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4147557Z return func(x) 2025-09-07T07:33:27.4147590Z ^^^^^^^ 2025-09-07T07:33:27.4147726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4147792Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4147834Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4147999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4148046Z return func(*args, **kwargs) 2025-09-07T07:33:27.4148083Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4148264Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4148349Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4148352Z 2025-09-07T07:33:27.4148557Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4148560Z 2025-09-07T07:33:27.4148562Z 2025-09-07T07:33:27.4148634Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4148829Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4148834Z 2025-09-07T07:33:27.4148921Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4148992Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4150331Z inline_call [] 2025-09-07T07:33:27.4150389Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4150424Z inductor [] 2025-09-07T07:33:27.4150498Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4150570Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4150821Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4150933Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4151017Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4151211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4151295Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4151427Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4151544Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4151653Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.4151696Z Traceback (most recent call last): 2025-09-07T07:33:27.4151845Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4151879Z self._run_test( 2025-09-07T07:33:27.4151992Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4152080Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4152122Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4152252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4152298Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4152336Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4153900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4153947Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4153987Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4154121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4154165Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4154208Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4154352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4154433Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4154471Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4154621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4154666Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4154814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4154867Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4154908Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4155048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4155103Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4155142Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4155257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4155322Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4155366Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4155493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4156854Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4156897Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4157036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4157082Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4157170Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4157306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4157345Z return aot_autograd( 2025-09-07T07:33:27.4157380Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4157515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4157582Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4157629Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4157786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4157869Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4157914Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4158139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4158182Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4158365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4158405Z fx_g = _create_graph( 2025-09-07T07:33:27.4158439Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4158600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4158634Z fx_g = make_fx( 2025-09-07T07:33:27.4158669Z ^^^^^^^^ 2025-09-07T07:33:27.4160120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4160172Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4160215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4160361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4160404Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4160441Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4160597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4160635Z t = dispatch_trace( 2025-09-07T07:33:27.4160669Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4160780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4160822Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4160858Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4160980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4161023Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4161062Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4161224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4161301Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4161342Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4161465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4161504Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4161539Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4161664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4163004Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4163039Z ^^^^^^^^^ 2025-09-07T07:33:27.4163301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4163341Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4163378Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4163524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4163574Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4163608Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4163764Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4163825Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4163869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4164041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4164119Z outs_pair = fn(*args) 2025-09-07T07:33:27.4164157Z ^^^^^^^^^ 2025-09-07T07:33:27.4164326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4164390Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4164435Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4164605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4164643Z outs_pair = fn(*args) 2025-09-07T07:33:27.4164677Z ^^^^^^^^^ 2025-09-07T07:33:27.4164851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4166215Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4166262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4166459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4166529Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4166576Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4166849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4166887Z outs_pair = fn(*args) 2025-09-07T07:33:27.4166922Z ^^^^^^^^^ 2025-09-07T07:33:27.4167111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4167156Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4167195Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4167363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4167410Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4167447Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4167571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4167612Z return handle_torch_function( 2025-09-07T07:33:27.4167649Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4167787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4167862Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4167907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4168111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4168154Z return func(*args, **kwargs) 2025-09-07T07:33:27.4169492Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4169615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4169657Z result = _engine_run_backward( 2025-09-07T07:33:27.4169693Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4169836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4169954Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4170004Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4170127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4170205Z return user_fn(self, *args) 2025-09-07T07:33:27.4170244Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4170388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4170431Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4170468Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4170624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4170668Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4170704Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4170825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4170865Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4170900Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4171068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4171119Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4172442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4172577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4172627Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4172666Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4172825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4172871Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4172911Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4173124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4173167Z t = dispatch_trace( 2025-09-07T07:33:27.4173203Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4173314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4173357Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4173394Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4173516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4173555Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4173589Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4173749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4173826Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4173867Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4174041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4174080Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4174115Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4175545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4175588Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4175622Z ^^^^^^^^^ 2025-09-07T07:33:27.4175770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4175818Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4175853Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4175895Z File "", line 1, in 2025-09-07T07:33:27.4176037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4176157Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4176209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4176343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4176390Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4176428Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4176617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4176660Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4176696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4176864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4176909Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4176948Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4177096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4177138Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4178471Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4178606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4178693Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4178740Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4178864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4178923Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4178967Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4179096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4179135Z leaves = list(leaves) 2025-09-07T07:33:27.4179171Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4179293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4179329Z return func(x) 2025-09-07T07:33:27.4179361Z ^^^^^^^ 2025-09-07T07:33:27.4179498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4179562Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4179604Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4179768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4179809Z return func(*args, **kwargs) 2025-09-07T07:33:27.4179846Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4180060Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4180145Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4180147Z 2025-09-07T07:33:27.4180352Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4180354Z 2025-09-07T07:33:27.4180356Z 2025-09-07T07:33:27.4181725Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4181922Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4181924Z 2025-09-07T07:33:27.4182010Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4182144Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4182179Z inline_call [] 2025-09-07T07:33:27.4182236Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4182270Z inductor [] 2025-09-07T07:33:27.4182344Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4182414Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4182668Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4182778Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4182864Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4183012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4183158Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4183290Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4183408Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4183478Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4183514Z inline_call [] 2025-09-07T07:33:27.4183569Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4183641Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4183710Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4185271Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4185389Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4185475Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4185621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4185705Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4185833Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4185950Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4186000Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4186109Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.4186199Z Traceback (most recent call last): 2025-09-07T07:33:27.4186350Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4186385Z self._run_test( 2025-09-07T07:33:27.4186497Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4186550Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4186592Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4186723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4186770Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4186809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4186959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4187042Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4187085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4187219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4188563Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4188603Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4188744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4188823Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4188861Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4189011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4189057Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4189211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4189267Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4189308Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4189449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4189502Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4189540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4189656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4189721Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4189766Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4189891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4189957Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4189999Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4190138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4190182Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4191509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4191647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4191687Z return aot_autograd( 2025-09-07T07:33:27.4191721Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4191856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4191924Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4191971Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4192170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4192253Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4192298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4192478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4192521Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4192705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4192744Z fx_g = _create_graph( 2025-09-07T07:33:27.4192778Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4192939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4193015Z fx_g = make_fx( 2025-09-07T07:33:27.4193048Z ^^^^^^^^ 2025-09-07T07:33:27.4193360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4193407Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4193445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4193589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4197052Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4197101Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4197263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4197302Z t = dispatch_trace( 2025-09-07T07:33:27.4197337Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4197459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4197500Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4197536Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4197661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4197702Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4197738Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4197898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4197976Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4198018Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4198140Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4198182Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4198217Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4198343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4198386Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4198420Z ^^^^^^^^^ 2025-09-07T07:33:27.4198553Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4198592Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4200087Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4200236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4200287Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4200321Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4200477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4200602Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4200648Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4200823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4200862Z outs_pair = fn(*args) 2025-09-07T07:33:27.4200896Z ^^^^^^^^^ 2025-09-07T07:33:27.4201066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4201130Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4201175Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4201346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4201423Z outs_pair = fn(*args) 2025-09-07T07:33:27.4201461Z ^^^^^^^^^ 2025-09-07T07:33:27.4201636Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4201695Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4201739Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4201930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4202000Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4203428Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4203601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4203644Z outs_pair = fn(*args) 2025-09-07T07:33:27.4203683Z ^^^^^^^^^ 2025-09-07T07:33:27.4203872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4203917Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4203953Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4204122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4204168Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4204205Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4204330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4204373Z return handle_torch_function( 2025-09-07T07:33:27.4204410Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4204555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4204629Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4204674Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4204840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4204881Z return func(*args, **kwargs) 2025-09-07T07:33:27.4204918Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4205038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4205079Z result = _engine_run_backward( 2025-09-07T07:33:27.4205115Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4206582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4206850Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4206901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4207026Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4207068Z return user_fn(self, *args) 2025-09-07T07:33:27.4207104Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4207246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4207289Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4207327Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4207483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4207527Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4207608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4207735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4207774Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4207810Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4207972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4208023Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4208064Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4208197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4208246Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4208285Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4209767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4209826Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4209865Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4210021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4210060Z t = dispatch_trace( 2025-09-07T07:33:27.4210094Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4210206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4210249Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4210285Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4210407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4210446Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4210480Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4210647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4210723Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4210766Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4210888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4210927Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4210961Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4211086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4211127Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4211161Z ^^^^^^^^^ 2025-09-07T07:33:27.4211310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4212659Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4212734Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4212777Z File "", line 1, in 2025-09-07T07:33:27.4212922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4212998Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4213045Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4213261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4213309Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4213347Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4213536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4213623Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4213662Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4213830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4213875Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4213911Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4214053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4214095Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4214131Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4214262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4214350Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4214396Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4215846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4215908Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4215953Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4216077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4216116Z leaves = list(leaves) 2025-09-07T07:33:27.4216151Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4216272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4216306Z return func(x) 2025-09-07T07:33:27.4216338Z ^^^^^^^ 2025-09-07T07:33:27.4216475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4216540Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4216588Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4216752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4216794Z return func(*args, **kwargs) 2025-09-07T07:33:27.4216830Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4217009Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4217093Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4217096Z 2025-09-07T07:33:27.4217299Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4217301Z 2025-09-07T07:33:27.4217303Z 2025-09-07T07:33:27.4217375Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4217623Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4217626Z 2025-09-07T07:33:27.4217712Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4217785Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4219139Z inline_call [] 2025-09-07T07:33:27.4219197Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4219231Z inductor [] 2025-09-07T07:33:27.4219306Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4219377Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4219632Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4219792Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4219879Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4220027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4220112Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4220243Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4220364Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4220433Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4220468Z inline_call [] 2025-09-07T07:33:27.4220524Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4220600Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4220669Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4220920Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4221028Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4221115Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4221266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4222665Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4222797Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4222921Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4222990Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4223025Z inline_call [] 2025-09-07T07:33:27.4223159Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4223231Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4223300Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4223550Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4223657Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4223741Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4223944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4224027Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4224155Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4224270Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4224481Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-4427bb6647e4698a.xml - 2025-09-07T07:33:27.4224539Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4224900Z FAILED [1.2295s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4225026Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4225028Z 2025-09-07T07:33:27.4225230Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4225232Z 2025-09-07T07:33:27.4225234Z 2025-09-07T07:33:27.4225305Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4225499Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.4226850Z 2025-09-07T07:33:27.4226935Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4226996Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4227071Z ================== 1 failed, 220 deselected, 2 rerun in 4.26s ================== 2025-09-07T07:33:27.4227106Z Got exit code 1 2025-09-07T07:33:27.4227229Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.4227647Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4227687Z import pkg_resources 2025-09-07T07:33:27.4227853Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-8f0172b5bdca95f0.xml 2025-09-07T07:33:27.4227908Z ============================= test session starts ============================== 2025-09-07T07:33:27.4228023Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4228063Z cachedir: .pytest_cache 2025-09-07T07:33:27.4228216Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4228261Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4228299Z configfile: pytest.ini 2025-09-07T07:33:27.4228461Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4228536Z collecting ... collected 467 items / 32 deselected / 435 selected 2025-09-07T07:33:27.4228586Z stepcurrent: skipping 32 already run items. 2025-09-07T07:33:27.4228627Z Running 189 items in this shard 2025-09-07T07:33:27.4228629Z 2025-09-07T07:33:27.4228807Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_False PASSED [2.7879s] [ 0%] 2025-09-07T07:33:27.4229044Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.7160s] [ 1%] 2025-09-07T07:33:27.4229239Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.4451s] [ 1%] 2025-09-07T07:33:27.4230718Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True FAILED [0.4502s] [ 1%] 2025-09-07T07:33:27.4230722Z 2025-09-07T07:33:27.4230772Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4230885Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4230928Z Traceback (most recent call last): 2025-09-07T07:33:27.4231080Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4231166Z self._run_test( 2025-09-07T07:33:27.4231277Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4231333Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4231374Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4231508Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4231554Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4231594Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4231742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4231788Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4231826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4231965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4232009Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4232047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4232188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4232269Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4232307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4233902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4233949Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4234099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4234152Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4234197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4234339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4234392Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4234430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4234546Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4234612Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4234656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4234781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4234843Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4234886Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4235079Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4235125Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4235163Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4235300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4235339Z return aot_autograd( 2025-09-07T07:33:27.4235375Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4235509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4235578Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4236935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4237096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4237241Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4237287Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4237466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4237510Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4237694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4237734Z fx_g = _create_graph( 2025-09-07T07:33:27.4237769Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4237930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4237964Z fx_g = make_fx( 2025-09-07T07:33:27.4237998Z ^^^^^^^^ 2025-09-07T07:33:27.4238150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4238197Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4238235Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4238380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4238422Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4238458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4238617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4238654Z t = dispatch_trace( 2025-09-07T07:33:27.4238690Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4238801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4240171Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4240212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4240339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4240379Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4240415Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4240577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4240656Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4240697Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4240821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4240859Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4240895Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4241018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4241109Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4241144Z ^^^^^^^^^ 2025-09-07T07:33:27.4241276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4241316Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4241352Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4241498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4241548Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4241582Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4241736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4243179Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4243226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4243465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4243505Z outs_pair = fn(*args) 2025-09-07T07:33:27.4243539Z ^^^^^^^^^ 2025-09-07T07:33:27.4243707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4243773Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4243818Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4243991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4244029Z outs_pair = fn(*args) 2025-09-07T07:33:27.4244064Z ^^^^^^^^^ 2025-09-07T07:33:27.4244242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4244304Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4244346Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4244538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4244608Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4244655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4244823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4244863Z outs_pair = fn(*args) 2025-09-07T07:33:27.4244896Z ^^^^^^^^^ 2025-09-07T07:33:27.4245086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4245134Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4246489Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4246657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4246792Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4246829Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4246954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4246996Z return handle_torch_function( 2025-09-07T07:33:27.4247033Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4247172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4247246Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4247343Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4247511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4247551Z return func(*args, **kwargs) 2025-09-07T07:33:27.4247587Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4247709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4247750Z result = _engine_run_backward( 2025-09-07T07:33:27.4247787Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4247931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4248050Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4248099Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4248266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4248307Z return user_fn(self, *args) 2025-09-07T07:33:27.4249662Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4249806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4249850Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4249887Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4250042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4250085Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4250123Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4250244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4250289Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4250328Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4250490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4250542Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4250583Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4250716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4250765Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4250804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4250962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4251009Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4251051Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4252708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4254399Z t = dispatch_trace( 2025-09-07T07:33:27.4254438Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4254552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4254597Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4254633Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4254757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4254796Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4254832Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4254990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4255072Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4255196Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4255320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4255358Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4255394Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4255519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4255561Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4255596Z ^^^^^^^^^ 2025-09-07T07:33:27.4255743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4255792Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4255826Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4255869Z File "", line 1, in 2025-09-07T07:33:27.4256036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4257503Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4257549Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4257687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4257734Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4257773Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4257963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4258007Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4258042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4258213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4258260Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4258297Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4258438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4258481Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4258517Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4258649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4258736Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4258782Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4258906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4258970Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4259091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4259217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4260597Z leaves = list(leaves) 2025-09-07T07:33:27.4260634Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4260757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4260792Z return func(x) 2025-09-07T07:33:27.4260825Z ^^^^^^^ 2025-09-07T07:33:27.4260960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4261026Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4261067Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4261233Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4261321Z return func(*args, **kwargs) 2025-09-07T07:33:27.4261359Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4261535Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4261620Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4261624Z 2025-09-07T07:33:27.4261831Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4261833Z 2025-09-07T07:33:27.4261835Z 2025-09-07T07:33:27.4261909Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4262105Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4262126Z 2025-09-07T07:33:27.4262215Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4262291Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4262327Z inline_call [] 2025-09-07T07:33:27.4262383Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4262458Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4262529Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4264173Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4264285Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4264371Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4264527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4264614Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4264744Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4264862Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4264974Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4265019Z Traceback (most recent call last): 2025-09-07T07:33:27.4265167Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4265203Z self._run_test( 2025-09-07T07:33:27.4265314Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4265418Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4265458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4265588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4265634Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4265673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4265822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4265868Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4265909Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4266043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4267423Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4267465Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4267658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4267739Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4267778Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4267929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4267974Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4268122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4268174Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4268216Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4268356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4268434Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4268473Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4268588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4268655Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4268699Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4268825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4268887Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4268930Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4269068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4269115Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4269156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4270614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4270654Z return aot_autograd( 2025-09-07T07:33:27.4270689Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4270823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4270894Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4270939Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4271098Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4271180Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4271226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4271410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4271478Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4271661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4271700Z fx_g = _create_graph( 2025-09-07T07:33:27.4271735Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4271896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4271930Z fx_g = make_fx( 2025-09-07T07:33:27.4271963Z ^^^^^^^^ 2025-09-07T07:33:27.4272110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4272159Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4272234Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4272380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4273816Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4273856Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4274013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4274050Z t = dispatch_trace( 2025-09-07T07:33:27.4274085Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4274197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4274240Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4274275Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4274399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4274481Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4274523Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4274682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4274760Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4274801Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4274925Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4274963Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4274998Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4275122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4275164Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4275199Z ^^^^^^^^^ 2025-09-07T07:33:27.4275335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4275376Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4276735Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4276884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4276934Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4276968Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4277123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4277184Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4277229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4277405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4277446Z outs_pair = fn(*args) 2025-09-07T07:33:27.4277514Z ^^^^^^^^^ 2025-09-07T07:33:27.4277683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4277749Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4277793Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4277964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4278002Z outs_pair = fn(*args) 2025-09-07T07:33:27.4278037Z ^^^^^^^^^ 2025-09-07T07:33:27.4278210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4278270Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4278313Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4278547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4278617Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4279981Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4280152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4280191Z outs_pair = fn(*args) 2025-09-07T07:33:27.4280225Z ^^^^^^^^^ 2025-09-07T07:33:27.4280413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4280457Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4280515Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4280687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4280733Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4280770Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4280893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4280935Z return handle_torch_function( 2025-09-07T07:33:27.4280971Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4281110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4281184Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4281229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4281398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4281441Z return func(*args, **kwargs) 2025-09-07T07:33:27.4281476Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4281598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4281639Z result = _engine_run_backward( 2025-09-07T07:33:27.4281675Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4283187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4283309Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4283359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4283484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4283527Z return user_fn(self, *args) 2025-09-07T07:33:27.4283599Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4283740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4283784Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4283820Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4283975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4284019Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4284056Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4284178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4284218Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4284253Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4284459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4284513Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4284554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4284688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4284738Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4284776Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4286260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4286309Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4286349Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4286505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4286577Z t = dispatch_trace( 2025-09-07T07:33:27.4286617Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4286821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4286866Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4286902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4287025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4287063Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4287099Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4287255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4287334Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4287375Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4287505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4287544Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4287579Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4287704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4287746Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4287780Z ^^^^^^^^^ 2025-09-07T07:33:27.4287927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4289306Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4289342Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4289385Z File "", line 1, in 2025-09-07T07:33:27.4289527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4289606Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4289676Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4289810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4289859Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4289897Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4290088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4290132Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4290167Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4290336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4290379Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4290418Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4290592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4290635Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4290671Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4290803Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4290891Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4290937Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4291061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4292433Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4292478Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4292629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4292669Z leaves = list(leaves) 2025-09-07T07:33:27.4292704Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4292825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4292860Z return func(x) 2025-09-07T07:33:27.4292893Z ^^^^^^^ 2025-09-07T07:33:27.4293028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4293165Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4293208Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4293373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4293414Z return func(*args, **kwargs) 2025-09-07T07:33:27.4293451Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4293630Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4293717Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4293719Z 2025-09-07T07:33:27.4293924Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4293926Z 2025-09-07T07:33:27.4293928Z 2025-09-07T07:33:27.4294000Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4294196Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4294199Z 2025-09-07T07:33:27.4294283Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4294359Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4295755Z inline_call [] 2025-09-07T07:33:27.4295815Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4295889Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4295962Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4296214Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4296325Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4296409Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4296559Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4296690Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4296823Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4296940Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4297011Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4297046Z inline_call [] 2025-09-07T07:33:27.4297102Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4297174Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4297243Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4297491Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4297626Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4297711Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4297858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4297942Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4299387Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4299505Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4299554Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4299668Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4299714Z Traceback (most recent call last): 2025-09-07T07:33:27.4299869Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4299904Z self._run_test( 2025-09-07T07:33:27.4300016Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4300069Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4300111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4300241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4300288Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4300326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4300475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4300523Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4300565Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4300720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4300766Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4300803Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4300945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4301024Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4301064Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4302527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4302575Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4302725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4302818Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4302860Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4303002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4303053Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4303243Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4303357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4303423Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4303467Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4303592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4303680Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4303728Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4303866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4303910Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4303948Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4304083Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4304122Z return aot_autograd( 2025-09-07T07:33:27.4304158Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4304292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4304359Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4306007Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4306172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4306256Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4306301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4306482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4306525Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4306709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4306750Z fx_g = _create_graph( 2025-09-07T07:33:27.4306785Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4306947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4306985Z fx_g = make_fx( 2025-09-07T07:33:27.4307043Z ^^^^^^^^ 2025-09-07T07:33:27.4307192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4307238Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4307277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4307421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4307465Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4307501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4307657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4307695Z t = dispatch_trace( 2025-09-07T07:33:27.4307729Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4309149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4309250Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4309286Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4309409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4309450Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4309485Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4309644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4309721Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4309763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4309886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4309926Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4309983Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4310113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4310154Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4310189Z ^^^^^^^^^ 2025-09-07T07:33:27.4310319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4310360Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4310394Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4310543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4310591Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4310626Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4310778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4312163Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4312214Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4312391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4312430Z outs_pair = fn(*args) 2025-09-07T07:33:27.4312465Z ^^^^^^^^^ 2025-09-07T07:33:27.4312633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4312699Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4312744Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4312913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4312953Z outs_pair = fn(*args) 2025-09-07T07:33:27.4312986Z ^^^^^^^^^ 2025-09-07T07:33:27.4313281Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4313340Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4313384Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4313575Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4313644Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4313689Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4313858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4313896Z outs_pair = fn(*args) 2025-09-07T07:33:27.4313932Z ^^^^^^^^^ 2025-09-07T07:33:27.4314168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4315548Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4315587Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4315754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4315800Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4315838Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4315961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4316004Z return handle_torch_function( 2025-09-07T07:33:27.4316040Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4316179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4316287Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4316333Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4316500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4316541Z return func(*args, **kwargs) 2025-09-07T07:33:27.4316577Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4316699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4316742Z result = _engine_run_backward( 2025-09-07T07:33:27.4316777Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4316920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4317038Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4317093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4317217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4317259Z return user_fn(self, *args) 2025-09-07T07:33:27.4318615Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4318760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4318802Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4318840Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4318994Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4319038Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4319076Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4319203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4319269Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4319306Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4319467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4319519Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4319559Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4319694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4319743Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4319782Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4319942Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4320027Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4320066Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4320222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4320260Z t = dispatch_trace( 2025-09-07T07:33:27.4321609Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4321722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4321766Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4321802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4321924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4321962Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4321997Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4322181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4322259Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4322301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4322423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4322461Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4322496Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4322620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4322661Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4322696Z ^^^^^^^^^ 2025-09-07T07:33:27.4322843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4322891Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4322926Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4322971Z File "", line 1, in 2025-09-07T07:33:27.4323176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4323254Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4324633Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4324770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4324817Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4324856Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4325043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4325087Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4325126Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4325327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4325371Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4325409Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4325550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4325592Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4325629Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4325761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4325849Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4325895Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4326065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4326128Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4326172Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4326299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4326338Z leaves = list(leaves) 2025-09-07T07:33:27.4326373Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4327910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4327946Z return func(x) 2025-09-07T07:33:27.4327980Z ^^^^^^^ 2025-09-07T07:33:27.4328115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4328180Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4328247Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4328420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4328461Z return func(*args, **kwargs) 2025-09-07T07:33:27.4328498Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4328677Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4328763Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4328765Z 2025-09-07T07:33:27.4328969Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4328971Z 2025-09-07T07:33:27.4328973Z 2025-09-07T07:33:27.4329046Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4329246Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4329249Z 2025-09-07T07:33:27.4329334Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4329406Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4329441Z inline_call [] 2025-09-07T07:33:27.4329498Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4329571Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4329643Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4329903Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4331333Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4331444Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4331593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4331678Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4331808Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4331927Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4331997Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4332033Z inline_call [] 2025-09-07T07:33:27.4332088Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4332160Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4332270Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4332522Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4332631Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4332716Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4332864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4332949Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4333274Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4333420Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4333490Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4333525Z inline_call [] 2025-09-07T07:33:27.4333579Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4334983Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4335054Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4335304Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4335412Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4335496Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4335650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4335734Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4335862Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4335978Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4336194Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-8f0172b5bdca95f0.xml - 2025-09-07T07:33:27.4336251Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4336612Z FAILED [0.4502s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4336728Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4336730Z 2025-09-07T07:33:27.4336935Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4336938Z 2025-09-07T07:33:27.4336939Z 2025-09-07T07:33:27.4337012Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4337209Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4337211Z 2025-09-07T07:33:27.4337295Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4337354Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4337470Z ============= 1 failed, 1 passed, 32 deselected, 2 rerun in 4.63s ============== 2025-09-07T07:33:27.4337508Z Got exit code 1 2025-09-07T07:33:27.4337546Z Retrying single test... 2025-09-07T07:33:27.4337964Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4339330Z import pkg_resources 2025-09-07T07:33:27.4339499Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-be02265bff5266bc.xml 2025-09-07T07:33:27.4339555Z ============================= test session starts ============================== 2025-09-07T07:33:27.4339667Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4339727Z cachedir: .pytest_cache 2025-09-07T07:33:27.4339887Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4339934Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4339972Z configfile: pytest.ini 2025-09-07T07:33:27.4340132Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4340208Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.4340437Z stepcurrent: skipping 33 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4340479Z Running 1 items in this shard 2025-09-07T07:33:27.4340481Z 2025-09-07T07:33:27.4340678Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.8573s] [100%] 2025-09-07T07:33:27.4340874Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.4685s] [100%] 2025-09-07T07:33:27.4341043Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True FAILED [0.4593s] [100%] 2025-09-07T07:33:27.4341045Z 2025-09-07T07:33:27.4341094Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4341206Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4341249Z Traceback (most recent call last): 2025-09-07T07:33:27.4341401Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4341436Z self._run_test( 2025-09-07T07:33:27.4341548Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4342933Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4342977Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4343177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4343225Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4343264Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4343414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4343459Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4343498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4343633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4343678Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4343717Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4343927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4344008Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4344046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4344197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4344244Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4344392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4344446Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4344487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4344631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4344708Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4344748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4346195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4346262Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4346306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4346432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4346497Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4346537Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4346676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4346721Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4346761Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4346902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4346941Z return aot_autograd( 2025-09-07T07:33:27.4346976Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4347111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4347180Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4347226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4347386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4347470Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4347516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4347703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4347777Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4347962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4349307Z fx_g = _create_graph( 2025-09-07T07:33:27.4349345Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4349506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4349541Z fx_g = make_fx( 2025-09-07T07:33:27.4349574Z ^^^^^^^^ 2025-09-07T07:33:27.4349723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4349769Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4349808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4349997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4350041Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4350079Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4350236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4350274Z t = dispatch_trace( 2025-09-07T07:33:27.4350308Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4350424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4350466Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4350501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4350624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4350685Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4350725Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4350887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4350966Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4352315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4352440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4352479Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4352514Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4352640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4352682Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4352717Z ^^^^^^^^^ 2025-09-07T07:33:27.4352855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4352897Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4352932Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4353144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4353196Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4353230Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4353385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4353446Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4353491Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4353662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4353704Z outs_pair = fn(*args) 2025-09-07T07:33:27.4353774Z ^^^^^^^^^ 2025-09-07T07:33:27.4353943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4354008Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4355372Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4355544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4355583Z outs_pair = fn(*args) 2025-09-07T07:33:27.4355618Z ^^^^^^^^^ 2025-09-07T07:33:27.4355797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4355855Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4355901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4356141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4356213Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4356258Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4356428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4356465Z outs_pair = fn(*args) 2025-09-07T07:33:27.4356500Z ^^^^^^^^^ 2025-09-07T07:33:27.4356686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4356732Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4356791Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4356959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4357007Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4357043Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4357168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4357210Z return handle_torch_function( 2025-09-07T07:33:27.4357246Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4358698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4358775Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4358821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4358990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4359033Z return func(*args, **kwargs) 2025-09-07T07:33:27.4359071Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4359192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4359235Z result = _engine_run_backward( 2025-09-07T07:33:27.4359271Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4359415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4359533Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4359583Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4359706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4359749Z return user_fn(self, *args) 2025-09-07T07:33:27.4359807Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4359949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4359992Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4360030Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4360184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4360228Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4360264Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4361696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4361737Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4361773Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4361976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4362032Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4362072Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4362210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4362260Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4362300Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4362459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4362506Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4362546Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4362701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4362759Z t = dispatch_trace( 2025-09-07T07:33:27.4362797Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4362910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4362952Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4362988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4363161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4363201Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4363235Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4363393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4364787Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4364830Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4364954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4365000Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4365034Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4365158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4365200Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4365235Z ^^^^^^^^^ 2025-09-07T07:33:27.4365382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4365431Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4365465Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4365507Z File "", line 1, in 2025-09-07T07:33:27.4365649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4365727Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4365806Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4365940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4365988Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4366025Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4366216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4366259Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4366296Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4366463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4367937Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4367976Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4368165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4368209Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4368245Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4368379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4368467Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4368513Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4368637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4368698Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4368742Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4368893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4368935Z leaves = list(leaves) 2025-09-07T07:33:27.4368969Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4369091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4369125Z return func(x) 2025-09-07T07:33:27.4369158Z ^^^^^^^ 2025-09-07T07:33:27.4369295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4369359Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4369401Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4369565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4370919Z return func(*args, **kwargs) 2025-09-07T07:33:27.4370960Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4371144Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4371230Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4371233Z 2025-09-07T07:33:27.4371436Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4371438Z 2025-09-07T07:33:27.4371440Z 2025-09-07T07:33:27.4371513Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4371708Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4371711Z 2025-09-07T07:33:27.4371796Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4371870Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4371932Z inline_call [] 2025-09-07T07:33:27.4371989Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4372024Z inductor [] 2025-09-07T07:33:27.4372097Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4372168Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4372420Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4372531Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4372617Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4372767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4372891Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4373023Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4373375Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4374834Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4374881Z Traceback (most recent call last): 2025-09-07T07:33:27.4375032Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4375067Z self._run_test( 2025-09-07T07:33:27.4375178Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4375232Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4375312Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4375450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4375495Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4375534Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4375682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4375729Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4375767Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4375905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4375948Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4375986Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4376126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4376209Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4376247Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4376396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4376441Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4376589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4377960Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4378003Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4378143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4378196Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4378237Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4378381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4378447Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4378492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4378617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4378679Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4378722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4378859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4378904Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4378941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4379117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4379158Z return aot_autograd( 2025-09-07T07:33:27.4379194Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4379327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4379397Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4379442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4379601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4379683Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4381047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4381229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4381300Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4381484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4381524Z fx_g = _create_graph( 2025-09-07T07:33:27.4381560Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4381721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4381755Z fx_g = make_fx( 2025-09-07T07:33:27.4381788Z ^^^^^^^^ 2025-09-07T07:33:27.4381936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4381983Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4382020Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4382168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4382212Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4382249Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4382404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4382442Z t = dispatch_trace( 2025-09-07T07:33:27.4382477Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4382587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4382630Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4382665Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4384181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4384223Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4384260Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4384422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4384525Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4384566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4384690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4384728Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4384763Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4384890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4384933Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4384967Z ^^^^^^^^^ 2025-09-07T07:33:27.4385099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4385140Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4385219Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4385368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4385418Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4385452Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4385607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4385668Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4385712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4385885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4387247Z outs_pair = fn(*args) 2025-09-07T07:33:27.4387282Z ^^^^^^^^^ 2025-09-07T07:33:27.4387484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4387551Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4387595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4387771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4387809Z outs_pair = fn(*args) 2025-09-07T07:33:27.4387843Z ^^^^^^^^^ 2025-09-07T07:33:27.4388017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4388077Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4388119Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4388313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4388385Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4388431Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4388603Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4388643Z outs_pair = fn(*args) 2025-09-07T07:33:27.4388676Z ^^^^^^^^^ 2025-09-07T07:33:27.4388864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4388908Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4388945Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4389111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4390491Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4390530Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4390655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4390696Z return handle_torch_function( 2025-09-07T07:33:27.4390733Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4390871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4390948Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4390995Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4391162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4391204Z return func(*args, **kwargs) 2025-09-07T07:33:27.4391240Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4391401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4391444Z result = _engine_run_backward( 2025-09-07T07:33:27.4391479Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4391623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4391742Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4391791Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4391917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4391960Z return user_fn(self, *args) 2025-09-07T07:33:27.4391996Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4392160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4392206Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4393625Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4393783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4393826Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4393863Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4393985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4394026Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4394061Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4394222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4394275Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4394322Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4394456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4394505Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4394544Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4394702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4394748Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4394788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4394947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4394985Z t = dispatch_trace( 2025-09-07T07:33:27.4395019Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4395134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4395208Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4396561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4396689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4396728Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4396762Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4396919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4396996Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4397037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4397160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4397198Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4397234Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4397416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4397458Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4397493Z ^^^^^^^^^ 2025-09-07T07:33:27.4397640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4397688Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4397724Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4397765Z File "", line 1, in 2025-09-07T07:33:27.4397906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4397984Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4398030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4398190Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4398239Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4399587Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4399782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4399825Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4399861Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4400029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4400073Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4400109Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4400251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4400300Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4400338Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4400471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4400557Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4400604Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4400727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4400787Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4400830Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4400954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4400994Z leaves = list(leaves) 2025-09-07T07:33:27.4401029Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4401174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4401209Z return func(x) 2025-09-07T07:33:27.4401241Z ^^^^^^^ 2025-09-07T07:33:27.4402685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4402751Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4402794Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4402961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4403002Z return func(*args, **kwargs) 2025-09-07T07:33:27.4403038Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4403267Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4403408Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4403411Z 2025-09-07T07:33:27.4403615Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4403617Z 2025-09-07T07:33:27.4403619Z 2025-09-07T07:33:27.4403691Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4403887Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4403890Z 2025-09-07T07:33:27.4403973Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4404046Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4404080Z inline_call [] 2025-09-07T07:33:27.4404160Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4404197Z inductor [] 2025-09-07T07:33:27.4404272Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4404343Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4404597Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4404708Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4404794Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4406273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4406361Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4406499Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4406620Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4406777Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4406814Z inline_call [] 2025-09-07T07:33:27.4406870Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4406942Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4407012Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4407263Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4407371Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4407488Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4407635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4407718Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4407847Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4407964Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4408013Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4408125Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4408170Z Traceback (most recent call last): 2025-09-07T07:33:27.4408356Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4408393Z self._run_test( 2025-09-07T07:33:27.4409856Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4409912Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4409953Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4410086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4410132Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4410172Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4410319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4410366Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4410405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4410568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4410614Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4410652Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4410792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4410873Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4410911Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4411060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4411105Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4411253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4411308Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4411350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4411489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4411543Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4412891Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4413010Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4413125Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4413171Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4413295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4413358Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4413399Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4413544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4413618Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4413655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4413791Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4413830Z return aot_autograd( 2025-09-07T07:33:27.4413865Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4413999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4414068Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4414113Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4414272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4414394Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4414441Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4414620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4414664Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4414846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4416211Z fx_g = _create_graph( 2025-09-07T07:33:27.4416247Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4416410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4416444Z fx_g = make_fx( 2025-09-07T07:33:27.4416503Z ^^^^^^^^ 2025-09-07T07:33:27.4416655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4416703Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4416741Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4416885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4416927Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4416964Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4417119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4417157Z t = dispatch_trace( 2025-09-07T07:33:27.4417191Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4417303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4417345Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4417383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4417506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4417546Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4417582Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4417740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4419130Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4419173Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4419297Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4419335Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4419373Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4419497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4419565Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4419600Z ^^^^^^^^^ 2025-09-07T07:33:27.4419734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4419775Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4419810Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4419957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4420007Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4420040Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4420195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4420255Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4420301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4420514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4420554Z outs_pair = fn(*args) 2025-09-07T07:33:27.4420588Z ^^^^^^^^^ 2025-09-07T07:33:27.4420757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4420824Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4422176Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4422349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4422388Z outs_pair = fn(*args) 2025-09-07T07:33:27.4422422Z ^^^^^^^^^ 2025-09-07T07:33:27.4422620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4422681Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4422723Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4422914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4422983Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4423029Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4423265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4423304Z outs_pair = fn(*args) 2025-09-07T07:33:27.4423338Z ^^^^^^^^^ 2025-09-07T07:33:27.4423528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4423575Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4423612Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4423777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4423823Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4423859Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4423983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4424024Z return handle_torch_function( 2025-09-07T07:33:27.4425372Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4425512Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4425587Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4425664Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4425829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4425869Z return func(*args, **kwargs) 2025-09-07T07:33:27.4425906Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4426027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4426069Z result = _engine_run_backward( 2025-09-07T07:33:27.4426104Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4426247Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4426366Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4426460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4426588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4426630Z return user_fn(self, *args) 2025-09-07T07:33:27.4426666Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4426807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4426852Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4426889Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4427044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4427087Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4427123Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4428555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4428627Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4428662Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4428826Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4428877Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4428918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4429051Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4429101Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4429139Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4429298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4429344Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4429386Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4429543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4429581Z t = dispatch_trace( 2025-09-07T07:33:27.4429615Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4429730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4429772Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4429808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4429931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4429969Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4430005Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4430164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4431563Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4431626Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4431748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4431787Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4431822Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4431945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4431988Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4432021Z ^^^^^^^^^ 2025-09-07T07:33:27.4432168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4432217Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4432251Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4432294Z File "", line 1, in 2025-09-07T07:33:27.4432467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4432547Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4432593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4432726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4432773Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4432811Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4433001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4433044Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4433129Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4434649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4434697Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4434733Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4434875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4434917Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4434952Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4435085Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4435172Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4435219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4435342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4435406Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4435451Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4435575Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4435613Z leaves = list(leaves) 2025-09-07T07:33:27.4435647Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4435768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4435803Z return func(x) 2025-09-07T07:33:27.4435835Z ^^^^^^^ 2025-09-07T07:33:27.4435971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4436035Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4436077Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4436244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4437620Z return func(*args, **kwargs) 2025-09-07T07:33:27.4437657Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4437836Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4437921Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4437923Z 2025-09-07T07:33:27.4438128Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4438130Z 2025-09-07T07:33:27.4438132Z 2025-09-07T07:33:27.4438204Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4438399Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4438453Z 2025-09-07T07:33:27.4438538Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4438613Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4438648Z inline_call [] 2025-09-07T07:33:27.4438705Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4438739Z inductor [] 2025-09-07T07:33:27.4438813Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4438884Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4439137Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4439246Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4439353Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4439502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4439586Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4439716Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4439834Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4441211Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4441249Z inline_call [] 2025-09-07T07:33:27.4441306Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4441380Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4441453Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4441710Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4441818Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4441903Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4442049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4442132Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4442260Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4442377Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4442449Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4442514Z inline_call [] 2025-09-07T07:33:27.4442568Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4442638Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4442707Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4442955Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4443124Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4443207Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4443354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4444822Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4444953Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4445073Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4445284Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-be02265bff5266bc.xml - 2025-09-07T07:33:27.4445342Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4445701Z FAILED [0.4593s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4445818Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4445821Z 2025-09-07T07:33:27.4446024Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4446026Z 2025-09-07T07:33:27.4446028Z 2025-09-07T07:33:27.4446099Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4446293Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4446295Z 2025-09-07T07:33:27.4446380Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4446439Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4446505Z ================== 1 failed, 220 deselected, 2 rerun in 1.99s ================== 2025-09-07T07:33:27.4446541Z Got exit code 1 2025-09-07T07:33:27.4446583Z Retrying single test... 2025-09-07T07:33:27.4447066Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4447107Z import pkg_resources 2025-09-07T07:33:27.4447275Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-0665310efd9d0378.xml 2025-09-07T07:33:27.4447331Z ============================= test session starts ============================== 2025-09-07T07:33:27.4447442Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4447481Z cachedir: .pytest_cache 2025-09-07T07:33:27.4447639Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4449031Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4449071Z configfile: pytest.ini 2025-09-07T07:33:27.4449231Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4449306Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.4449537Z stepcurrent: skipping 33 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4449579Z Running 1 items in this shard 2025-09-07T07:33:27.4449581Z 2025-09-07T07:33:27.4449777Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.9842s] [100%] 2025-09-07T07:33:27.4450007Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.6088s] [100%] 2025-09-07T07:33:27.4450177Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True FAILED [0.5605s] [100%] 2025-09-07T07:33:27.4450179Z 2025-09-07T07:33:27.4450228Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4450339Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4450383Z Traceback (most recent call last): 2025-09-07T07:33:27.4450537Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4450571Z self._run_test( 2025-09-07T07:33:27.4450684Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4450758Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4450804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4450938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4450985Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4451025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4451173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4452530Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4452571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4452707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4452752Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4452789Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4452937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4453020Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4453058Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4453283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4453329Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4453477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4453530Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4453571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4453712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4453766Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4453839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4453954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4454021Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4454067Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4454194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4454259Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4454300Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4455770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4455817Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4455855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4456041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4456082Z return aot_autograd( 2025-09-07T07:33:27.4456117Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4456251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4456319Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4456365Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4456525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4456609Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4456654Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4456867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4456911Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4457099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4457138Z fx_g = _create_graph( 2025-09-07T07:33:27.4457174Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4457335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4457370Z fx_g = make_fx( 2025-09-07T07:33:27.4457403Z ^^^^^^^^ 2025-09-07T07:33:27.4457552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4458914Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4458955Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4459105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4459149Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4459186Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4459342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4459381Z t = dispatch_trace( 2025-09-07T07:33:27.4459415Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4459526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4459567Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4459602Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4459725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4459766Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4459803Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4459992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4460071Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4460113Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4460236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4460275Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4460309Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4460432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4460474Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4461813Z ^^^^^^^^^ 2025-09-07T07:33:27.4461946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4462031Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4462067Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4462214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4462264Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4462298Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4462454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4462515Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4462560Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4462731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4462772Z outs_pair = fn(*args) 2025-09-07T07:33:27.4462832Z ^^^^^^^^^ 2025-09-07T07:33:27.4463006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4463144Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4463189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4463360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4463399Z outs_pair = fn(*args) 2025-09-07T07:33:27.4463433Z ^^^^^^^^^ 2025-09-07T07:33:27.4463607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4463666Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4465039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4465237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4465309Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4465354Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4465524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4465563Z outs_pair = fn(*args) 2025-09-07T07:33:27.4465597Z ^^^^^^^^^ 2025-09-07T07:33:27.4465784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4465830Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4465866Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4466037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4466117Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4466154Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4466277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4466320Z return handle_torch_function( 2025-09-07T07:33:27.4466356Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4466496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4466570Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4466615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4466781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4466823Z return func(*args, **kwargs) 2025-09-07T07:33:27.4466902Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4468333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4468378Z result = _engine_run_backward( 2025-09-07T07:33:27.4468414Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4468558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4468675Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4468725Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4468849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4468891Z return user_fn(self, *args) 2025-09-07T07:33:27.4468950Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4469100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4469143Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4469181Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4469335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4469379Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4469415Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4469537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4469576Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4469613Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4469773Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4469828Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4469869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4471310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4471361Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4471401Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4471560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4471606Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4471646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4471801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4471839Z t = dispatch_trace( 2025-09-07T07:33:27.4471874Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4472011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4472054Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4472090Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4472212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4472252Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4472287Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4472446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4472522Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4472564Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4472687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4472727Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4472800Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4472926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4474371Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4474409Z ^^^^^^^^^ 2025-09-07T07:33:27.4474557Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4474606Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4474640Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4474683Z File "", line 1, in 2025-09-07T07:33:27.4474825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4474902Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4474982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4475123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4475170Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4475207Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4475397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4475439Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4475476Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4475643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4475688Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4475724Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4475871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4475914Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4475951Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4476082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4477489Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4477536Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4477663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4477722Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4477767Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4477890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4477934Z leaves = list(leaves) 2025-09-07T07:33:27.4477995Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4478117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4478151Z return func(x) 2025-09-07T07:33:27.4478184Z ^^^^^^^ 2025-09-07T07:33:27.4478320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4478384Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4478426Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4478592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4478633Z return func(*args, **kwargs) 2025-09-07T07:33:27.4478668Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4478900Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4478986Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4478988Z 2025-09-07T07:33:27.4479197Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4479199Z 2025-09-07T07:33:27.4479201Z 2025-09-07T07:33:27.4479273Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4480770Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4480773Z 2025-09-07T07:33:27.4480860Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4480933Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4480990Z inline_call [] 2025-09-07T07:33:27.4481052Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4481087Z inductor [] 2025-09-07T07:33:27.4481160Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4481231Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4481489Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4481599Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4481684Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4481833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4481922Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4482053Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4482170Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4482282Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4482326Z Traceback (most recent call last): 2025-09-07T07:33:27.4482475Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4482510Z self._run_test( 2025-09-07T07:33:27.4482624Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4482680Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4482721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4484315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4484391Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4484431Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4484579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4484626Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4484664Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4484798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4484842Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4484880Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4485020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4485153Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4485194Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4485344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4485389Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4485537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4485591Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4485632Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4485771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4485823Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4485861Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4486001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4487478Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4487525Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4487651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4487714Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4487756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4487894Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4487939Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4487976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4488112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4488153Z return aot_autograd( 2025-09-07T07:33:27.4488195Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4488327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4488397Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4488442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4488602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4488684Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4488730Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4488910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4488954Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4489164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4489205Z fx_g = _create_graph( 2025-09-07T07:33:27.4489239Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4490717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4490752Z fx_g = make_fx( 2025-09-07T07:33:27.4490785Z ^^^^^^^^ 2025-09-07T07:33:27.4490935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4490981Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4491019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4491164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4491268Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4491306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4491462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4491500Z t = dispatch_trace( 2025-09-07T07:33:27.4491535Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4491647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4491689Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4491724Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4491849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4491889Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4491925Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4492086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4492189Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4492230Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4493729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4493770Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4493805Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4493929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4493972Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4494006Z ^^^^^^^^^ 2025-09-07T07:33:27.4494137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4494177Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4494215Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4494367Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4494418Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4494452Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4494607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4494668Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4494712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4494885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4494923Z outs_pair = fn(*args) 2025-09-07T07:33:27.4494958Z ^^^^^^^^^ 2025-09-07T07:33:27.4495128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4495229Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4495274Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4495445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4496800Z outs_pair = fn(*args) 2025-09-07T07:33:27.4496837Z ^^^^^^^^^ 2025-09-07T07:33:27.4497011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4497070Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4497113Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4497303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4497423Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4497471Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4497643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4497683Z outs_pair = fn(*args) 2025-09-07T07:33:27.4497716Z ^^^^^^^^^ 2025-09-07T07:33:27.4497905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4497949Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4497986Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4498152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4498222Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4498262Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4498386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4498429Z return handle_torch_function( 2025-09-07T07:33:27.4498466Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4498605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4500000Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4500047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4500213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4500253Z return func(*args, **kwargs) 2025-09-07T07:33:27.4500290Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4500419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4500462Z result = _engine_run_backward( 2025-09-07T07:33:27.4500497Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4500639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4500759Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4500808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4500933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4500974Z return user_fn(self, *args) 2025-09-07T07:33:27.4501011Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4501152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4501222Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4501259Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4501414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4501457Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4501494Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4501615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4501655Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4503007Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4503246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4503298Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4503341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4503528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4503579Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4503618Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4503777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4503824Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4503863Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4504018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4504056Z t = dispatch_trace( 2025-09-07T07:33:27.4504090Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4504202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4504270Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4504306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4504429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4504467Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4504503Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4504660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4504738Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4504778Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4506229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4506268Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4506304Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4506434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4506476Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4506511Z ^^^^^^^^^ 2025-09-07T07:33:27.4506658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4506706Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4506741Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4506783Z File "", line 1, in 2025-09-07T07:33:27.4506924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4507002Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4507048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4507184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4507259Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4507297Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4507485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4507529Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4507564Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4507733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4507776Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4509119Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4509263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4509307Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4509388Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4509522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4509609Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4509656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4509781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4509841Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4509884Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4510010Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4510050Z leaves = list(leaves) 2025-09-07T07:33:27.4510102Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4510227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4510263Z return func(x) 2025-09-07T07:33:27.4510295Z ^^^^^^^ 2025-09-07T07:33:27.4510430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4510493Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4510536Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4510700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4510741Z return func(*args, **kwargs) 2025-09-07T07:33:27.4510776Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4512261Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4512348Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4512355Z 2025-09-07T07:33:27.4512561Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4512563Z 2025-09-07T07:33:27.4512568Z 2025-09-07T07:33:27.4512640Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4512836Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4512839Z 2025-09-07T07:33:27.4512923Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4512996Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4513030Z inline_call [] 2025-09-07T07:33:27.4513149Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4513185Z inductor [] 2025-09-07T07:33:27.4513294Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4513365Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4513619Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4513730Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4513816Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4513964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4514049Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4514180Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4514346Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4514416Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4514452Z inline_call [] 2025-09-07T07:33:27.4515835Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4515910Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4515981Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4516236Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4516344Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4516460Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4516609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4516693Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4516821Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4516938Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4516988Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4517100Z _ WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4517144Z Traceback (most recent call last): 2025-09-07T07:33:27.4517294Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1248, in test_while_loop_nested_control_flow 2025-09-07T07:33:27.4517333Z self._run_test( 2025-09-07T07:33:27.4517445Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4517500Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4517540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4517672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4517718Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4517759Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4517907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4519265Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4519304Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4519439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4519509Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4519548Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4519690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4519770Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4519809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4519959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4520005Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4520153Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4520206Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4520248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4520427Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4520482Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4520520Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4520635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4520701Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4520744Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4520870Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4520932Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4522279Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4522443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4522489Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4522526Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4522662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4522700Z return aot_autograd( 2025-09-07T07:33:27.4522736Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4522870Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4522940Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4522987Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4523195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4523282Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4523329Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4523509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4523554Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4523738Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4523777Z fx_g = _create_graph( 2025-09-07T07:33:27.4523812Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4523973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4524007Z fx_g = make_fx( 2025-09-07T07:33:27.4524040Z ^^^^^^^^ 2025-09-07T07:33:27.4524193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4526016Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4526056Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4526202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4526244Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4526281Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4526439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4526477Z t = dispatch_trace( 2025-09-07T07:33:27.4526511Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4526623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4526665Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4526776Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4526950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4526990Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4527027Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4527187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4527266Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4527306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4527430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4527468Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4527503Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4527627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4529014Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4529057Z ^^^^^^^^^ 2025-09-07T07:33:27.4529189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4529230Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4529266Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4529412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4529462Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4529495Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4529650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4529712Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4529757Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4529934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4529974Z outs_pair = fn(*args) 2025-09-07T07:33:27.4530008Z ^^^^^^^^^ 2025-09-07T07:33:27.4530179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4530246Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4530289Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4530460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4530498Z outs_pair = fn(*args) 2025-09-07T07:33:27.4530533Z ^^^^^^^^^ 2025-09-07T07:33:27.4530706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4530799Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4532143Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4532336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4532405Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4532452Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4532621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4532660Z outs_pair = fn(*args) 2025-09-07T07:33:27.4532694Z ^^^^^^^^^ 2025-09-07T07:33:27.4532881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4532966Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4533004Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4533236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4533283Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4533319Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4533444Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4533486Z return handle_torch_function( 2025-09-07T07:33:27.4533523Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4533662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4533736Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4533808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4533975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4534016Z return func(*args, **kwargs) 2025-09-07T07:33:27.4535373Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4535498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4535540Z result = _engine_run_backward( 2025-09-07T07:33:27.4535576Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4535720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4535838Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4535888Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4536020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4536061Z return user_fn(self, *args) 2025-09-07T07:33:27.4536098Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4536239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4536283Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4536320Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4536476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4536519Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4536555Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4536677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4536718Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4536783Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4536955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4537006Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4537047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4538494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4538545Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4538584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4538743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4538790Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4538833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4539039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4539079Z t = dispatch_trace( 2025-09-07T07:33:27.4539113Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4539225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4539267Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4539302Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4539425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4539463Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4539498Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4539655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4539733Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4539797Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4539921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4539959Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4539994Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4540118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4541477Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4541512Z ^^^^^^^^^ 2025-09-07T07:33:27.4541662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4541710Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4541745Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4541787Z File "", line 1, in 2025-09-07T07:33:27.4541934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4542012Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4542058Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4542191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4542238Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4542276Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4542466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4542508Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4542544Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4542712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4542781Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4542818Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4542958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4543001Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4543036Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4544577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4544666Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4544713Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4544839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4544901Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4544997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4545122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4545161Z leaves = list(leaves) 2025-09-07T07:33:27.4545196Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4545316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4545351Z return func(x) 2025-09-07T07:33:27.4545383Z ^^^^^^^ 2025-09-07T07:33:27.4545519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4545582Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4545624Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4545788Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4545857Z return func(*args, **kwargs) 2025-09-07T07:33:27.4545892Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4546070Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4546153Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4546156Z 2025-09-07T07:33:27.4546358Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4546361Z 2025-09-07T07:33:27.4546362Z 2025-09-07T07:33:27.4546435Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4547946Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4547951Z 2025-09-07T07:33:27.4548042Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4548116Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4548151Z inline_call [] 2025-09-07T07:33:27.4548208Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4548241Z inductor [] 2025-09-07T07:33:27.4548315Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4548386Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4548644Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4548753Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4548839Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4549019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4549104Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4549234Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4549353Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4549422Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4549458Z inline_call [] 2025-09-07T07:33:27.4549512Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4549584Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4549653Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4549942Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4551353Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4551440Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4551588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4551671Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4551803Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4551922Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4552016Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4552057Z inline_call [] 2025-09-07T07:33:27.4552111Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.4552181Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4552250Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4552498Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4552606Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 801, in forward 2025-09-07T07:33:27.4552689Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, (ci, cj, a, b)) 2025-09-07T07:33:27.4552835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4552920Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4553048Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4553236Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4553450Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-0665310efd9d0378.xml - 2025-09-07T07:33:27.4553507Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4553869Z FAILED [0.5605s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4555283Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4555311Z 2025-09-07T07:33:27.4555523Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4555525Z 2025-09-07T07:33:27.4555527Z 2025-09-07T07:33:27.4555600Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4555794Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4555796Z 2025-09-07T07:33:27.4555880Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4555939Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4556005Z ================== 1 failed, 220 deselected, 2 rerun in 2.39s ================== 2025-09-07T07:33:27.4556041Z Got exit code 1 2025-09-07T07:33:27.4556209Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.4556628Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4556668Z import pkg_resources 2025-09-07T07:33:27.4556834Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-706ddbc6999885be.xml 2025-09-07T07:33:27.4556889Z ============================= test session starts ============================== 2025-09-07T07:33:27.4556999Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4557038Z cachedir: .pytest_cache 2025-09-07T07:33:27.4557215Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4557261Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4557299Z configfile: pytest.ini 2025-09-07T07:33:27.4557457Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4557530Z collecting ... collected 467 items / 34 deselected / 433 selected 2025-09-07T07:33:27.4557581Z stepcurrent: skipping 34 already run items. 2025-09-07T07:33:27.4557622Z Running 187 items in this shard 2025-09-07T07:33:27.4557624Z 2025-09-07T07:33:27.4559112Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_True_autograd_False PASSED [3.8677s] [ 0%] 2025-09-07T07:33:27.4559307Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.3340s] [ 1%] 2025-09-07T07:33:27.4559504Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2709s] [ 1%] 2025-09-07T07:33:27.4559674Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True FAILED [0.2701s] [ 1%] 2025-09-07T07:33:27.4559676Z 2025-09-07T07:33:27.4559726Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4559837Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4559882Z Traceback (most recent call last): 2025-09-07T07:33:27.4560035Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4560070Z self._run_test( 2025-09-07T07:33:27.4560182Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4560240Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4560301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4560435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4560482Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4560521Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4560671Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4560717Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4560755Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4560891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4560936Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4560974Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4562453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4562538Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4562578Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4562728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4562775Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4562923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4562977Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4563018Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4563246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4563326Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4563368Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4563483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4563549Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4563593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4563719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4563782Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4563824Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4563962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4564008Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4564046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4564187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4564226Z return aot_autograd( 2025-09-07T07:33:27.4565589Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4565726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4565795Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4565841Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4566000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4566082Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4566128Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4566312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4566386Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4566569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4566609Z fx_g = _create_graph( 2025-09-07T07:33:27.4566643Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4566882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4566917Z fx_g = make_fx( 2025-09-07T07:33:27.4566949Z ^^^^^^^^ 2025-09-07T07:33:27.4567098Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4567144Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4567184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4567369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4567414Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4567450Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4568923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4568963Z t = dispatch_trace( 2025-09-07T07:33:27.4568998Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4569109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4569151Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4569186Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4569313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4569373Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4569417Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4569576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4569655Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4569696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4569819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4569858Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4569894Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4570018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4570060Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4570095Z ^^^^^^^^^ 2025-09-07T07:33:27.4570227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4570270Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4570305Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4570452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4571809Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4571846Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4572001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4572064Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4572108Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4572279Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4572320Z outs_pair = fn(*args) 2025-09-07T07:33:27.4572381Z ^^^^^^^^^ 2025-09-07T07:33:27.4572550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4572616Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4572660Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4572833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4572871Z outs_pair = fn(*args) 2025-09-07T07:33:27.4572906Z ^^^^^^^^^ 2025-09-07T07:33:27.4573145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4573204Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4573248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4573490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4573561Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4573609Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4573779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4575142Z outs_pair = fn(*args) 2025-09-07T07:33:27.4575178Z ^^^^^^^^^ 2025-09-07T07:33:27.4575368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4575412Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4575449Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4575646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4575694Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4575731Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4575855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4575897Z return handle_torch_function( 2025-09-07T07:33:27.4575933Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4576074Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4576149Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4576195Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4576360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4576407Z return func(*args, **kwargs) 2025-09-07T07:33:27.4576442Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4576565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4576606Z result = _engine_run_backward( 2025-09-07T07:33:27.4576642Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4576785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4576904Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4578263Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4578389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4578432Z return user_fn(self, *args) 2025-09-07T07:33:27.4578496Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4578637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4578680Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4578717Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4578873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4578916Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4578952Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4579074Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4579113Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4579148Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4579353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4579407Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4579447Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4579584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4579632Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4579671Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4579830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4579877Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4579916Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4581388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4581447Z t = dispatch_trace( 2025-09-07T07:33:27.4581488Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4581603Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4581647Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4581683Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4581806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4581845Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4581880Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4582039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4582117Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4582157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4582279Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4582321Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4582356Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4582480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4582521Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4582556Z ^^^^^^^^^ 2025-09-07T07:33:27.4582703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4582754Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4582787Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4584203Z File "", line 1, in 2025-09-07T07:33:27.4584346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4584424Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4584473Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4584628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4584674Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4584713Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4584901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4584945Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4584981Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4585148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4585191Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4585230Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4585403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4585447Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4585483Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4585616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4585703Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4585750Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4585873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4585934Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4585977Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4587421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4587487Z leaves = list(leaves) 2025-09-07T07:33:27.4587522Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4587644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4587679Z return func(x) 2025-09-07T07:33:27.4587711Z ^^^^^^^ 2025-09-07T07:33:27.4587850Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4587915Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4587957Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4588122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4588162Z return func(*args, **kwargs) 2025-09-07T07:33:27.4588199Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4588382Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4588470Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4588472Z 2025-09-07T07:33:27.4588675Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4588677Z 2025-09-07T07:33:27.4588680Z 2025-09-07T07:33:27.4588752Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4588945Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4588948Z 2025-09-07T07:33:27.4589032Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4589106Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4589161Z inline_call [] 2025-09-07T07:33:27.4589216Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4590611Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4590686Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4590942Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4591054Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4591135Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4591285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4591409Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4591541Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4591661Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4591772Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4591816Z Traceback (most recent call last): 2025-09-07T07:33:27.4591965Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4592000Z self._run_test( 2025-09-07T07:33:27.4592111Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4592165Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4592206Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4592359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4592406Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4592445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4592593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4592639Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4592677Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4594214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4594261Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4594299Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4594440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4594527Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4594566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4594716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4594761Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4594909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4594963Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4595003Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4595143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4595194Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4595233Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4595353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4595448Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4595491Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4595618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4595680Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4595722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4595860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4597214Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4597253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4597390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4597429Z return aot_autograd( 2025-09-07T07:33:27.4597521Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4597656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4597727Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4597772Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4597932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4598014Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4598060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4598239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4598309Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4598495Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4598534Z fx_g = _create_graph( 2025-09-07T07:33:27.4598569Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4598730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4598763Z fx_g = make_fx( 2025-09-07T07:33:27.4598796Z ^^^^^^^^ 2025-09-07T07:33:27.4598944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4598990Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4599028Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4600485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4600536Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4600574Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4600730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4600768Z t = dispatch_trace( 2025-09-07T07:33:27.4600802Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4600912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4600954Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4600988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4601116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4601155Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4601191Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4601352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4601453Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4601495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4601618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4601656Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4601692Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4601815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4601858Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4601892Z ^^^^^^^^^ 2025-09-07T07:33:27.4603413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4603456Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4603494Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4603689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4603742Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4603776Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4603932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4603993Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4604037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4604208Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4604246Z outs_pair = fn(*args) 2025-09-07T07:33:27.4604281Z ^^^^^^^^^ 2025-09-07T07:33:27.4604448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4604542Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4604587Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4604760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4604798Z outs_pair = fn(*args) 2025-09-07T07:33:27.4604833Z ^^^^^^^^^ 2025-09-07T07:33:27.4605006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4605066Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4605109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4605301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4606761Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4606809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4606979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4607017Z outs_pair = fn(*args) 2025-09-07T07:33:27.4607051Z ^^^^^^^^^ 2025-09-07T07:33:27.4607240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4607284Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4607321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4607489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4607538Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4607607Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4607731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4607773Z return handle_torch_function( 2025-09-07T07:33:27.4607809Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4607951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4608028Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4608074Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4608239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4608280Z return func(*args, **kwargs) 2025-09-07T07:33:27.4608315Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4608474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4609828Z result = _engine_run_backward( 2025-09-07T07:33:27.4609865Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4610009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4610127Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4610177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4610302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4610343Z return user_fn(self, *args) 2025-09-07T07:33:27.4610379Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4610520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4610591Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4610629Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4610784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4610827Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4610864Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4610985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4611025Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4611060Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4611222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4611273Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4611315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4611451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4611501Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4612848Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4613010Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4613057Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4613159Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4613314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4613353Z t = dispatch_trace( 2025-09-07T07:33:27.4613387Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4613500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4613573Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4613609Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4613733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4613770Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4613806Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4613963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4614042Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4614082Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4614205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4614243Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4614278Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4614437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4614480Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4614514Z ^^^^^^^^^ 2025-09-07T07:33:27.4615979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4616029Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4616063Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4616105Z File "", line 1, in 2025-09-07T07:33:27.4616246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4616324Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4616370Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4616509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4616584Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4616621Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4616811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4616854Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4616890Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4617057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4617100Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4617138Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4617278Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4617322Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4617361Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4617493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4617580Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4618934Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4619059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4619119Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4619162Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4619288Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4619326Z leaves = list(leaves) 2025-09-07T07:33:27.4619364Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4619486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4619547Z return func(x) 2025-09-07T07:33:27.4619580Z ^^^^^^^ 2025-09-07T07:33:27.4619716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4619780Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4619822Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4619987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4620028Z return func(*args, **kwargs) 2025-09-07T07:33:27.4620063Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4620241Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4620327Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4620356Z 2025-09-07T07:33:27.4620558Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4620561Z 2025-09-07T07:33:27.4620562Z 2025-09-07T07:33:27.4620634Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4620829Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4620831Z 2025-09-07T07:33:27.4620916Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4622295Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4622331Z inline_call [] 2025-09-07T07:33:27.4622386Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4622485Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4622559Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4622817Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4622928Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4623009Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4623202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4623286Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4623416Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4623537Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4623608Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4623643Z inline_call [] 2025-09-07T07:33:27.4623697Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4623769Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4623839Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4624089Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4624199Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4624279Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4624460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4625871Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4626002Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4626119Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4626170Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4626284Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4626329Z Traceback (most recent call last): 2025-09-07T07:33:27.4626479Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4626518Z self._run_test( 2025-09-07T07:33:27.4626671Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4626726Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4626768Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4626898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4626944Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4626983Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4627133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4627178Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4627218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4627350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4627415Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4627455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4627594Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4627673Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4629023Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4629174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4629220Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4629368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4629422Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4629462Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4629610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4629663Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4629702Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4629817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4629883Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4629926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4630053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4630115Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4630157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4630295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4630363Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4630401Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4630537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4630576Z return aot_autograd( 2025-09-07T07:33:27.4630610Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4632048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4632117Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4632163Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4632324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4632407Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4632491Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4632673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4632716Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4632901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4632940Z fx_g = _create_graph( 2025-09-07T07:33:27.4632976Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4633200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4633236Z fx_g = make_fx( 2025-09-07T07:33:27.4633268Z ^^^^^^^^ 2025-09-07T07:33:27.4633417Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4633493Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4633532Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4633676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4633719Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4633757Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4633913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4633950Z t = dispatch_trace( 2025-09-07T07:33:27.4635302Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4635415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4635457Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4635492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4635622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4635663Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4635698Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4635858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4635934Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4635976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4636099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4636137Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4636172Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4636299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4636342Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4636380Z ^^^^^^^^^ 2025-09-07T07:33:27.4636544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4636585Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4636620Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4636769Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4636818Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4638164Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4638320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4638382Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4638426Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4638643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4638684Z outs_pair = fn(*args) 2025-09-07T07:33:27.4638719Z ^^^^^^^^^ 2025-09-07T07:33:27.4638887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4638953Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4638997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4639168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4639206Z outs_pair = fn(*args) 2025-09-07T07:33:27.4639240Z ^^^^^^^^^ 2025-09-07T07:33:27.4639414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4639504Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4639548Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4639742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4639811Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4639856Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4640025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4640063Z outs_pair = fn(*args) 2025-09-07T07:33:27.4640097Z ^^^^^^^^^ 2025-09-07T07:33:27.4641594Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4641643Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4641687Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4641855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4641900Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4641937Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4642059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4642103Z return handle_torch_function( 2025-09-07T07:33:27.4642139Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4642279Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4642352Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4642398Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4642586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4642628Z return func(*args, **kwargs) 2025-09-07T07:33:27.4642663Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4642784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4642824Z result = _engine_run_backward( 2025-09-07T07:33:27.4642860Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4643006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4643295Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4643345Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4644860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4644906Z return user_fn(self, *args) 2025-09-07T07:33:27.4644943Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4645084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4645128Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4645166Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4645321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4645365Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4645401Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4645524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4645563Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4645619Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4645785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4645837Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4645877Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4646012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4646061Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4646101Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4646259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4646306Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4646345Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4646507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4647953Z t = dispatch_trace( 2025-09-07T07:33:27.4647990Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4648104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4648147Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4648183Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4648305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4648344Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4648379Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4648537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4648613Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4648657Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4648807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4648846Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4648880Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4649005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4649046Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4649081Z ^^^^^^^^^ 2025-09-07T07:33:27.4649228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4649277Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4649311Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4649353Z File "", line 1, in 2025-09-07T07:33:27.4649494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4650927Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4650974Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4651108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4651155Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4651194Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4651386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4651430Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4651465Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4651633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4651698Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4651736Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4651877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4651919Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4651954Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4652086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4652174Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4652219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4652343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4652403Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4652449Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4652577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4654004Z leaves = list(leaves) 2025-09-07T07:33:27.4654040Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4654162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4654196Z return func(x) 2025-09-07T07:33:27.4654230Z ^^^^^^^ 2025-09-07T07:33:27.4654365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4654429Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4654471Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4654637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4654679Z return func(*args, **kwargs) 2025-09-07T07:33:27.4654747Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4654925Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4655012Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4655014Z 2025-09-07T07:33:27.4655218Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4655221Z 2025-09-07T07:33:27.4655223Z 2025-09-07T07:33:27.4655295Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4655489Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4655492Z 2025-09-07T07:33:27.4655614Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4655689Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4655725Z inline_call [] 2025-09-07T07:33:27.4655779Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4655853Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4655924Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4657572Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4657684Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4657767Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4657946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4658034Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4658163Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4658283Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4658356Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4658391Z inline_call [] 2025-09-07T07:33:27.4658445Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4658517Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4658585Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4658839Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4658950Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4659032Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4659178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4659262Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4659389Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4659506Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4659574Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4659610Z inline_call [] 2025-09-07T07:33:27.4660974Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4661065Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4661133Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4661384Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4661491Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4661571Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4661720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4661803Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4661971Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4662089Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4662301Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-706ddbc6999885be.xml - 2025-09-07T07:33:27.4662360Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4662721Z FAILED [0.2701s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4662805Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4662807Z 2025-09-07T07:33:27.4663026Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4663029Z 2025-09-07T07:33:27.4663031Z 2025-09-07T07:33:27.4663172Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4663363Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4663365Z 2025-09-07T07:33:27.4663448Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4663508Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4663578Z ============= 1 failed, 1 passed, 34 deselected, 2 rerun in 4.95s ============== 2025-09-07T07:33:27.4663612Z Got exit code 1 2025-09-07T07:33:27.4664991Z Retrying single test... 2025-09-07T07:33:27.4665420Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4665462Z import pkg_resources 2025-09-07T07:33:27.4665630Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-4c6b9b92fdfe81a4.xml 2025-09-07T07:33:27.4665685Z ============================= test session starts ============================== 2025-09-07T07:33:27.4665796Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4665836Z cachedir: .pytest_cache 2025-09-07T07:33:27.4665993Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4666038Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4666077Z configfile: pytest.ini 2025-09-07T07:33:27.4666267Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4666343Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.4666575Z stepcurrent: skipping 35 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4666617Z Running 1 items in this shard 2025-09-07T07:33:27.4666619Z 2025-09-07T07:33:27.4666812Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.3930s] [100%] 2025-09-07T07:33:27.4667003Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2163s] [100%] 2025-09-07T07:33:27.4667210Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True FAILED [0.2179s] [100%] 2025-09-07T07:33:27.4667213Z 2025-09-07T07:33:27.4667262Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4667373Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4667416Z Traceback (most recent call last): 2025-09-07T07:33:27.4667570Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4667605Z self._run_test( 2025-09-07T07:33:27.4669035Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4669092Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4669135Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4669295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4669346Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4669385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4669534Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4669580Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4669619Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4669754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4669799Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4669837Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4669978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4670060Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4670102Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4670252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4670299Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4670446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4670499Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4670540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4670680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4672042Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4672083Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4672199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4672286Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4672331Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4672455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4672519Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4672561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4672700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4672744Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4672782Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4672918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4672959Z return aot_autograd( 2025-09-07T07:33:27.4673020Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4673209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4673278Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4673324Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4673483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4673566Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4673610Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4673791Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4673859Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4675370Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4675412Z fx_g = _create_graph( 2025-09-07T07:33:27.4675449Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4675613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4675648Z fx_g = make_fx( 2025-09-07T07:33:27.4675681Z ^^^^^^^^ 2025-09-07T07:33:27.4675830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4675876Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4675915Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4676058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4676103Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4676145Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4676301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4676339Z t = dispatch_trace( 2025-09-07T07:33:27.4676372Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4676484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4676525Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4676560Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4676683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4676723Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4676758Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4678221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4678349Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4678392Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4678514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4678553Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4678587Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4678712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4678754Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4678788Z ^^^^^^^^^ 2025-09-07T07:33:27.4678921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4678962Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4678997Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4679183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4679235Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4679269Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4679424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4679486Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4679531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4679702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4679741Z outs_pair = fn(*args) 2025-09-07T07:33:27.4679778Z ^^^^^^^^^ 2025-09-07T07:33:27.4679946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4681345Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4681393Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4681563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4681602Z outs_pair = fn(*args) 2025-09-07T07:33:27.4681635Z ^^^^^^^^^ 2025-09-07T07:33:27.4681810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4681870Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4681913Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4682102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4682176Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4682222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4682397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4682434Z outs_pair = fn(*args) 2025-09-07T07:33:27.4682470Z ^^^^^^^^^ 2025-09-07T07:33:27.4682655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4682701Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4682738Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4682904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4682950Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4682988Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4683211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4684579Z return handle_torch_function( 2025-09-07T07:33:27.4684617Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4684757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4684831Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4684876Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4685040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4685082Z return func(*args, **kwargs) 2025-09-07T07:33:27.4685117Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4685293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4685337Z result = _engine_run_backward( 2025-09-07T07:33:27.4685372Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4685516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4685633Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4685684Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4685807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4685849Z return user_fn(self, *args) 2025-09-07T07:33:27.4685884Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4686026Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4686090Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4686128Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4686284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4686328Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4687770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4687895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4687934Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4687970Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4688134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4688187Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4688227Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4688369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4688419Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4688458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4688617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4688664Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4688702Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4688857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4688896Z t = dispatch_trace( 2025-09-07T07:33:27.4688930Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4689042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4689086Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4689150Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4689276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4689315Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4689350Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4690830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4690908Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4690950Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4691071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4691111Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4691146Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4691314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4691358Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4691394Z ^^^^^^^^^ 2025-09-07T07:33:27.4691540Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4691589Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4691622Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4691665Z File "", line 1, in 2025-09-07T07:33:27.4691806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4691884Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4691929Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4692062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4692129Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4692167Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4692355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4692398Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4693800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4693976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4694021Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4694058Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4694200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4694242Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4694281Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4694420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4694511Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4694556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4694681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4694741Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4694785Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4694910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4694949Z leaves = list(leaves) 2025-09-07T07:33:27.4694984Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4695106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4695167Z return func(x) 2025-09-07T07:33:27.4695200Z ^^^^^^^ 2025-09-07T07:33:27.4695335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4695399Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4695441Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4696913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4696955Z return func(*args, **kwargs) 2025-09-07T07:33:27.4696991Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4697169Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4697255Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4697259Z 2025-09-07T07:33:27.4697507Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4697510Z 2025-09-07T07:33:27.4697511Z 2025-09-07T07:33:27.4697584Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4697777Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4697779Z 2025-09-07T07:33:27.4697864Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4697937Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4697972Z inline_call [] 2025-09-07T07:33:27.4698026Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4698078Z inductor [] 2025-09-07T07:33:27.4698154Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4698229Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4698486Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4698597Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4698678Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4698828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4698912Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4699042Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4700472Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4700587Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4700631Z Traceback (most recent call last): 2025-09-07T07:33:27.4700782Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4700817Z self._run_test( 2025-09-07T07:33:27.4700929Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4700983Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4701023Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4701154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4701201Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4701244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4701410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4701457Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4701495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4701629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4701673Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4701712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4701850Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4701931Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4701969Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4702156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4702202Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4703717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4703772Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4703813Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4703953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4704005Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4704043Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4704161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4704225Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4704305Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4704430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4704493Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4704535Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4704672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4704716Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4704754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4704889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4704927Z return aot_autograd( 2025-09-07T07:33:27.4704963Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4705100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4705171Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4705217Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4706702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4706786Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4706832Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4707012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4707056Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4707239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4707315Z fx_g = _create_graph( 2025-09-07T07:33:27.4707350Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4707513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4707547Z fx_g = make_fx( 2025-09-07T07:33:27.4707580Z ^^^^^^^^ 2025-09-07T07:33:27.4707729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4707775Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4707813Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4707957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4708000Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4708037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4708229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4708268Z t = dispatch_trace( 2025-09-07T07:33:27.4708302Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4708413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4708455Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4709800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4709924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4709964Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4710000Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4710158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4710236Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4710296Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4710428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4710466Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4710501Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4710625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4710667Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4710701Z ^^^^^^^^^ 2025-09-07T07:33:27.4710834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4710874Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4710911Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4711057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4711108Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4711146Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4711302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4711363Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4712706Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4712880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4712919Z outs_pair = fn(*args) 2025-09-07T07:33:27.4712953Z ^^^^^^^^^ 2025-09-07T07:33:27.4713180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4713245Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4713292Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4713492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4713531Z outs_pair = fn(*args) 2025-09-07T07:33:27.4713564Z ^^^^^^^^^ 2025-09-07T07:33:27.4713739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4713799Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4713841Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4714032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4714101Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4714148Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4714357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4714397Z outs_pair = fn(*args) 2025-09-07T07:33:27.4714431Z ^^^^^^^^^ 2025-09-07T07:33:27.4714619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4714664Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4714701Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4716187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4716235Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4716271Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4716515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4716558Z return handle_torch_function( 2025-09-07T07:33:27.4716595Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4716734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4716808Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4716853Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4717017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4717057Z return func(*args, **kwargs) 2025-09-07T07:33:27.4717093Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4717214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4717257Z result = _engine_run_backward( 2025-09-07T07:33:27.4717296Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4717440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4717558Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4717608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4717732Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4717774Z return user_fn(self, *args) 2025-09-07T07:33:27.4717810Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4719273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4719318Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4719357Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4719515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4719577Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4719614Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4719737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4719776Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4719812Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4719975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4720026Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4720067Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4720201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4720282Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4720322Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4720480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4720527Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4720566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4720721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4720759Z t = dispatch_trace( 2025-09-07T07:33:27.4720793Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4720905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4722251Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4722289Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4722436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4722477Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4722511Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4722668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4722745Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4722786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4722908Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4722946Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4722982Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4723171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4723215Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4723249Z ^^^^^^^^^ 2025-09-07T07:33:27.4723398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4723447Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4723481Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4723522Z File "", line 1, in 2025-09-07T07:33:27.4723664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4723741Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4723788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4723921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4725285Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4725326Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4725543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4725586Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4725622Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4725793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4725837Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4725873Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4726016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4726057Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4726093Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4726225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4726351Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4726399Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4726522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4726582Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4726626Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4726834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4726872Z leaves = list(leaves) 2025-09-07T07:33:27.4726907Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4727027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4728410Z return func(x) 2025-09-07T07:33:27.4728444Z ^^^^^^^ 2025-09-07T07:33:27.4728587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4728651Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4728693Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4728857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4728898Z return func(*args, **kwargs) 2025-09-07T07:33:27.4728933Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4729120Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4729205Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4729207Z 2025-09-07T07:33:27.4729418Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4729423Z 2025-09-07T07:33:27.4729424Z 2025-09-07T07:33:27.4729497Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4729692Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4729694Z 2025-09-07T07:33:27.4729778Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4729850Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4729885Z inline_call [] 2025-09-07T07:33:27.4729939Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4729973Z inductor [] 2025-09-07T07:33:27.4730047Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4730119Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4730394Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4730503Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4731888Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4732039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4732123Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4732254Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4732373Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4732474Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4732512Z inline_call [] 2025-09-07T07:33:27.4732565Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4732638Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4732706Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4732958Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4733124Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4733206Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4733354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4733468Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4733597Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4733713Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4733762Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4733874Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4733919Z Traceback (most recent call last): 2025-09-07T07:33:27.4734069Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4735421Z self._run_test( 2025-09-07T07:33:27.4735535Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4735594Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4735636Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4735768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4735814Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4735854Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4736006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4736053Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4736091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4736226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4736269Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4736310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4736456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4736563Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4736601Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4736753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4736798Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4736946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4736999Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4737039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4737180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4738584Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4738626Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4738742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4738806Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4738850Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4738974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4739037Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4739079Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4739217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4739261Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4739314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4739456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4739494Z return aot_autograd( 2025-09-07T07:33:27.4739530Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4739663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4739732Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4739777Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4739936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4740017Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4740064Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4740246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4741595Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4741781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4741821Z fx_g = _create_graph( 2025-09-07T07:33:27.4741856Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4742018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4742054Z fx_g = make_fx( 2025-09-07T07:33:27.4742087Z ^^^^^^^^ 2025-09-07T07:33:27.4742236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4742282Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4742323Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4742490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4742533Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4742570Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4742728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4742766Z t = dispatch_trace( 2025-09-07T07:33:27.4742800Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4742912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4742952Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4742987Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4743155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4743196Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4743275Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4744752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4744832Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4744873Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4744997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4745035Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4745071Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4745194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4745238Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4745272Z ^^^^^^^^^ 2025-09-07T07:33:27.4745403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4745475Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4745512Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4745659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4745710Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4745744Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4745899Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4745960Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4746006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4746181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4746222Z outs_pair = fn(*args) 2025-09-07T07:33:27.4746259Z ^^^^^^^^^ 2025-09-07T07:33:27.4747728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4747796Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4747841Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4748011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4748050Z outs_pair = fn(*args) 2025-09-07T07:33:27.4748084Z ^^^^^^^^^ 2025-09-07T07:33:27.4748258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4748317Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4748361Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4748583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4748652Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4748698Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4748867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4748905Z outs_pair = fn(*args) 2025-09-07T07:33:27.4748939Z ^^^^^^^^^ 2025-09-07T07:33:27.4749127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4749171Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4749209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4749409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4749457Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4749494Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4749618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4750960Z return handle_torch_function( 2025-09-07T07:33:27.4750999Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4751138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4751212Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4751257Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4751423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4751485Z return func(*args, **kwargs) 2025-09-07T07:33:27.4751521Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4751642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4751685Z result = _engine_run_backward( 2025-09-07T07:33:27.4751719Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4751862Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4751981Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4752031Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4752156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4752199Z return user_fn(self, *args) 2025-09-07T07:33:27.4752239Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4752380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4752423Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4752460Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4752615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4754044Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4754085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4754211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4754253Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4754288Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4754451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4754536Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4754578Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4754711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4754761Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4754800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4754960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4755007Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4755045Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4755202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4755242Z t = dispatch_trace( 2025-09-07T07:33:27.4755309Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4755424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4755466Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4755503Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4755625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4755664Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4757020Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4757181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4757259Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4757301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4757423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4757491Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4757527Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4757653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4757696Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4757730Z ^^^^^^^^^ 2025-09-07T07:33:27.4757877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4757926Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4757960Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4758002Z File "", line 1, in 2025-09-07T07:33:27.4758144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4758220Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4758270Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4758405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4758452Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4758490Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4758680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4758723Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4760059Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4760228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4760273Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4760310Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4760455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4760514Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4760550Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4760682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4760773Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4760820Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4760944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4761004Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4761047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4761172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4761241Z leaves = list(leaves) 2025-09-07T07:33:27.4761277Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4761398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4761434Z return func(x) 2025-09-07T07:33:27.4761466Z ^^^^^^^ 2025-09-07T07:33:27.4761602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4761665Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4763016Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4763274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4763316Z return func(*args, **kwargs) 2025-09-07T07:33:27.4763351Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4763561Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4763647Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4763649Z 2025-09-07T07:33:27.4763854Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4763856Z 2025-09-07T07:33:27.4763858Z 2025-09-07T07:33:27.4763930Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4764124Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4764126Z 2025-09-07T07:33:27.4764210Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4764286Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4764323Z inline_call [] 2025-09-07T07:33:27.4764378Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4764412Z inductor [] 2025-09-07T07:33:27.4764485Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4764556Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4764810Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4764919Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4765001Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4765149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4765237Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4765385Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4766919Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4766990Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4767026Z inline_call [] 2025-09-07T07:33:27.4767079Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4767152Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4767220Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4767476Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4767632Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4767715Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4767863Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4767947Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4768075Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4768191Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4768260Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4768295Z inline_call [] 2025-09-07T07:33:27.4768347Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4768440Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4768509Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4768758Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4768865Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4768945Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4770416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4770500Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4770628Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4770752Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4770967Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-4c6b9b92fdfe81a4.xml - 2025-09-07T07:33:27.4771026Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4771382Z FAILED [0.2179s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4771467Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4771469Z 2025-09-07T07:33:27.4771670Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4771693Z 2025-09-07T07:33:27.4771695Z 2025-09-07T07:33:27.4771768Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4771960Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4771963Z 2025-09-07T07:33:27.4772046Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4772106Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4772172Z ================== 1 failed, 220 deselected, 2 rerun in 1.01s ================== 2025-09-07T07:33:27.4772207Z Got exit code 1 2025-09-07T07:33:27.4772246Z Retrying single test... 2025-09-07T07:33:27.4772700Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4772743Z import pkg_resources 2025-09-07T07:33:27.4772909Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-ff39534ef63fe07b.xml 2025-09-07T07:33:27.4772965Z ============================= test session starts ============================== 2025-09-07T07:33:27.4773150Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4774521Z cachedir: .pytest_cache 2025-09-07T07:33:27.4774677Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4774722Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4774760Z configfile: pytest.ini 2025-09-07T07:33:27.4774954Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4775031Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.4775262Z stepcurrent: skipping 35 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4775304Z Running 1 items in this shard 2025-09-07T07:33:27.4775307Z 2025-09-07T07:33:27.4775500Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.4688s] [100%] 2025-09-07T07:33:27.4775691Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2683s] [100%] 2025-09-07T07:33:27.4775859Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True FAILED [0.2240s] [100%] 2025-09-07T07:33:27.4775866Z 2025-09-07T07:33:27.4775914Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4776026Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4776069Z Traceback (most recent call last): 2025-09-07T07:33:27.4776222Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4776257Z self._run_test( 2025-09-07T07:33:27.4776368Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4776423Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4776465Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4776597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4776645Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4776705Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4778189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4778237Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4778277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4778413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4778459Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4778496Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4778637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4778717Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4778758Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4778961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4779009Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4779157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4779210Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4779252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4779392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4779444Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4779482Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4779597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4779677Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4779724Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4779849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4781235Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4781280Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4781419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4781464Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4781502Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4781643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4781688Z return aot_autograd( 2025-09-07T07:33:27.4781723Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4781867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4781939Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4781986Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4782148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4782231Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4782276Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4782458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4782502Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4782689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4782749Z fx_g = _create_graph( 2025-09-07T07:33:27.4782785Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4782945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4782980Z fx_g = make_fx( 2025-09-07T07:33:27.4783013Z ^^^^^^^^ 2025-09-07T07:33:27.4784550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4784597Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4784636Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4784782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4784826Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4784865Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4785071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4785111Z t = dispatch_trace( 2025-09-07T07:33:27.4785145Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4785260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4785301Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4785337Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4785460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4785501Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4785536Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4785695Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4785773Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4785840Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4785963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4786003Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4786037Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4787472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4787516Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4787552Z ^^^^^^^^^ 2025-09-07T07:33:27.4787683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4787724Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4787759Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4787906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4787962Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4787996Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4788152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4788213Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4788258Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4788430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4788470Z outs_pair = fn(*args) 2025-09-07T07:33:27.4788504Z ^^^^^^^^^ 2025-09-07T07:33:27.4788677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4788742Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4788792Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4788987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4789026Z outs_pair = fn(*args) 2025-09-07T07:33:27.4789060Z ^^^^^^^^^ 2025-09-07T07:33:27.4789234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4790592Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4790636Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4790828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4790898Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4790979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4791151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4791190Z outs_pair = fn(*args) 2025-09-07T07:33:27.4791225Z ^^^^^^^^^ 2025-09-07T07:33:27.4791410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4791456Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4791492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4791659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4791705Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4791742Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4791885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4791929Z return handle_torch_function( 2025-09-07T07:33:27.4791965Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4792104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4792180Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4792225Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4792390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4793803Z return func(*args, **kwargs) 2025-09-07T07:33:27.4793841Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4793963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4794008Z result = _engine_run_backward( 2025-09-07T07:33:27.4794049Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4794193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4794311Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4794360Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4794484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4794525Z return user_fn(self, *args) 2025-09-07T07:33:27.4794561Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4794705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4794748Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4794788Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4794979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4795023Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4795059Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4795181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4795220Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4795256Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4795423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4795475Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4796833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4796969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4797067Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4797107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4797267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4797315Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4797353Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4797509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4797547Z t = dispatch_trace( 2025-09-07T07:33:27.4797581Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4797693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4797735Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4797790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4797915Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4797955Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4797990Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4798148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4798225Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4798266Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4798389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4798428Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4798462Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4799890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4799934Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4799978Z ^^^^^^^^^ 2025-09-07T07:33:27.4800126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4800177Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4800210Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4800253Z File "", line 1, in 2025-09-07T07:33:27.4800392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4800471Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4800516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4800649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4800697Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4800736Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4800951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4800993Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4801030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4801200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4801245Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4801281Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4801421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4801463Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4802803Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4802969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4803120Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4803167Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4803290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4803351Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4803395Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4803519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4803559Z leaves = list(leaves) 2025-09-07T07:33:27.4803593Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4803715Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4803764Z return func(x) 2025-09-07T07:33:27.4803804Z ^^^^^^^ 2025-09-07T07:33:27.4803940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4804004Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4804046Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4804210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4804250Z return func(*args, **kwargs) 2025-09-07T07:33:27.4804286Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4804464Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4804548Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4804551Z 2025-09-07T07:33:27.4804759Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4804762Z 2025-09-07T07:33:27.4804764Z 2025-09-07T07:33:27.4806152Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4806349Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4806351Z 2025-09-07T07:33:27.4806436Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4806508Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4806543Z inline_call [] 2025-09-07T07:33:27.4806597Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4806632Z inductor [] 2025-09-07T07:33:27.4806774Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4806858Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4807142Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4807252Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4807335Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4807485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4807569Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4807699Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4807816Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4808147Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4808193Z Traceback (most recent call last): 2025-09-07T07:33:27.4808343Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4808378Z self._run_test( 2025-09-07T07:33:27.4808488Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4809866Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4809908Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4810040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4810086Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4810126Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4810325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4810375Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4810414Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4810549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4810593Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4810631Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4810771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4810851Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4810889Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4811038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4811086Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4811234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4811286Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4811326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4811465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4811516Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4811554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4812975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4813041Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4813132Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4813260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4813349Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4813390Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4813528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4813572Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4813608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4813744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4813782Z return aot_autograd( 2025-09-07T07:33:27.4813817Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4813952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4814023Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4814101Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4814261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4814343Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4814389Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4814568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4814612Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4814794Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4816149Z fx_g = _create_graph( 2025-09-07T07:33:27.4816215Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4816384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4816419Z fx_g = make_fx( 2025-09-07T07:33:27.4816452Z ^^^^^^^^ 2025-09-07T07:33:27.4816602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4816648Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4816686Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4816831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4816873Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4816910Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4817066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4817108Z t = dispatch_trace( 2025-09-07T07:33:27.4817143Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4817257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4817299Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4817334Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4817458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4817497Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4817534Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4817691Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4817770Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4819111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4819241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4819296Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4819332Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4819456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4819498Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4819532Z ^^^^^^^^^ 2025-09-07T07:33:27.4819664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4819704Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4819740Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4819887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4819938Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4819973Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4820160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4820222Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4820267Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4820439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4820478Z outs_pair = fn(*args) 2025-09-07T07:33:27.4820513Z ^^^^^^^^^ 2025-09-07T07:33:27.4820686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4820752Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4822100Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4822296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4822336Z outs_pair = fn(*args) 2025-09-07T07:33:27.4822369Z ^^^^^^^^^ 2025-09-07T07:33:27.4822542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4822603Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4822646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4822837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4822906Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4822952Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4823206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4823248Z outs_pair = fn(*args) 2025-09-07T07:33:27.4823281Z ^^^^^^^^^ 2025-09-07T07:33:27.4823468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4823512Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4823549Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4823715Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4823762Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4823798Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4823921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4823965Z return handle_torch_function( 2025-09-07T07:33:27.4824028Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4825494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4825570Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4825615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4825781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4825821Z return func(*args, **kwargs) 2025-09-07T07:33:27.4825857Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4825978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4826020Z result = _engine_run_backward( 2025-09-07T07:33:27.4826056Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4826245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4826364Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4826415Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4826538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4826580Z return user_fn(self, *args) 2025-09-07T07:33:27.4826616Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4826756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4826800Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4826836Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4826991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4827060Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4827097Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4827217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4828567Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4828602Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4828768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4828819Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4828860Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4828994Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4829043Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4829082Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4829248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4829295Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4829335Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4829490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4829529Z t = dispatch_trace( 2025-09-07T07:33:27.4829563Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4829675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4829717Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4829753Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4829876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4829916Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4829976Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4830133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4831510Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4831552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4831675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4831713Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4831749Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4831873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4831916Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4831950Z ^^^^^^^^^ 2025-09-07T07:33:27.4832136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4832187Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4832221Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4832263Z File "", line 1, in 2025-09-07T07:33:27.4832408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4832486Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4832531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4832665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4832712Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4832750Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4832941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4833002Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4833039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4833306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4834667Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4834705Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4834847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4834889Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4834926Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4835057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4835146Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4835200Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4835325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4835386Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4835429Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4835554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4835592Z leaves = list(leaves) 2025-09-07T07:33:27.4835627Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4835747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4835782Z return func(x) 2025-09-07T07:33:27.4835814Z ^^^^^^^ 2025-09-07T07:33:27.4835953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4836045Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4836087Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4836251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4837604Z return func(*args, **kwargs) 2025-09-07T07:33:27.4837640Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4837820Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4837904Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4837906Z 2025-09-07T07:33:27.4838114Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4838117Z 2025-09-07T07:33:27.4838170Z 2025-09-07T07:33:27.4838242Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4838436Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4838439Z 2025-09-07T07:33:27.4838523Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4838597Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4838631Z inline_call [] 2025-09-07T07:33:27.4838685Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4838719Z inductor [] 2025-09-07T07:33:27.4838792Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4838867Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4839147Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4839259Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4839341Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4839489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4839573Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4839702Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4839820Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4839889Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4841233Z inline_call [] 2025-09-07T07:33:27.4841293Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4841366Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4841435Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4841685Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4841793Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4841874Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4842022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4842104Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4842256Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4842376Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4842425Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4842537Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4842581Z Traceback (most recent call last): 2025-09-07T07:33:27.4842730Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4842765Z self._run_test( 2025-09-07T07:33:27.4842875Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4842930Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4842971Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4843215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4843261Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4844619Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4844770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4844816Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4844855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4844989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4845033Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4845071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4845211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4845323Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4845361Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4845511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4845556Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4845706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4845759Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4845799Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4845939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4845991Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4846031Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4846148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4846214Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4846258Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4846383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4847835Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4847878Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4848017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4848061Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4848099Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4848237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4848308Z return aot_autograd( 2025-09-07T07:33:27.4848343Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4848477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4848546Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4848592Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4848751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4848833Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4848879Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4849061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4849137Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4849321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4849362Z fx_g = _create_graph( 2025-09-07T07:33:27.4849397Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4849558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4849592Z fx_g = make_fx( 2025-09-07T07:33:27.4850933Z ^^^^^^^^ 2025-09-07T07:33:27.4851084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4851130Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4851168Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4851337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4851381Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4851418Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4851573Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4851611Z t = dispatch_trace( 2025-09-07T07:33:27.4851645Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4851756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4851798Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4851834Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4851956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4851995Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4852031Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4852192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4852272Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4852313Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4852438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4852477Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4852512Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4854007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4854052Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4854086Z ^^^^^^^^^ 2025-09-07T07:33:27.4854221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4854263Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4854328Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4854475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4854525Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4854559Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4854714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4854774Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4854820Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4854992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4855031Z outs_pair = fn(*args) 2025-09-07T07:33:27.4855066Z ^^^^^^^^^ 2025-09-07T07:33:27.4855284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4855352Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4855396Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4855566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4855604Z outs_pair = fn(*args) 2025-09-07T07:33:27.4855639Z ^^^^^^^^^ 2025-09-07T07:33:27.4855814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4857207Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4857250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4857447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4857542Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4857588Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4857757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4857796Z outs_pair = fn(*args) 2025-09-07T07:33:27.4857830Z ^^^^^^^^^ 2025-09-07T07:33:27.4858016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4858061Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4858098Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4858263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4858314Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4858351Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4858474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4858516Z return handle_torch_function( 2025-09-07T07:33:27.4858554Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4858692Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4858767Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4858812Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4858976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4860319Z return func(*args, **kwargs) 2025-09-07T07:33:27.4860356Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4860501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4860543Z result = _engine_run_backward( 2025-09-07T07:33:27.4860578Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4860723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4860843Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4860893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4861017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4861058Z return user_fn(self, *args) 2025-09-07T07:33:27.4861094Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4861272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4861318Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4861354Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4861510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4861553Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4861590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4861711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4861751Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4861786Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4861947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4862014Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4863456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4863593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4863642Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4863681Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4863840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4863888Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4863927Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4864087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4864126Z t = dispatch_trace( 2025-09-07T07:33:27.4864160Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4864277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4864321Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4864357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4864479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4864517Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4864553Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4864709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4864788Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4864829Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4864951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4864991Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4866331Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4866492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4866535Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4866569Z ^^^^^^^^^ 2025-09-07T07:33:27.4866716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4866765Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4866799Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4866840Z File "", line 1, in 2025-09-07T07:33:27.4866981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4867058Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4867104Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4867278Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4867328Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4867366Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4867555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4867598Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4867634Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4867802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4867845Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4867881Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4868022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4868088Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4869431Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4869566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4869655Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4869701Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4869824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4869885Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4869929Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4870054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4870093Z leaves = list(leaves) 2025-09-07T07:33:27.4870129Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4870254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4870289Z return func(x) 2025-09-07T07:33:27.4870322Z ^^^^^^^ 2025-09-07T07:33:27.4870458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4870521Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4870563Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4870729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4870771Z return func(*args, **kwargs) 2025-09-07T07:33:27.4870807Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4870984Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4871090Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4871093Z 2025-09-07T07:33:27.4872596Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4872598Z 2025-09-07T07:33:27.4872600Z 2025-09-07T07:33:27.4872674Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4872870Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4872872Z 2025-09-07T07:33:27.4872955Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4873030Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4873111Z inline_call [] 2025-09-07T07:33:27.4873166Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4873245Z inductor [] 2025-09-07T07:33:27.4873320Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4873392Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4873647Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4873757Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4873840Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4873989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4874075Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4874225Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4874345Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4874415Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4874450Z inline_call [] 2025-09-07T07:33:27.4874504Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4874579Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4874648Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4876227Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4876337Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4876426Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4876574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4876658Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4876787Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4876904Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4876973Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4877008Z inline_call [] 2025-09-07T07:33:27.4877060Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4877132Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4877206Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4877477Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4877584Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4877664Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4877810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4877891Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4878018Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4878134Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4878378Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-ff39534ef63fe07b.xml - 2025-09-07T07:33:27.4878436Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4880108Z FAILED [0.2240s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4880197Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4880199Z 2025-09-07T07:33:27.4880400Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4880419Z 2025-09-07T07:33:27.4880421Z 2025-09-07T07:33:27.4880496Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4880688Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.4880690Z 2025-09-07T07:33:27.4880774Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4880834Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4880903Z ================== 1 failed, 220 deselected, 2 rerun in 1.17s ================== 2025-09-07T07:33:27.4880938Z Got exit code 1 2025-09-07T07:33:27.4881061Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.4881483Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4881525Z import pkg_resources 2025-09-07T07:33:27.4881690Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-6b35803ec3af7c95.xml 2025-09-07T07:33:27.4881747Z ============================= test session starts ============================== 2025-09-07T07:33:27.4881858Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4881898Z cachedir: .pytest_cache 2025-09-07T07:33:27.4882052Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4882097Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4882136Z configfile: pytest.ini 2025-09-07T07:33:27.4882298Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4882393Z collecting ... collected 467 items / 36 deselected / 431 selected 2025-09-07T07:33:27.4883819Z stepcurrent: skipping 36 already run items. 2025-09-07T07:33:27.4883863Z Running 185 items in this shard 2025-09-07T07:33:27.4883866Z 2025-09-07T07:33:27.4884065Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5712s] [ 0%] 2025-09-07T07:33:27.4884258Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2220s] [ 0%] 2025-09-07T07:33:27.4884428Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True FAILED [0.2138s] [ 0%] 2025-09-07T07:33:27.4884430Z 2025-09-07T07:33:27.4884478Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4884643Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4884688Z Traceback (most recent call last): 2025-09-07T07:33:27.4884842Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4884877Z self._run_test( 2025-09-07T07:33:27.4884988Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4885043Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4885087Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4885220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4885267Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4885306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4885479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4885525Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4885564Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4885698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4885741Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4885780Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4887307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4887390Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4887429Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4887580Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4887628Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4887782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4887835Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4887876Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4888017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4888071Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4888109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4888226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4888292Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4888337Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4888466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4888554Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4888595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4888734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4888778Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4888816Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4888952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4890306Z return aot_autograd( 2025-09-07T07:33:27.4890342Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4890478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4890548Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4890630Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4890790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4890873Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4890918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4891099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4891142Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4891325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4891364Z fx_g = _create_graph( 2025-09-07T07:33:27.4891414Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4891582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4891616Z fx_g = make_fx( 2025-09-07T07:33:27.4891650Z ^^^^^^^^ 2025-09-07T07:33:27.4891798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4891845Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4891882Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4892027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4892070Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4892107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4893659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4893701Z t = dispatch_trace( 2025-09-07T07:33:27.4893741Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4893854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4893896Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4893932Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4894055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4894095Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4894131Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4894290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4894369Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4894411Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4894538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4894602Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4894636Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4894761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4894804Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4894838Z ^^^^^^^^^ 2025-09-07T07:33:27.4894976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4895016Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4895052Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4895198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4896567Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4896603Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4896807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4896870Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4896916Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4897088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4897127Z outs_pair = fn(*args) 2025-09-07T07:33:27.4897162Z ^^^^^^^^^ 2025-09-07T07:33:27.4897332Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4897398Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4897443Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4897637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4897678Z outs_pair = fn(*args) 2025-09-07T07:33:27.4897712Z ^^^^^^^^^ 2025-09-07T07:33:27.4897886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4897947Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4897989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4898180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4898251Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4898296Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4898471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4899824Z outs_pair = fn(*args) 2025-09-07T07:33:27.4899861Z ^^^^^^^^^ 2025-09-07T07:33:27.4900047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4900092Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4900129Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4900295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4900340Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4900376Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4900500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4900545Z return handle_torch_function( 2025-09-07T07:33:27.4900589Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4900745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4900820Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4900865Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4901031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4901072Z return func(*args, **kwargs) 2025-09-07T07:33:27.4901107Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4901228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4901270Z result = _engine_run_backward( 2025-09-07T07:33:27.4901306Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4901482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4901603Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4902964Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4903170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4903212Z return user_fn(self, *args) 2025-09-07T07:33:27.4903248Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4903394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4903437Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4903475Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4903634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4903718Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4903754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4903880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4903919Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4903956Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4904117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4904169Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4904210Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4904343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4904392Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4904432Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4904596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4904645Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4906004Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4906161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4906200Z t = dispatch_trace( 2025-09-07T07:33:27.4906234Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4906347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4906389Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4906426Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4906550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4906592Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4906654Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4906814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4906890Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4906931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4907053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4907091Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4907127Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4907252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4907293Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4907327Z ^^^^^^^^^ 2025-09-07T07:33:27.4907514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4907565Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4907600Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4908952Z File "", line 1, in 2025-09-07T07:33:27.4909095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4909172Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4909218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4909353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4909401Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4909439Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4909633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4909695Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4909731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4909903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4909947Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4909983Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4910125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4910167Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4910204Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4910336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4910424Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4910474Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4910598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4910658Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4911996Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4912123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4912163Z leaves = list(leaves) 2025-09-07T07:33:27.4912197Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4912319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4912354Z return func(x) 2025-09-07T07:33:27.4912386Z ^^^^^^^ 2025-09-07T07:33:27.4912522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4912610Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4912652Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4912818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4912859Z return func(*args, **kwargs) 2025-09-07T07:33:27.4912894Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4913144Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4913229Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4913231Z 2025-09-07T07:33:27.4913438Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4913442Z 2025-09-07T07:33:27.4913445Z 2025-09-07T07:33:27.4913554Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4913751Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4913754Z 2025-09-07T07:33:27.4913838Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4913911Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4913945Z inline_call [] 2025-09-07T07:33:27.4913999Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4915351Z inductor [] 2025-09-07T07:33:27.4915426Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4915497Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4915780Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4915893Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4915976Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4916128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4916212Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4916341Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4916462Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4916576Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4916626Z Traceback (most recent call last): 2025-09-07T07:33:27.4916777Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4916813Z self._run_test( 2025-09-07T07:33:27.4916924Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4916978Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4917018Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4917150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4917196Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4917235Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4917383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4918742Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4918809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4918943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4918987Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4919026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4919169Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4919249Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4919287Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4919438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4919483Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4919658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4919715Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4919756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4919897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4919948Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4919987Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4920101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4920166Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4920209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4920334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4920415Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4920465Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4921909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4921956Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4921993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4922129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4922167Z return aot_autograd( 2025-09-07T07:33:27.4922203Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4922337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4922406Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4922451Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4922617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4922699Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4922748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4922930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4922973Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4923228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4923268Z fx_g = _create_graph( 2025-09-07T07:33:27.4923303Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4923464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4923528Z fx_g = make_fx( 2025-09-07T07:33:27.4923561Z ^^^^^^^^ 2025-09-07T07:33:27.4923710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4925068Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4925107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4925254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4925296Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4925333Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4925489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4925526Z t = dispatch_trace( 2025-09-07T07:33:27.4925561Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4925726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4925770Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4925805Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4925931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4925970Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4926007Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4926165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4926242Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4926283Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4926405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4926463Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4926498Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4926630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4926672Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4928081Z ^^^^^^^^^ 2025-09-07T07:33:27.4928215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4928255Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4928291Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4928437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4928487Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4928521Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4928674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4928743Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4928787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4928960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4928998Z outs_pair = fn(*args) 2025-09-07T07:33:27.4929033Z ^^^^^^^^^ 2025-09-07T07:33:27.4929202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4929267Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4929311Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4929482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4929521Z outs_pair = fn(*args) 2025-09-07T07:33:27.4929576Z ^^^^^^^^^ 2025-09-07T07:33:27.4929750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4929810Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4929852Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4931351Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4931421Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4931467Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4931637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4931678Z outs_pair = fn(*args) 2025-09-07T07:33:27.4931712Z ^^^^^^^^^ 2025-09-07T07:33:27.4931937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4931982Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4932019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4932185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4932232Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4932268Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4932392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4932433Z return handle_torch_function( 2025-09-07T07:33:27.4932470Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4932611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4932704Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4932750Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4932914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4932955Z return func(*args, **kwargs) 2025-09-07T07:33:27.4932990Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4934488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4934532Z result = _engine_run_backward( 2025-09-07T07:33:27.4934568Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4934712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4934843Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4934893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4935019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4935060Z return user_fn(self, *args) 2025-09-07T07:33:27.4935097Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4935240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4935283Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4935320Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4935477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4935519Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4935557Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4935706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4935746Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4935781Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4935943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4935994Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4936035Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4936169Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4937529Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4937569Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4937728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4937823Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4937864Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4938019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4938058Z t = dispatch_trace( 2025-09-07T07:33:27.4938092Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4938205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4938248Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4938283Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4938406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4938445Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4938480Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4938663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4938742Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4938783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4938905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4938943Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4938980Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4939104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4940451Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4940487Z ^^^^^^^^^ 2025-09-07T07:33:27.4940639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4940689Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4940729Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4940771Z File "", line 1, in 2025-09-07T07:33:27.4940913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4940992Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4941039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4941172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4941220Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4941258Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4941450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4941494Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4941533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4941723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4941766Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4941804Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4941945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4941988Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4942023Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4942156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4943629Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4943679Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4943851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4943914Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4943957Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4944082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4944120Z leaves = list(leaves) 2025-09-07T07:33:27.4944156Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4944277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4944312Z return func(x) 2025-09-07T07:33:27.4944344Z ^^^^^^^ 2025-09-07T07:33:27.4944480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4944544Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4944611Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4944776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4944817Z return func(*args, **kwargs) 2025-09-07T07:33:27.4944853Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4945030Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4945115Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4945117Z 2025-09-07T07:33:27.4945319Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4945322Z 2025-09-07T07:33:27.4945324Z 2025-09-07T07:33:27.4945395Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4946911Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4946914Z 2025-09-07T07:33:27.4947001Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4947075Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4947109Z inline_call [] 2025-09-07T07:33:27.4947163Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4947197Z inductor [] 2025-09-07T07:33:27.4947271Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4947345Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4947602Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4947718Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4947824Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4947973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4948057Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4948187Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4948308Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4948381Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4948416Z inline_call [] 2025-09-07T07:33:27.4948469Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4948577Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4948650Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4948899Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4949008Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4950402Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4950550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4950634Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4950761Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4950901Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4950952Z =================================== FAILURES =================================== 2025-09-07T07:33:27.4951065Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4951110Z Traceback (most recent call last): 2025-09-07T07:33:27.4951259Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4951295Z self._run_test( 2025-09-07T07:33:27.4951406Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4951460Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4951501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4951632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4951684Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4951723Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4951872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4951919Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4951957Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4952091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4952135Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4953547Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4953690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4953770Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4953812Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4953987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4954033Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4954180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4954233Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4954274Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4954414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4954466Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4954505Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4954620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4954721Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4954766Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4954891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4954954Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4954996Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4955136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4955181Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4955220Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4955356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4956707Z return aot_autograd( 2025-09-07T07:33:27.4956766Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4956908Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4956976Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4957021Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4957181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4957263Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4957309Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4957488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4957532Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.4957719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.4957760Z fx_g = _create_graph( 2025-09-07T07:33:27.4957794Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4957956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.4957990Z fx_g = make_fx( 2025-09-07T07:33:27.4958023Z ^^^^^^^^ 2025-09-07T07:33:27.4958172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.4958218Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.4958256Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4958403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.4958445Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.4959787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4959967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4960005Z t = dispatch_trace( 2025-09-07T07:33:27.4960039Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4960150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4960192Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4960227Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4960352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4960391Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4960427Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4960585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4960694Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4960737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4960861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4960899Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4960934Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4961058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4961100Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4961135Z ^^^^^^^^^ 2025-09-07T07:33:27.4961266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.4961306Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.4961342Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4962790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4962861Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4962894Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4963052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.4963158Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.4963203Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4963380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4963419Z outs_pair = fn(*args) 2025-09-07T07:33:27.4963454Z ^^^^^^^^^ 2025-09-07T07:33:27.4963622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.4963693Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.4963737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4963909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4963947Z outs_pair = fn(*args) 2025-09-07T07:33:27.4963982Z ^^^^^^^^^ 2025-09-07T07:33:27.4964156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.4964216Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.4964258Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4964449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.4964521Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.4964594Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4964763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.4966120Z outs_pair = fn(*args) 2025-09-07T07:33:27.4966155Z ^^^^^^^^^ 2025-09-07T07:33:27.4966342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4966387Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4966424Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4966595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.4966641Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.4966741Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4966907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.4966950Z return handle_torch_function( 2025-09-07T07:33:27.4966987Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4967124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.4967199Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.4967245Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4967411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4967451Z return func(*args, **kwargs) 2025-09-07T07:33:27.4967486Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4967607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.4967673Z result = _engine_run_backward( 2025-09-07T07:33:27.4967709Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4967853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.4969289Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4969342Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4969466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.4969507Z return user_fn(self, *args) 2025-09-07T07:33:27.4969544Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4969686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.4969731Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.4969773Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4969931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.4969974Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.4970010Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4970132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4970172Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4970207Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4970369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.4970420Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.4970461Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4970600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.4970675Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.4970713Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4970873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.4970920Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.4972265Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4972421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.4972460Z t = dispatch_trace( 2025-09-07T07:33:27.4972494Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4972606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.4972650Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.4972719Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4972844Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4972883Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4972920Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4973120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.4973199Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.4973241Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4973367Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.4973405Z return fn(*args, **kwargs) 2025-09-07T07:33:27.4973440Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4973563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.4973635Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.4973670Z ^^^^^^^^^ 2025-09-07T07:33:27.4973817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.4973864Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.4975218Z ^^^^^^^^^^^ 2025-09-07T07:33:27.4975262Z File "", line 1, in 2025-09-07T07:33:27.4975404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.4975481Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.4975528Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4975664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.4975713Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.4975756Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4975944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.4975986Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.4976022Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4976189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.4976232Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.4976271Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4976411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.4976453Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.4976490Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4976628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.4976741Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.4976791Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4976914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.4976975Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.4978321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4978449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.4978486Z leaves = list(leaves) 2025-09-07T07:33:27.4978522Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.4978641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.4978720Z return func(x) 2025-09-07T07:33:27.4978754Z ^^^^^^^ 2025-09-07T07:33:27.4978890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.4978953Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.4978996Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4979159Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.4979201Z return func(*args, **kwargs) 2025-09-07T07:33:27.4979236Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4979413Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4979497Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4979519Z 2025-09-07T07:33:27.4979726Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4979729Z 2025-09-07T07:33:27.4979731Z 2025-09-07T07:33:27.4979804Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4980003Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4980006Z 2025-09-07T07:33:27.4980089Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4980163Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4980197Z inline_call [] 2025-09-07T07:33:27.4981553Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4981588Z inductor [] 2025-09-07T07:33:27.4981664Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4981742Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4981999Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4982109Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4982191Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4982340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4982425Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4982553Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4982676Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4982762Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4982798Z inline_call [] 2025-09-07T07:33:27.4982851Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4982924Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4982992Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4983285Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4983393Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4983475Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4983674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4983759Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4983887Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4985334Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4985404Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.4985439Z inline_call [] 2025-09-07T07:33:27.4985491Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.4985562Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.4985631Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.4985883Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.4986015Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.4986095Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.4986243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.4986325Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.4986452Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.4986568Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.4986783Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-6b35803ec3af7c95.xml - 2025-09-07T07:33:27.4986844Z =========================== short test summary info ============================ 2025-09-07T07:33:27.4987213Z FAILED [0.2138s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.4987297Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.4987299Z 2025-09-07T07:33:27.4987502Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.4987504Z 2025-09-07T07:33:27.4987506Z 2025-09-07T07:33:27.4987577Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.4987777Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4987797Z 2025-09-07T07:33:27.4987880Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.4989255Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.4989321Z ================== 1 failed, 36 deselected, 2 rerun in 1.30s =================== 2025-09-07T07:33:27.4989356Z Got exit code 1 2025-09-07T07:33:27.4989395Z Retrying single test... 2025-09-07T07:33:27.4989811Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.4989850Z import pkg_resources 2025-09-07T07:33:27.4990052Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-0b2e0ba56bbe8c56.xml 2025-09-07T07:33:27.4990110Z ============================= test session starts ============================== 2025-09-07T07:33:27.4990221Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.4990260Z cachedir: .pytest_cache 2025-09-07T07:33:27.4990414Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.4990459Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.4990496Z configfile: pytest.ini 2025-09-07T07:33:27.4990657Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.4990731Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.4990989Z stepcurrent: skipping 36 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.4991033Z Running 1 items in this shard 2025-09-07T07:33:27.4991035Z 2025-09-07T07:33:27.4991230Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5443s] [100%] 2025-09-07T07:33:27.4991421Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2127s] [100%] 2025-09-07T07:33:27.4991589Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True FAILED [0.2132s] [100%] 2025-09-07T07:33:27.4991591Z 2025-09-07T07:33:27.4991640Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.4993112Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.4993164Z Traceback (most recent call last): 2025-09-07T07:33:27.4993318Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.4993353Z self._run_test( 2025-09-07T07:33:27.4993464Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.4993519Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.4993561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4993694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.4993741Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.4993779Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4993928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.4993983Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.4994423Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4994559Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.4994603Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.4994641Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4994783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.4994863Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.4994902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4995054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.4995099Z raise BackendCompilerFailed( 2025-09-07T07:33:27.4995284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.4996664Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4996706Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4996852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.4996903Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.4996942Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4997058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.4997124Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.4997169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4997294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.4997387Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.4997430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4997569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.4997613Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.4997652Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4997792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.4997831Z return aot_autograd( 2025-09-07T07:33:27.4997866Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.4998000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.4998070Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.4998118Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4998280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.4999667Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.4999714Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.4999895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.4999938Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5000123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5000162Z fx_g = _create_graph( 2025-09-07T07:33:27.5000198Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5000361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5000415Z fx_g = make_fx( 2025-09-07T07:33:27.5000448Z ^^^^^^^^ 2025-09-07T07:33:27.5000596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5000643Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5000680Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5000825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5000867Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5000904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5001061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5001100Z t = dispatch_trace( 2025-09-07T07:33:27.5001136Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5001277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5001320Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5001356Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5002786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5002828Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5002864Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5003025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5003164Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5003206Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5003329Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5003395Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5003435Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5003560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5003603Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5003637Z ^^^^^^^^^ 2025-09-07T07:33:27.5003768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5003808Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5003845Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5003992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5004042Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5004076Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5004231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5004297Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5004342Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5004516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5005867Z outs_pair = fn(*args) 2025-09-07T07:33:27.5005902Z ^^^^^^^^^ 2025-09-07T07:33:27.5006073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5006138Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5006184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5006354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5006396Z outs_pair = fn(*args) 2025-09-07T07:33:27.5006454Z ^^^^^^^^^ 2025-09-07T07:33:27.5006628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5006744Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5006788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5006978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5007048Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5007093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5007263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5007302Z outs_pair = fn(*args) 2025-09-07T07:33:27.5007371Z ^^^^^^^^^ 2025-09-07T07:33:27.5007560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5007605Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5007642Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5007808Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5009175Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5009215Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5009338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5009380Z return handle_torch_function( 2025-09-07T07:33:27.5009419Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5009580Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5009656Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5009703Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5009871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5009911Z return func(*args, **kwargs) 2025-09-07T07:33:27.5009948Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5010068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5010110Z result = _engine_run_backward( 2025-09-07T07:33:27.5010145Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5010289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5010412Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5010462Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5010586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5010627Z return user_fn(self, *args) 2025-09-07T07:33:27.5010663Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5010805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5010848Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5012188Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5012345Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5012391Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5012428Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5012574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5012613Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5012649Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5012811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5012864Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5012904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5013038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5013127Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5013165Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5013394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5013443Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5013483Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5013637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5013676Z t = dispatch_trace( 2025-09-07T07:33:27.5013710Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5013822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5013864Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5015216Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5015342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5015382Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5015442Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5015606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5015685Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5015727Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5015849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5015888Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5015923Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5016050Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5016091Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5016124Z ^^^^^^^^^ 2025-09-07T07:33:27.5016273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5016325Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5016361Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5016402Z File "", line 1, in 2025-09-07T07:33:27.5016543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5016620Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5016667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5016800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5016849Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5018189Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5018379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5018424Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5018490Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5018658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5018703Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5018739Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5018881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5018923Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5018960Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5019091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5019180Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5019230Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5019388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5019448Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5019493Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5019617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5019656Z leaves = list(leaves) 2025-09-07T07:33:27.5019690Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5019811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5019846Z return func(x) 2025-09-07T07:33:27.5021195Z ^^^^^^^ 2025-09-07T07:33:27.5021333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5021417Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5021465Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5021630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5021671Z return func(*args, **kwargs) 2025-09-07T07:33:27.5021705Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5021885Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5021970Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5021972Z 2025-09-07T07:33:27.5022175Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5022177Z 2025-09-07T07:33:27.5022179Z 2025-09-07T07:33:27.5022252Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5022452Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5022455Z 2025-09-07T07:33:27.5022540Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5022612Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5022647Z inline_call [] 2025-09-07T07:33:27.5022702Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5022736Z inductor [] 2025-09-07T07:33:27.5022812Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5022883Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5023199Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5023333Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5023415Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5024880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5024967Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5025097Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5025215Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5025328Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5025374Z Traceback (most recent call last): 2025-09-07T07:33:27.5025566Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5025604Z self._run_test( 2025-09-07T07:33:27.5025715Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5025770Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5025811Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5025942Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5025987Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5026026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5026174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5026223Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5026282Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5026424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5026469Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5026507Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5026647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5028029Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5028069Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5028219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5028264Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5028412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5028466Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5028513Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5028655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5028708Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5028746Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5028862Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5028928Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5028972Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5029097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5029159Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5029202Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5029362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5029408Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5029445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5029581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5029619Z return aot_autograd( 2025-09-07T07:33:27.5029655Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5031095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5031166Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5031212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5031372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5031492Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5031541Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5031720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5031763Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5031945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5031985Z fx_g = _create_graph( 2025-09-07T07:33:27.5032020Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5032180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5032228Z fx_g = make_fx( 2025-09-07T07:33:27.5032261Z ^^^^^^^^ 2025-09-07T07:33:27.5032414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5032460Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5032498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5032641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5032684Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5032720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5032878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5032917Z t = dispatch_trace( 2025-09-07T07:33:27.5034319Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5034432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5034476Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5034517Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5034641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5034681Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5034717Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5034875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5034953Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5034994Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5035117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5035155Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5035191Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5035320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5035392Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5035426Z ^^^^^^^^^ 2025-09-07T07:33:27.5035558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5035598Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5035633Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5035779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5035829Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5037173Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5037330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5037392Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5037484Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5037660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5037699Z outs_pair = fn(*args) 2025-09-07T07:33:27.5037733Z ^^^^^^^^^ 2025-09-07T07:33:27.5037902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5037968Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5038012Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5038183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5038221Z outs_pair = fn(*args) 2025-09-07T07:33:27.5038256Z ^^^^^^^^^ 2025-09-07T07:33:27.5038454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5038515Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5038558Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5038750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5038819Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5038865Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5039033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5039071Z outs_pair = fn(*args) 2025-09-07T07:33:27.5039105Z ^^^^^^^^^ 2025-09-07T07:33:27.5040601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5040648Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5040685Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5040851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5040897Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5040934Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5041059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5041101Z return handle_torch_function( 2025-09-07T07:33:27.5041138Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5041276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5041354Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5041420Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5041587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5041627Z return func(*args, **kwargs) 2025-09-07T07:33:27.5041662Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5041784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5041825Z result = _engine_run_backward( 2025-09-07T07:33:27.5041861Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5042005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5042124Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5042203Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5043698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5043740Z return user_fn(self, *args) 2025-09-07T07:33:27.5043778Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5043920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5043963Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5044000Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5044155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5044198Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5044235Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5044389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5044431Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5044466Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5044628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5044679Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5044720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5044854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5044903Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5044942Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5045101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5045149Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5045191Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5045348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5046751Z t = dispatch_trace( 2025-09-07T07:33:27.5046787Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5046898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5046941Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5046977Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5047101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5047139Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5047175Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5047333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5047438Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5047478Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5047602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5047640Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5047677Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5047801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5047843Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5047877Z ^^^^^^^^^ 2025-09-07T07:33:27.5048024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5048073Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5048107Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5048150Z File "", line 1, in 2025-09-07T07:33:27.5049648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5049729Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5049775Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5049909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5049957Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5049995Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5050182Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5050226Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5050262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5050450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5050494Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5050531Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5050672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5050715Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5050751Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5050882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5050972Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5051020Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5051146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5051212Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5051256Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5051381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5052719Z leaves = list(leaves) 2025-09-07T07:33:27.5052756Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5052879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5052914Z return func(x) 2025-09-07T07:33:27.5052946Z ^^^^^^^ 2025-09-07T07:33:27.5053149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5053213Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5053256Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5053427Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5053492Z return func(*args, **kwargs) 2025-09-07T07:33:27.5053528Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5053708Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5053794Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5053796Z 2025-09-07T07:33:27.5054000Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5054002Z 2025-09-07T07:33:27.5054004Z 2025-09-07T07:33:27.5054076Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5054307Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5054312Z 2025-09-07T07:33:27.5054395Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5054468Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5054503Z inline_call [] 2025-09-07T07:33:27.5054557Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5054591Z inductor [] 2025-09-07T07:33:27.5055990Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5056065Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5056321Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5056431Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5056541Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5056689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5056774Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5056903Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5057022Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5057094Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5057129Z inline_call [] 2025-09-07T07:33:27.5057183Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5057254Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5057329Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5057581Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5057690Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5057771Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5057920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5058003Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5058133Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5058249Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5058329Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5059754Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5059800Z Traceback (most recent call last): 2025-09-07T07:33:27.5059951Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5059988Z self._run_test( 2025-09-07T07:33:27.5060099Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5060153Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5060194Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5060326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5060374Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5060448Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5060599Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5060645Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5060683Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5060818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5060862Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5060900Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5061038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5061119Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5061157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5061331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5061378Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5062835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5062890Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5062931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5063134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5063187Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5063226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5063341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5063406Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5063455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5063581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5063643Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5063685Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5063823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5063868Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5063904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5064040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5064078Z return aot_autograd( 2025-09-07T07:33:27.5064114Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5064253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5064356Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5064401Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5064560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5065959Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5066009Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5066193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5066236Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5066419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5066503Z fx_g = _create_graph( 2025-09-07T07:33:27.5066539Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5066702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5066736Z fx_g = make_fx( 2025-09-07T07:33:27.5066769Z ^^^^^^^^ 2025-09-07T07:33:27.5066918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5066964Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5067002Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5067146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5067188Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5067224Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5067404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5067443Z t = dispatch_trace( 2025-09-07T07:33:27.5067478Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5067590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5067631Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5067667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5069094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5069134Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5069170Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5069328Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5069406Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5069449Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5069580Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5069618Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5069653Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5069777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5069819Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5069853Z ^^^^^^^^^ 2025-09-07T07:33:27.5069985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5070025Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5070061Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5070207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5070260Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5070316Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5070471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5070533Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5070576Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5072050Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5072092Z outs_pair = fn(*args) 2025-09-07T07:33:27.5072126Z ^^^^^^^^^ 2025-09-07T07:33:27.5072294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5072360Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5072405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5072612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5072650Z outs_pair = fn(*args) 2025-09-07T07:33:27.5072686Z ^^^^^^^^^ 2025-09-07T07:33:27.5072864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5072924Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5072966Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5073212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5073280Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5073350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5073525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5073564Z outs_pair = fn(*args) 2025-09-07T07:33:27.5073598Z ^^^^^^^^^ 2025-09-07T07:33:27.5073785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5073830Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5073867Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5074032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5075636Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5075675Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5075809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5075856Z return handle_torch_function( 2025-09-07T07:33:27.5075892Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5076033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5076131Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5076181Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5076347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5076388Z return func(*args, **kwargs) 2025-09-07T07:33:27.5076424Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5076547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5076590Z result = _engine_run_backward( 2025-09-07T07:33:27.5076630Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5076799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5076918Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5076967Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5077092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5077132Z return user_fn(self, *args) 2025-09-07T07:33:27.5077169Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5077309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5078872Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5078911Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5079114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5079160Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5079197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5079319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5079363Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5079398Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5079560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5079611Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5079653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5079787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5079861Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5079902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5080063Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5080110Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5080149Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5080304Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5080343Z t = dispatch_trace( 2025-09-07T07:33:27.5080377Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5080488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5081863Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5081901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5082032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5082072Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5082108Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5082267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5082345Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5082385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5082509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5082547Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5082582Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5082706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5082749Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5082787Z ^^^^^^^^^ 2025-09-07T07:33:27.5082952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5083001Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5083035Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5083138Z File "", line 1, in 2025-09-07T07:33:27.5083280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5083358Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5083406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5083547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5084921Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5084962Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5085204Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5085248Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5085284Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5085452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5085497Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5085535Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5085677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5085720Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5085755Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5085888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5086000Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5086048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5086172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5086232Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5086276Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5086402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5086440Z leaves = list(leaves) 2025-09-07T07:33:27.5086475Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5086595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5088029Z return func(x) 2025-09-07T07:33:27.5088063Z ^^^^^^^ 2025-09-07T07:33:27.5088210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5088275Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5088317Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5088482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5088523Z return func(*args, **kwargs) 2025-09-07T07:33:27.5088559Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5088737Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5088822Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5088824Z 2025-09-07T07:33:27.5089031Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5089059Z 2025-09-07T07:33:27.5089061Z 2025-09-07T07:33:27.5089134Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5089331Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5089333Z 2025-09-07T07:33:27.5089418Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5089492Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5089526Z inline_call [] 2025-09-07T07:33:27.5089581Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5089615Z inductor [] 2025-09-07T07:33:27.5089689Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5089762Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5090047Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5090159Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5091568Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5091719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5091805Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5091936Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5092054Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5092147Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5092184Z inline_call [] 2025-09-07T07:33:27.5092238Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5092311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5092380Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5092630Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5092738Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5092820Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5092967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5093058Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5093245Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5093362Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5093431Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5093465Z inline_call [] 2025-09-07T07:33:27.5093519Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5093590Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5094990Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5095242Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5095386Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5095467Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5095613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5095695Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5095823Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5095938Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5096153Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-0b2e0ba56bbe8c56.xml - 2025-09-07T07:33:27.5096246Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5096608Z FAILED [0.2132s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5096691Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5096694Z 2025-09-07T07:33:27.5096895Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5096898Z 2025-09-07T07:33:27.5096900Z 2025-09-07T07:33:27.5096971Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5097165Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5097191Z 2025-09-07T07:33:27.5097274Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5097336Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5097404Z ================== 1 failed, 220 deselected, 2 rerun in 1.24s ================== 2025-09-07T07:33:27.5097439Z Got exit code 1 2025-09-07T07:33:27.5097478Z Retrying single test... 2025-09-07T07:33:27.5097897Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5099260Z import pkg_resources 2025-09-07T07:33:27.5099429Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-6f5d34837fb37628.xml 2025-09-07T07:33:27.5099494Z ============================= test session starts ============================== 2025-09-07T07:33:27.5099605Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5099645Z cachedir: .pytest_cache 2025-09-07T07:33:27.5099799Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5099844Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5099882Z configfile: pytest.ini 2025-09-07T07:33:27.5100041Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5100115Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.5100345Z stepcurrent: skipping 36 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5100408Z Running 1 items in this shard 2025-09-07T07:33:27.5100410Z 2025-09-07T07:33:27.5100606Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5511s] [100%] 2025-09-07T07:33:27.5100798Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2203s] [100%] 2025-09-07T07:33:27.5100966Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True FAILED [0.2307s] [100%] 2025-09-07T07:33:27.5100969Z 2025-09-07T07:33:27.5101017Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5101130Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5101174Z Traceback (most recent call last): 2025-09-07T07:33:27.5101366Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5101402Z self._run_test( 2025-09-07T07:33:27.5101514Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5101569Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5102944Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5103141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5103189Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5103228Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5103376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5103422Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5103495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5103631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5103675Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5103713Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5103853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5103934Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5103973Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5104125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5104170Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5104320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5104379Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5104421Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5104564Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5104616Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5104654Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5106104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5106172Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5106219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5106344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5106407Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5106452Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5106615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5106660Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5106699Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5106835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5106875Z return aot_autograd( 2025-09-07T07:33:27.5106909Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5107044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5107113Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5107160Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5107355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5107441Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5107486Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5107665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5107709Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5107893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5107935Z fx_g = _create_graph( 2025-09-07T07:33:27.5109290Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5109454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5109507Z fx_g = make_fx( 2025-09-07T07:33:27.5109545Z ^^^^^^^^ 2025-09-07T07:33:27.5109694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5109740Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5109778Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5109923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5109965Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5110003Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5110158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5110196Z t = dispatch_trace( 2025-09-07T07:33:27.5110230Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5110342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5110389Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5110426Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5110548Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5110589Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5110624Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5110783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5110861Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5112215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5112340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5112381Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5112417Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5112547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5112609Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5112643Z ^^^^^^^^^ 2025-09-07T07:33:27.5112775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5112815Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5112851Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5112997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5113048Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5113143Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5113300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5113362Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5113446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5113619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5113659Z outs_pair = fn(*args) 2025-09-07T07:33:27.5113694Z ^^^^^^^^^ 2025-09-07T07:33:27.5113865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5113930Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5113976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5115496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5115537Z outs_pair = fn(*args) 2025-09-07T07:33:27.5115593Z ^^^^^^^^^ 2025-09-07T07:33:27.5115779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5115838Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5115881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5116077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5116146Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5116191Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5116361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5116399Z outs_pair = fn(*args) 2025-09-07T07:33:27.5116435Z ^^^^^^^^^ 2025-09-07T07:33:27.5116624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5116670Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5116706Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5116872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5116918Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5116955Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5117078Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5117120Z return handle_torch_function( 2025-09-07T07:33:27.5117159Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5117297Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5118726Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5118773Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5118938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5118979Z return func(*args, **kwargs) 2025-09-07T07:33:27.5119016Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5119138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5119180Z result = _engine_run_backward( 2025-09-07T07:33:27.5119216Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5119364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5119484Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5119568Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5119693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5119735Z return user_fn(self, *args) 2025-09-07T07:33:27.5119771Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5119913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5119955Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5119992Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5120146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5120190Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5120225Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5120366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5121731Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5121768Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5121931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5121983Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5122023Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5122157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5122206Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5122244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5122404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5122456Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5122497Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5122656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5122695Z t = dispatch_trace( 2025-09-07T07:33:27.5122729Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5122842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5122885Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5122921Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5123044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5123159Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5123194Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5123356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5123463Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5124832Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5124956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5124996Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5125030Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5125157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5125198Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5125234Z ^^^^^^^^^ 2025-09-07T07:33:27.5125381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5125430Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5125466Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5125554Z File "", line 1, in 2025-09-07T07:33:27.5125697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5125775Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5125822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5125956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5126005Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5126042Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5126236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5126279Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5126333Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5126507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5127937Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5127976Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5128120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5128163Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5128199Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5128331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5128420Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5128466Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5128598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5128659Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5128703Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5128827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5128866Z leaves = list(leaves) 2025-09-07T07:33:27.5128900Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5129021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5129056Z return func(x) 2025-09-07T07:33:27.5129088Z ^^^^^^^ 2025-09-07T07:33:27.5129225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5129288Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5129333Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5129526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5129568Z return func(*args, **kwargs) 2025-09-07T07:33:27.5130927Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5131107Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5131192Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5131195Z 2025-09-07T07:33:27.5131400Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5131403Z 2025-09-07T07:33:27.5131404Z 2025-09-07T07:33:27.5131477Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5131708Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5131712Z 2025-09-07T07:33:27.5131797Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5131870Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5131905Z inline_call [] 2025-09-07T07:33:27.5131958Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5131992Z inductor [] 2025-09-07T07:33:27.5132067Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5132138Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5132395Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5132526Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5132609Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5132758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5132843Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5132972Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5133162Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5133274Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5134657Z Traceback (most recent call last): 2025-09-07T07:33:27.5134811Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5134854Z self._run_test( 2025-09-07T07:33:27.5134966Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5135021Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5135061Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5135192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5135238Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5135277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5135424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5135471Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5135509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5135646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5135724Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5135762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5135902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5135982Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5136019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5136169Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5136214Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5136361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5136415Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5137787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5137975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5138028Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5138068Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5138183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5138249Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5138293Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5138419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5138481Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5138523Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5138683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5138729Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5138765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5138902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5138940Z return aot_autograd( 2025-09-07T07:33:27.5138976Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5139110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5139180Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5139226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5139385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5139470Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5140837Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5141020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5141063Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5141249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5141289Z fx_g = _create_graph( 2025-09-07T07:33:27.5141324Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5141488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5141522Z fx_g = make_fx( 2025-09-07T07:33:27.5141555Z ^^^^^^^^ 2025-09-07T07:33:27.5141710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5141776Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5141813Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5141960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5142004Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5142040Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5142195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5142232Z t = dispatch_trace( 2025-09-07T07:33:27.5142267Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5142378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5142420Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5142456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5142613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5144039Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5144077Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5144237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5144315Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5144356Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5144480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5144519Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5144556Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5144683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5144758Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5144794Z ^^^^^^^^^ 2025-09-07T07:33:27.5144926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5144966Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5145002Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5145148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5145197Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5145232Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5145386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5145449Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5145492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5145669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5145709Z outs_pair = fn(*args) 2025-09-07T07:33:27.5147070Z ^^^^^^^^^ 2025-09-07T07:33:27.5147240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5147306Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5147350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5147522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5147559Z outs_pair = fn(*args) 2025-09-07T07:33:27.5147594Z ^^^^^^^^^ 2025-09-07T07:33:27.5147769Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5147861Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5147904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5148098Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5148167Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5148214Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5148383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5148421Z outs_pair = fn(*args) 2025-09-07T07:33:27.5148455Z ^^^^^^^^^ 2025-09-07T07:33:27.5148642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5148726Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5148763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5148928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5148974Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5150330Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5150457Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5150499Z return handle_torch_function( 2025-09-07T07:33:27.5150536Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5150676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5150751Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5150821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5150989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5151029Z return func(*args, **kwargs) 2025-09-07T07:33:27.5151065Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5151186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5151227Z result = _engine_run_backward( 2025-09-07T07:33:27.5151264Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5151411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5151532Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5151581Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5151711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5151751Z return user_fn(self, *args) 2025-09-07T07:33:27.5151788Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5151930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5151973Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5152010Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5153549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5153594Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5153631Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5153752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5153793Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5153862Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5154027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5154078Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5154119Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5154253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5154303Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5154341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5154500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5154547Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5154586Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5154783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5154823Z t = dispatch_trace( 2025-09-07T07:33:27.5154858Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5154969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5155013Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5155049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5156498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5156538Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5156574Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5156734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5156837Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5156884Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5157007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5157045Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5157080Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5157204Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5157247Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5157280Z ^^^^^^^^^ 2025-09-07T07:33:27.5157428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5157477Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5157511Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5157552Z File "", line 1, in 2025-09-07T07:33:27.5157697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5157774Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5157820Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5157954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5158001Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5158039Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5159551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5159596Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5159632Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5159800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5159865Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5159903Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5160044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5160087Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5160122Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5160255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5160341Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5160388Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5160512Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5160574Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5160646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5160772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5160810Z leaves = list(leaves) 2025-09-07T07:33:27.5160845Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5160966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5161001Z return func(x) 2025-09-07T07:33:27.5161033Z ^^^^^^^ 2025-09-07T07:33:27.5162491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5162557Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5162600Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5162769Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5162833Z return func(*args, **kwargs) 2025-09-07T07:33:27.5162869Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5163047Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5163179Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5163182Z 2025-09-07T07:33:27.5163385Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5163388Z 2025-09-07T07:33:27.5163389Z 2025-09-07T07:33:27.5163462Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5163663Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5163666Z 2025-09-07T07:33:27.5163753Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5163826Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5163861Z inline_call [] 2025-09-07T07:33:27.5163915Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5163949Z inductor [] 2025-09-07T07:33:27.5164023Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5164094Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5164348Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5164457Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5164542Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5164718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5166130Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5166262Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5166385Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5166456Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5166492Z inline_call [] 2025-09-07T07:33:27.5166546Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5166617Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5166767Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5167068Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5167179Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5167260Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5167409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5167491Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5167620Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5167736Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5167814Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5167929Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5167975Z Traceback (most recent call last): 2025-09-07T07:33:27.5168123Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5168161Z self._run_test( 2025-09-07T07:33:27.5168272Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5169654Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5169696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5169829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5169875Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5169914Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5170069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5170117Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5170155Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5170289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5170333Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5170371Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5170511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5170591Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5170629Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5170781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5170848Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5170997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5171050Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5171090Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5171230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5171281Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5171321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5172757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5172824Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5172869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5173036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5173141Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5173185Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5173324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5173369Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5173407Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5173545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5173583Z return aot_autograd( 2025-09-07T07:33:27.5173619Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5173752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5173851Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5173897Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5174056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5174138Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5174184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5174363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5174407Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5174590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5175965Z fx_g = _create_graph( 2025-09-07T07:33:27.5176002Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5176174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5176208Z fx_g = make_fx( 2025-09-07T07:33:27.5176241Z ^^^^^^^^ 2025-09-07T07:33:27.5176390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5176437Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5176474Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5176622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5176665Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5176701Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5176857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5176922Z t = dispatch_trace( 2025-09-07T07:33:27.5176957Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5177068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5177111Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5177146Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5177269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5177309Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5177344Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5177504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5177582Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5178942Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5179112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5179153Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5179188Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5179313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5179355Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5179389Z ^^^^^^^^^ 2025-09-07T07:33:27.5179521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5179561Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5179596Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5179743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5179792Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5179843Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5180006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5180069Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5180113Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5180285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5180324Z outs_pair = fn(*args) 2025-09-07T07:33:27.5180358Z ^^^^^^^^^ 2025-09-07T07:33:27.5180527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5180592Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5180636Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5182143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5182183Z outs_pair = fn(*args) 2025-09-07T07:33:27.5182218Z ^^^^^^^^^ 2025-09-07T07:33:27.5182391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5182451Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5182494Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5182687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5182756Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5182802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5182977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5183036Z outs_pair = fn(*args) 2025-09-07T07:33:27.5183130Z ^^^^^^^^^ 2025-09-07T07:33:27.5183317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5183362Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5183399Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5183569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5183616Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5183652Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5183776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5183819Z return handle_torch_function( 2025-09-07T07:33:27.5183896Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5185372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5185450Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5185495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5185660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5185701Z return func(*args, **kwargs) 2025-09-07T07:33:27.5185736Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5185857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5185900Z result = _engine_run_backward( 2025-09-07T07:33:27.5185935Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5186106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5186227Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5186276Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5186402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5186442Z return user_fn(self, *args) 2025-09-07T07:33:27.5186478Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5186620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5186664Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5186701Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5186865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5186910Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5186946Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5187068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5188429Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5188465Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5188628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5188679Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5188722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5188856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5188905Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5188947Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5189133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5189179Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5189218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5189373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5189412Z t = dispatch_trace( 2025-09-07T07:33:27.5189447Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5189559Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5189602Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5189638Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5189762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5189840Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5189877Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5190036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5191461Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5191503Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5191630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5191668Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5191703Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5191827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5191868Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5191903Z ^^^^^^^^^ 2025-09-07T07:33:27.5192076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5192125Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5192160Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5192201Z File "", line 1, in 2025-09-07T07:33:27.5192342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5192421Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5192467Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5192601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5192648Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5192686Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5192878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5192922Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5192958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5193198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5194577Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5194615Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5194757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5194800Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5194835Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5194971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5195061Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5195136Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5195263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5195324Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5195367Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5195491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5195529Z leaves = list(leaves) 2025-09-07T07:33:27.5195564Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5195685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5195720Z return func(x) 2025-09-07T07:33:27.5195752Z ^^^^^^^ 2025-09-07T07:33:27.5195942Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5196008Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5196050Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5196214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5197673Z return func(*args, **kwargs) 2025-09-07T07:33:27.5197712Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5197891Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5197975Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5197977Z 2025-09-07T07:33:27.5198181Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5198214Z 2025-09-07T07:33:27.5198221Z 2025-09-07T07:33:27.5198294Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5198493Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5198496Z 2025-09-07T07:33:27.5198580Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5198652Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5198687Z inline_call [] 2025-09-07T07:33:27.5198742Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5198775Z inductor [] 2025-09-07T07:33:27.5198849Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5198920Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5199178Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5199288Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5199370Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5199519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5199603Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5199733Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5199851Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5199920Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5201371Z inline_call [] 2025-09-07T07:33:27.5201427Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5201499Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5201569Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5201821Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5201932Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5202014Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5202162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5202247Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5202412Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5202529Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5202598Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5202631Z inline_call [] 2025-09-07T07:33:27.5202684Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5202754Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5202823Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5203260Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5203397Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5203478Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5203625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5203706Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5205189Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5205307Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5205522Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-6f5d34837fb37628.xml - 2025-09-07T07:33:27.5205579Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5205958Z FAILED [0.2307s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5206042Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5206044Z 2025-09-07T07:33:27.5206246Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5206248Z 2025-09-07T07:33:27.5206250Z 2025-09-07T07:33:27.5206322Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5206517Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.5206521Z 2025-09-07T07:33:27.5206607Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5206759Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5206825Z ================== 1 failed, 220 deselected, 2 rerun in 1.21s ================== 2025-09-07T07:33:27.5206860Z Got exit code 1 2025-09-07T07:33:27.5206983Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.5207397Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5207437Z import pkg_resources 2025-09-07T07:33:27.5207602Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-41a59fffa3599b15.xml 2025-09-07T07:33:27.5207697Z ============================= test session starts ============================== 2025-09-07T07:33:27.5207808Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5207848Z cachedir: .pytest_cache 2025-09-07T07:33:27.5208001Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5209385Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5209425Z configfile: pytest.ini 2025-09-07T07:33:27.5209585Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5209659Z collecting ... collected 467 items / 37 deselected / 430 selected 2025-09-07T07:33:27.5209709Z stepcurrent: skipping 37 already run items. 2025-09-07T07:33:27.5209751Z Running 184 items in this shard 2025-09-07T07:33:27.5209773Z 2025-09-07T07:33:27.5209976Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.1221s] [ 0%] 2025-09-07T07:33:27.5210168Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.6804s] [ 0%] 2025-09-07T07:33:27.5210337Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True FAILED [0.7099s] [ 0%] 2025-09-07T07:33:27.5210340Z 2025-09-07T07:33:27.5210388Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5210498Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5210541Z Traceback (most recent call last): 2025-09-07T07:33:27.5210693Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5210729Z self._run_test( 2025-09-07T07:33:27.5210843Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5210897Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5210938Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5211071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5211117Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5211156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5211305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5211351Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5212707Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5212843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5212908Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5212947Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5213152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5213236Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5213274Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5213424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5213469Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5213618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5213671Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5213713Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5213892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5213944Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5213983Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5214097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5214162Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5214207Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5214330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5214393Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5214435Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5215920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5215967Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5216006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5216146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5216185Z return aot_autograd( 2025-09-07T07:33:27.5216219Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5216354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5216422Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5216468Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5216626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5216709Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5216760Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5216940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5216984Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5217167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5217207Z fx_g = _create_graph( 2025-09-07T07:33:27.5217241Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5217401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5217435Z fx_g = make_fx( 2025-09-07T07:33:27.5217468Z ^^^^^^^^ 2025-09-07T07:33:27.5217621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5217691Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5219047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5219196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5219239Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5219276Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5219432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5219470Z t = dispatch_trace( 2025-09-07T07:33:27.5219503Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5219617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5219658Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5219696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5219858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5219899Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5219935Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5220094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5220171Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5220212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5220336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5220376Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5220411Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5220535Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5220592Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5220631Z ^^^^^^^^^ 2025-09-07T07:33:27.5222082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5222123Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5222159Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5222305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5222356Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5222390Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5222545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5222606Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5222650Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5222833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5222874Z outs_pair = fn(*args) 2025-09-07T07:33:27.5222908Z ^^^^^^^^^ 2025-09-07T07:33:27.5223154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5223220Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5223264Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5223433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5223473Z outs_pair = fn(*args) 2025-09-07T07:33:27.5223506Z ^^^^^^^^^ 2025-09-07T07:33:27.5223679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5223767Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5223809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5225341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5225413Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5225458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5225628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5225666Z outs_pair = fn(*args) 2025-09-07T07:33:27.5225701Z ^^^^^^^^^ 2025-09-07T07:33:27.5225886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5225982Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5226019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5226184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5226231Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5226267Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5226391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5226433Z return handle_torch_function( 2025-09-07T07:33:27.5226469Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5226608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5226683Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5226754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5226921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5226961Z return func(*args, **kwargs) 2025-09-07T07:33:27.5226997Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5227117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5228485Z result = _engine_run_backward( 2025-09-07T07:33:27.5228522Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5228666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5228783Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5228833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5228965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5229007Z return user_fn(self, *args) 2025-09-07T07:33:27.5229042Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5229185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5229228Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5229265Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5229420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5229464Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5229499Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5229624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5229665Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5229723Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5229886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5229937Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5229977Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5230110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5231479Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5231519Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5231679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5231725Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5231764Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5231962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5232002Z t = dispatch_trace( 2025-09-07T07:33:27.5232036Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5232147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5232189Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5232225Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5232346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5232385Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5232419Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5232577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5232654Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5232714Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5232836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5232874Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5232909Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5233035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5233138Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5234495Z ^^^^^^^^^ 2025-09-07T07:33:27.5234645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5234694Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5234729Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5234771Z File "", line 1, in 2025-09-07T07:33:27.5234923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5235003Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5235050Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5235189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5235237Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5235274Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5235462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5235504Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5235540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5235708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5235785Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5235821Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5235961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5236003Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5236039Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5236170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5237580Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5237628Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5237756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5237816Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5237906Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5238031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5238070Z leaves = list(leaves) 2025-09-07T07:33:27.5238105Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5238225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5238260Z return func(x) 2025-09-07T07:33:27.5238292Z ^^^^^^^ 2025-09-07T07:33:27.5238428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5238491Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5238533Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5238697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5238764Z return func(*args, **kwargs) 2025-09-07T07:33:27.5238799Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5238977Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5239060Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5239062Z 2025-09-07T07:33:27.5239265Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5239267Z 2025-09-07T07:33:27.5239269Z 2025-09-07T07:33:27.5239340Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5239533Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5239537Z 2025-09-07T07:33:27.5240943Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5241018Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5241053Z inline_call [] 2025-09-07T07:33:27.5241107Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5241140Z inductor [] 2025-09-07T07:33:27.5241215Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5241286Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5241539Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5241648Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5241729Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5241905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5241990Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5242119Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5242237Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5242348Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5242392Z Traceback (most recent call last): 2025-09-07T07:33:27.5242543Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5242578Z self._run_test( 2025-09-07T07:33:27.5242689Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5242779Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5242821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5244355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5244403Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5244443Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5244594Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5244640Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5244678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5244812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5244855Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5244922Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5245068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5245147Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5245185Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5245338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5245384Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5245530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5245584Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5245624Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5245764Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5245820Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5245860Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5245975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5246041Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5247470Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5247596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5247658Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5247703Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5247842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5247889Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5247927Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5248089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5248127Z return aot_autograd( 2025-09-07T07:33:27.5248162Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5248296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5248365Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5248411Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5248571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5248653Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5248699Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5248915Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5248959Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5249142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5249182Z fx_g = _create_graph( 2025-09-07T07:33:27.5249216Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5250701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5250737Z fx_g = make_fx( 2025-09-07T07:33:27.5250770Z ^^^^^^^^ 2025-09-07T07:33:27.5250919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5250983Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5251025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5251171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5251214Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5251250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5251407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5251447Z t = dispatch_trace( 2025-09-07T07:33:27.5251482Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5251593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5251634Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5251669Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5251792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5251835Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5251873Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5252031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5252110Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5252150Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5252273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5253690Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5253728Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5253853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5253895Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5253930Z ^^^^^^^^^ 2025-09-07T07:33:27.5254066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5254129Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5254164Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5254311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5254360Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5254395Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5254549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5254612Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5254656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5254835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5254875Z outs_pair = fn(*args) 2025-09-07T07:33:27.5254948Z ^^^^^^^^^ 2025-09-07T07:33:27.5255118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5255185Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5255229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5255401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5255439Z outs_pair = fn(*args) 2025-09-07T07:33:27.5256797Z ^^^^^^^^^ 2025-09-07T07:33:27.5256972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5257033Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5257103Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5257297Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5257366Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5257412Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5257584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5257623Z outs_pair = fn(*args) 2025-09-07T07:33:27.5257656Z ^^^^^^^^^ 2025-09-07T07:33:27.5257843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5257887Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5257925Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5258094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5258140Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5258176Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5258301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5258343Z return handle_torch_function( 2025-09-07T07:33:27.5258381Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5258520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5258594Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5259953Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5260123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5260181Z return func(*args, **kwargs) 2025-09-07T07:33:27.5260217Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5260339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5260382Z result = _engine_run_backward( 2025-09-07T07:33:27.5260419Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5260562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5260682Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5260731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5260857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5260932Z return user_fn(self, *args) 2025-09-07T07:33:27.5260971Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5261112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5261156Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5261193Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5261349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5261391Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5261427Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5261550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5261590Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5261627Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5263218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5263274Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5263316Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5263450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5263499Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5263538Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5263697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5263743Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5263782Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5263937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5263977Z t = dispatch_trace( 2025-09-07T07:33:27.5264015Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5264126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5264169Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5264205Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5264327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5264365Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5264401Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5264558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5264638Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5264679Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5266133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5266205Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5266243Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5266371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5266414Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5266448Z ^^^^^^^^^ 2025-09-07T07:33:27.5266595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5266644Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5266678Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5266720Z File "", line 1, in 2025-09-07T07:33:27.5266861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5266940Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5267025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5267161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5267208Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5267246Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5267434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5267478Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5267513Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5267681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5267725Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5267782Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5269249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5269294Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5269330Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5269463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5269551Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5269598Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5269725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5269785Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5269829Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5269958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5269998Z leaves = list(leaves) 2025-09-07T07:33:27.5270033Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5270156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5270190Z return func(x) 2025-09-07T07:33:27.5270222Z ^^^^^^^ 2025-09-07T07:33:27.5270360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5270424Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5270465Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5270632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5270672Z return func(*args, **kwargs) 2025-09-07T07:33:27.5270710Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5270912Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5272331Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5272334Z 2025-09-07T07:33:27.5272537Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5272540Z 2025-09-07T07:33:27.5272541Z 2025-09-07T07:33:27.5272613Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5272808Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5272810Z 2025-09-07T07:33:27.5272894Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5273003Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5273040Z inline_call [] 2025-09-07T07:33:27.5273179Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5273214Z inductor [] 2025-09-07T07:33:27.5273288Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5273361Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5273615Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5273726Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5273808Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5273958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5274069Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5274201Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5274318Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5274389Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5274424Z inline_call [] 2025-09-07T07:33:27.5274478Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5275889Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5275961Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5276211Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5276327Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5276407Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5276554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5276637Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5276767Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5276883Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5276933Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5277042Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5277116Z Traceback (most recent call last): 2025-09-07T07:33:27.5277265Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5277303Z self._run_test( 2025-09-07T07:33:27.5277413Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5277467Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5277508Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5277638Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5277684Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5277724Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5277872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5279240Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5279326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5279462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5279506Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5279545Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5279686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5279765Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5279804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5279956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5280000Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5280171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5280224Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5280265Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5280405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5280455Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5280495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5280610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5280675Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5280718Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5280843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5280911Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5280954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5282415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5282461Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5282499Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5282635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5282674Z return aot_autograd( 2025-09-07T07:33:27.5282709Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5282843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5282911Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5282956Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5283183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5283292Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5283338Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5283517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5283561Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5283746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5283786Z fx_g = _create_graph( 2025-09-07T07:33:27.5283820Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5283981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5284057Z fx_g = make_fx( 2025-09-07T07:33:27.5284090Z ^^^^^^^^ 2025-09-07T07:33:27.5284240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5285619Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5285659Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5285806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5285849Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5285885Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5286043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5286080Z t = dispatch_trace( 2025-09-07T07:33:27.5286115Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5286258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5286302Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5286338Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5286462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5286501Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5286537Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5286787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5286867Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5286907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5287033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5287072Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5287111Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5287237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5287279Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5288644Z ^^^^^^^^^ 2025-09-07T07:33:27.5288777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5288818Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5288854Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5289001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5289051Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5289084Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5289239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5289306Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5289371Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5289544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5289583Z outs_pair = fn(*args) 2025-09-07T07:33:27.5289618Z ^^^^^^^^^ 2025-09-07T07:33:27.5289786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5289852Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5289896Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5290066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5290105Z outs_pair = fn(*args) 2025-09-07T07:33:27.5290168Z ^^^^^^^^^ 2025-09-07T07:33:27.5290348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5290407Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5290450Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5291962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5292033Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5292079Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5292248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5292306Z outs_pair = fn(*args) 2025-09-07T07:33:27.5292345Z ^^^^^^^^^ 2025-09-07T07:33:27.5292534Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5292578Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5292616Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5292780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5292826Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5292863Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5292986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5293028Z return handle_torch_function( 2025-09-07T07:33:27.5293141Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5293283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5293357Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5293404Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5293568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5293610Z return func(*args, **kwargs) 2025-09-07T07:33:27.5293644Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5295099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5295142Z result = _engine_run_backward( 2025-09-07T07:33:27.5295179Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5295322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5295447Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5295527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5295652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5295692Z return user_fn(self, *args) 2025-09-07T07:33:27.5295729Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5295869Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5295913Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5295950Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5296107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5296150Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5296187Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5296345Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5296387Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5296422Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5296583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5296634Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5296675Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5296808Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5298233Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5298273Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5298441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5298513Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5298553Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5298713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5298751Z t = dispatch_trace( 2025-09-07T07:33:27.5298786Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5298898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5298941Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5298977Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5299101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5299139Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5299175Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5299336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5299420Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5299600Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5301828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5302040Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5302146Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5302344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5302554Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5302666Z ^^^^^^^^^ 2025-09-07T07:33:27.5302881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5303184Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5303339Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5303439Z File "", line 1, in 2025-09-07T07:33:27.5303676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5303944Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5304101Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5304325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5304557Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5304675Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5304939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5305209Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5307634Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5307904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5308158Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5308272Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5308484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5308706Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5308815Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5309013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5309266Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5309439Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5309683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5309913Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5310054Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5310270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5310483Z leaves = list(leaves) 2025-09-07T07:33:27.5310595Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5310787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5317435Z return func(x) 2025-09-07T07:33:27.5317571Z ^^^^^^^ 2025-09-07T07:33:27.5317780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5318039Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5318196Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5318451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5318815Z return func(*args, **kwargs) 2025-09-07T07:33:27.5321542Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5321817Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5322120Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5322243Z 2025-09-07T07:33:27.5322461Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5322703Z 2025-09-07T07:33:27.5322705Z 2025-09-07T07:33:27.5322784Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5323225Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5323511Z 2025-09-07T07:33:27.5323605Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5323810Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5323963Z inline_call [] 2025-09-07T07:33:27.5324074Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5326418Z inductor [] 2025-09-07T07:33:27.5326544Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5326800Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5327168Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5327649Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5327883Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5328156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5328426Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5328677Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5328961Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5329184Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5330894Z inline_call [] 2025-09-07T07:33:27.5331000Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5331194Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5331373Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5331732Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5332125Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5332350Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5332615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5332883Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5333210Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5333499Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5335230Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5335376Z inline_call [] 2025-09-07T07:33:27.5335480Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5335638Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5335813Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5336179Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5336570Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5336797Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5337101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5337368Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5337615Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5339363Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5339741Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-41a59fffa3599b15.xml - 2025-09-07T07:33:27.5340051Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5340545Z FAILED [0.7099s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5341022Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5341141Z 2025-09-07T07:33:27.5341345Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5341581Z 2025-09-07T07:33:27.5341583Z 2025-09-07T07:33:27.5341656Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5341956Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5342182Z 2025-09-07T07:33:27.5342266Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5342445Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5344188Z ================== 1 failed, 37 deselected, 2 rerun in 2.76s =================== 2025-09-07T07:33:27.5344327Z Got exit code 1 2025-09-07T07:33:27.5344418Z Retrying single test... 2025-09-07T07:33:27.5344905Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5345392Z import pkg_resources 2025-09-07T07:33:27.5345621Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-ccef17752494136c.xml 2025-09-07T07:33:27.5345878Z ============================= test session starts ============================== 2025-09-07T07:33:27.5346080Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5346269Z cachedir: .pytest_cache 2025-09-07T07:33:27.5346482Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5346711Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5348275Z configfile: pytest.ini 2025-09-07T07:33:27.5348499Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5348766Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.5349103Z stepcurrent: skipping 37 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5349405Z Running 1 items in this shard 2025-09-07T07:33:27.5349477Z 2025-09-07T07:33:27.5349678Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.0705s] [100%] 2025-09-07T07:33:27.5350129Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.7448s] [100%] 2025-09-07T07:33:27.5350524Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True FAILED [0.6902s] [100%] 2025-09-07T07:33:27.5350728Z 2025-09-07T07:33:27.5350779Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5350981Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5351169Z Traceback (most recent call last): 2025-09-07T07:33:27.5352849Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5353138Z self._run_test( 2025-09-07T07:33:27.5353351Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5353554Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5353683Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5353893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5354108Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5354226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5354448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5354677Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5354795Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5356474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5356718Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5356839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5357054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5357311Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5357465Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5357687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5357920Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5358143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5358380Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5358506Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5360185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5360419Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5360542Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5360731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5360951Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5361093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5361296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5361520Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5361659Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5361877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5362095Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5363794Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5364015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5364231Z return aot_autograd( 2025-09-07T07:33:27.5364330Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5364527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5364772Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5364920Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5365165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5365443Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5365611Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5365919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5366185Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5367972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5368240Z fx_g = _create_graph( 2025-09-07T07:33:27.5368339Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5368562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5368795Z fx_g = make_fx( 2025-09-07T07:33:27.5368881Z ^^^^^^^^ 2025-09-07T07:33:27.5369086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5369347Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5369473Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5369694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5369920Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5371451Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5371686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5371916Z t = dispatch_trace( 2025-09-07T07:33:27.5372011Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5372180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5372369Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5372479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5372673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5372881Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5372984Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5373276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5374968Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5375126Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5375327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5375527Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5375628Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5375817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5376023Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5376132Z ^^^^^^^^^ 2025-09-07T07:33:27.5376331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5376579Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5376686Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5378318Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5378556Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5378674Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5378887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5379140Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5379278Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5379530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5379825Z outs_pair = fn(*args) 2025-09-07T07:33:27.5379924Z ^^^^^^^^^ 2025-09-07T07:33:27.5380152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5380427Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5381988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5382245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5382493Z outs_pair = fn(*args) 2025-09-07T07:33:27.5382588Z ^^^^^^^^^ 2025-09-07T07:33:27.5382822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5383187Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5383331Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5383607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5383910Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5384058Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5384312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5385993Z outs_pair = fn(*args) 2025-09-07T07:33:27.5386095Z ^^^^^^^^^ 2025-09-07T07:33:27.5386342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5386616Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5386735Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5386977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5387230Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5387346Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5387541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5387742Z return handle_torch_function( 2025-09-07T07:33:27.5387849Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5389464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5389717Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5389872Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5390128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5390404Z return func(*args, **kwargs) 2025-09-07T07:33:27.5390510Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5390696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5390895Z result = _engine_run_backward( 2025-09-07T07:33:27.5391003Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5391218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5391521Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5393210Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5393425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5393672Z return user_fn(self, *args) 2025-09-07T07:33:27.5393778Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5393987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5394211Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5394322Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5394548Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5394784Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5394895Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5395089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5396754Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5396857Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5397112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5397368Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5397494Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5397709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5397930Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5398050Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5398283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5398525Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5400941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5401183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5401421Z t = dispatch_trace( 2025-09-07T07:33:27.5401516Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5401686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5401878Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5401988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5402183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5402380Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5402483Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5402706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5404442Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5404603Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5404809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5405043Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5405141Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5405328Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5405531Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5405636Z ^^^^^^^^^ 2025-09-07T07:33:27.5405847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5406079Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5406194Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5407706Z File "", line 1, in 2025-09-07T07:33:27.5407930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5408228Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5408387Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5408605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5408822Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5408939Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5409201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5409469Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5409581Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5409817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5411420Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5411543Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5411759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5411980Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5412088Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5412288Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5412542Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5412709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5412913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5413209Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5413344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5414886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5415095Z leaves = list(leaves) 2025-09-07T07:33:27.5415194Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5415376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5415568Z return func(x) 2025-09-07T07:33:27.5415654Z ^^^^^^^ 2025-09-07T07:33:27.5415842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5416078Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5416215Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5416459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5416703Z return func(*args, **kwargs) 2025-09-07T07:33:27.5418126Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5418414Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5418709Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5418831Z 2025-09-07T07:33:27.5419037Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5419274Z 2025-09-07T07:33:27.5419276Z 2025-09-07T07:33:27.5419349Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5419647Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5419877Z 2025-09-07T07:33:27.5419963Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5420194Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5420343Z inline_call [] 2025-09-07T07:33:27.5420449Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5420571Z inductor [] 2025-09-07T07:33:27.5422036Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5422217Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5422581Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5422979Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5423254Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5423527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5423838Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5424091Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5424375Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5424642Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5424831Z Traceback (most recent call last): 2025-09-07T07:33:27.5426405Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5426625Z self._run_test( 2025-09-07T07:33:27.5426791Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5426991Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5427125Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5427338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5427551Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5427668Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5427888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5428118Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5428234Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5429759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5429975Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5430090Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5430305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5430590Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5430744Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5430970Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5431200Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5431422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5431658Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5431783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5433429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5433662Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5433826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5434019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5434236Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5434378Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5434582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5434807Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5434945Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5435162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5435380Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5436849Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5437092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5437306Z return aot_autograd( 2025-09-07T07:33:27.5437404Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5437597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5437836Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5437983Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5438225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5438502Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5438663Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5438933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5440556Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5440812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5441073Z fx_g = _create_graph( 2025-09-07T07:33:27.5441171Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5441391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5441623Z fx_g = make_fx( 2025-09-07T07:33:27.5441709Z ^^^^^^^^ 2025-09-07T07:33:27.5441909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5442141Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5442258Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5443881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5444136Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5444248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5444474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5444703Z t = dispatch_trace( 2025-09-07T07:33:27.5444797Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5444966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5445154Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5445262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5445454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5445652Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5447150Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5447429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5447705Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5447859Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5448058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5448254Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5448356Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5448544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5448746Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5448852Z ^^^^^^^^^ 2025-09-07T07:33:27.5449043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5450619Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5450734Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5450951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5451184Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5451300Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5451512Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5451760Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5451896Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5452146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5452394Z outs_pair = fn(*args) 2025-09-07T07:33:27.5452492Z ^^^^^^^^^ 2025-09-07T07:33:27.5454263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5454548Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5454694Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5454948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5455194Z outs_pair = fn(*args) 2025-09-07T07:33:27.5455289Z ^^^^^^^^^ 2025-09-07T07:33:27.5455521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5455794Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5455930Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5456212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5456641Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5458156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5458412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5458659Z outs_pair = fn(*args) 2025-09-07T07:33:27.5458755Z ^^^^^^^^^ 2025-09-07T07:33:27.5458999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5459266Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5459379Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5459659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5459913Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5460030Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5460224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5461773Z return handle_torch_function( 2025-09-07T07:33:27.5461883Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5462092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5462339Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5462493Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5462739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5463011Z return func(*args, **kwargs) 2025-09-07T07:33:27.5463193Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5463380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5463581Z result = _engine_run_backward( 2025-09-07T07:33:27.5463688Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5465266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5465570Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5465772Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5465984Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5466185Z return user_fn(self, *args) 2025-09-07T07:33:27.5466291Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5466506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5466727Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5466837Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5467060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5467293Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5468764Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5468966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5469164Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5469268Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5469492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5469752Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5469908Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5470121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5470341Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5470460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5470694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5472296Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5472417Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5472652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5472882Z t = dispatch_trace( 2025-09-07T07:33:27.5472979Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5473263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5473455Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5473566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5473760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5473956Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5474056Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5475649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5475924Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5476078Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5476276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5476519Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5476628Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5476815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5477017Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5477124Z ^^^^^^^^^ 2025-09-07T07:33:27.5477333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5477382Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5477417Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5478817Z File "", line 1, in 2025-09-07T07:33:27.5478965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5479044Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5479092Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5479236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5479284Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5479323Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5479515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5479558Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5479595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5479762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5479807Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5479844Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5479993Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5480063Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5480099Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5480233Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5480321Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5480368Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5480492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5480554Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5480597Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5482050Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5482091Z leaves = list(leaves) 2025-09-07T07:33:27.5482160Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5482283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5482320Z return func(x) 2025-09-07T07:33:27.5482352Z ^^^^^^^ 2025-09-07T07:33:27.5482489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5482553Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5482596Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5482765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5482807Z return func(*args, **kwargs) 2025-09-07T07:33:27.5482843Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5483030Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5483177Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5483180Z 2025-09-07T07:33:27.5483386Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5483388Z 2025-09-07T07:33:27.5483390Z 2025-09-07T07:33:27.5483462Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5483659Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5483662Z 2025-09-07T07:33:27.5483747Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5483821Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5483858Z inline_call [] 2025-09-07T07:33:27.5483920Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5485301Z inductor [] 2025-09-07T07:33:27.5485378Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5485449Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5485706Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5485818Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5485900Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5486053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5486140Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5486313Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5486434Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5486504Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5486539Z inline_call [] 2025-09-07T07:33:27.5486594Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5486667Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5486789Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5487041Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5487197Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5487284Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5487435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5487519Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5487648Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5489101Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5489154Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5489267Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5489312Z Traceback (most recent call last): 2025-09-07T07:33:27.5489497Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5489535Z self._run_test( 2025-09-07T07:33:27.5489647Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5489701Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5489742Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5489875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5489923Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5489963Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5490113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5490160Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5490199Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5490339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5490383Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5490422Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5490561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5490643Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5490681Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5490832Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5492203Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5492357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5492411Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5492483Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5492623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5492676Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5492715Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5492830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5492895Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5492941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5493110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5493174Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5493217Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5493392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5493437Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5493474Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5493612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5493651Z return aot_autograd( 2025-09-07T07:33:27.5493687Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5493824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5493894Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5493940Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5495448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5495555Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5495601Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5495785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5495829Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5496013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5496053Z fx_g = _create_graph( 2025-09-07T07:33:27.5496088Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5496251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5496287Z fx_g = make_fx( 2025-09-07T07:33:27.5496320Z ^^^^^^^^ 2025-09-07T07:33:27.5496476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5496523Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5496562Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5496710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5496752Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5496789Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5496946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5496984Z t = dispatch_trace( 2025-09-07T07:33:27.5497018Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5497131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5498509Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5498568Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5498693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5498733Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5498768Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5498927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5499008Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5499049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5499172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5499210Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5499246Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5499410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5499458Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5499492Z ^^^^^^^^^ 2025-09-07T07:33:27.5499624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5499665Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5499702Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5499849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5499899Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5499932Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5500093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5500155Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5501551Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5501730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5501770Z outs_pair = fn(*args) 2025-09-07T07:33:27.5501805Z ^^^^^^^^^ 2025-09-07T07:33:27.5501978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5502045Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5502090Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5502262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5502301Z outs_pair = fn(*args) 2025-09-07T07:33:27.5502337Z ^^^^^^^^^ 2025-09-07T07:33:27.5502516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5502579Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5502621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5502813Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5502883Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5502929Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5503192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5503231Z outs_pair = fn(*args) 2025-09-07T07:33:27.5503265Z ^^^^^^^^^ 2025-09-07T07:33:27.5503457Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5503528Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5504899Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5505069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5505116Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5505153Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5505278Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5505320Z return handle_torch_function( 2025-09-07T07:33:27.5505357Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5505497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5505613Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5505662Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5505828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5505868Z return func(*args, **kwargs) 2025-09-07T07:33:27.5505904Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5506026Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5506068Z result = _engine_run_backward( 2025-09-07T07:33:27.5506103Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5506248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5506368Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5506439Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5506566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5506607Z return user_fn(self, *args) 2025-09-07T07:33:27.5506644Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5508119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5508164Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5508201Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5508359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5508403Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5508440Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5508570Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5508611Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5508647Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5508810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5508861Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5508901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5509036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5509085Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5509123Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5509284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5509331Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5509400Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5509557Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5509596Z t = dispatch_trace( 2025-09-07T07:33:27.5509630Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5511062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5511106Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5511143Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5511265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5511305Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5511339Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5511498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5511616Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5511658Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5511785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5511823Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5511858Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5511982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5512024Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5512061Z ^^^^^^^^^ 2025-09-07T07:33:27.5512208Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5512257Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5512309Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5512350Z File "", line 1, in 2025-09-07T07:33:27.5512497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5512576Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5512623Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5514170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5514221Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5514259Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5514449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5514492Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5514528Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5514703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5514749Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5514787Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5514929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5514971Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5515011Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5515145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5515232Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5515279Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5515403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5515496Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5515540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5515664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5515703Z leaves = list(leaves) 2025-09-07T07:33:27.5515737Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5515857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5517222Z return func(x) 2025-09-07T07:33:27.5517255Z ^^^^^^^ 2025-09-07T07:33:27.5517392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5517456Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5517498Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5517707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5517753Z return func(*args, **kwargs) 2025-09-07T07:33:27.5517788Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5517970Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5518054Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5518056Z 2025-09-07T07:33:27.5518261Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5518263Z 2025-09-07T07:33:27.5518265Z 2025-09-07T07:33:27.5518338Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5518541Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5518565Z 2025-09-07T07:33:27.5518651Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5518725Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5518760Z inline_call [] 2025-09-07T07:33:27.5518815Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5518849Z inductor [] 2025-09-07T07:33:27.5518923Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5518993Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5519248Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5520686Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5520778Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5520928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5521013Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5521144Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5521263Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5521333Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5521369Z inline_call [] 2025-09-07T07:33:27.5521423Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5521495Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5521570Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5521845Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5521953Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5522036Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5522184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5522267Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5522396Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5522513Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5522613Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5522649Z inline_call [] 2025-09-07T07:33:27.5522702Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5524168Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5524240Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5524491Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5524599Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5524680Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5524831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5524941Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5525069Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5525186Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5525400Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-ccef17752494136c.xml - 2025-09-07T07:33:27.5525458Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5525824Z FAILED [0.6902s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5525913Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5525915Z 2025-09-07T07:33:27.5526118Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5526121Z 2025-09-07T07:33:27.5526122Z 2025-09-07T07:33:27.5526193Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5526386Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5526389Z 2025-09-07T07:33:27.5526473Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5526532Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5526599Z ================== 1 failed, 220 deselected, 2 rerun in 2.67s ================== 2025-09-07T07:33:27.5526655Z Got exit code 1 2025-09-07T07:33:27.5526746Z Retrying single test... 2025-09-07T07:33:27.5527166Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5528550Z import pkg_resources 2025-09-07T07:33:27.5528719Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-0ab937ba44569cc4.xml 2025-09-07T07:33:27.5528776Z ============================= test session starts ============================== 2025-09-07T07:33:27.5528889Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5528929Z cachedir: .pytest_cache 2025-09-07T07:33:27.5529127Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5529177Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5529216Z configfile: pytest.ini 2025-09-07T07:33:27.5529378Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5529454Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.5529686Z stepcurrent: skipping 37 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5529728Z Running 1 items in this shard 2025-09-07T07:33:27.5529731Z 2025-09-07T07:33:27.5529926Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.0290s] [100%] 2025-09-07T07:33:27.5530137Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.6835s] [100%] 2025-09-07T07:33:27.5530306Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True FAILED [0.6901s] [100%] 2025-09-07T07:33:27.5530308Z 2025-09-07T07:33:27.5530357Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5530470Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5530512Z Traceback (most recent call last): 2025-09-07T07:33:27.5530666Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5530701Z self._run_test( 2025-09-07T07:33:27.5530814Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5532201Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5532251Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5532386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5532432Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5532472Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5532624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5532670Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5532709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5532844Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5532889Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5532926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5533124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5533233Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5533271Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5533424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5533469Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5533618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5533671Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5533712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5533853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5533907Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5533983Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5535446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5535512Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5535557Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5535682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5535746Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5535787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5535926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5535971Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5536032Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5536176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5536219Z return aot_autograd( 2025-09-07T07:33:27.5536253Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5536389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5536458Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5536504Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5536662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5536746Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5536791Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5536978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5537022Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5537206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5538586Z fx_g = _create_graph( 2025-09-07T07:33:27.5538624Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5538786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5538821Z fx_g = make_fx( 2025-09-07T07:33:27.5538854Z ^^^^^^^^ 2025-09-07T07:33:27.5539003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5539049Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5539089Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5539257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5539300Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5539338Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5539495Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5539534Z t = dispatch_trace( 2025-09-07T07:33:27.5539568Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5539680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5539722Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5539760Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5539884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5539927Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5539992Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5540157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5540235Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5541613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5541739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5541779Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5541814Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5541940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5541982Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5542017Z ^^^^^^^^^ 2025-09-07T07:33:27.5542147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5542221Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5542256Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5542403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5542453Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5542487Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5542644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5542705Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5542752Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5542927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5542968Z outs_pair = fn(*args) 2025-09-07T07:33:27.5543003Z ^^^^^^^^^ 2025-09-07T07:33:27.5543225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5543291Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5544667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5544841Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5544880Z outs_pair = fn(*args) 2025-09-07T07:33:27.5544914Z ^^^^^^^^^ 2025-09-07T07:33:27.5545090Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5545150Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5545193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5545390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5545489Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5545535Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5545706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5545744Z outs_pair = fn(*args) 2025-09-07T07:33:27.5545779Z ^^^^^^^^^ 2025-09-07T07:33:27.5545966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5546012Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5546048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5546252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5546300Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5546337Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5546462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5546504Z return handle_torch_function( 2025-09-07T07:33:27.5546542Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5548013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5548089Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5548135Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5548301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5548374Z return func(*args, **kwargs) 2025-09-07T07:33:27.5548410Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5548533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5548576Z result = _engine_run_backward( 2025-09-07T07:33:27.5548612Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5548757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5548875Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5548926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5549051Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5549093Z return user_fn(self, *args) 2025-09-07T07:33:27.5549129Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5549280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5549323Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5549360Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5549516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5549560Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5549596Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5551039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5551080Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5551118Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5551281Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5551355Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5551395Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5551531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5551580Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5551619Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5551779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5551826Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5551865Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5552022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5552062Z t = dispatch_trace( 2025-09-07T07:33:27.5552096Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5552237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5552281Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5552318Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5552440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5552479Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5552514Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5552673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5554146Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5554189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5554314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5554389Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5554424Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5554551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5554592Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5554627Z ^^^^^^^^^ 2025-09-07T07:33:27.5554776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5554826Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5554859Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5554901Z File "", line 1, in 2025-09-07T07:33:27.5555045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5555124Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5555173Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5555310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5555359Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5555396Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5555586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5555629Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5555666Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5555834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5557209Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5557246Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5557393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5557461Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5557497Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5557632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5557721Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5557767Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5557893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5557953Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5557997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5558121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5558201Z leaves = list(leaves) 2025-09-07T07:33:27.5558236Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5558357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5558392Z return func(x) 2025-09-07T07:33:27.5558425Z ^^^^^^^ 2025-09-07T07:33:27.5558560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5558625Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5558667Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5558832Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5560195Z return func(*args, **kwargs) 2025-09-07T07:33:27.5560233Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5560634Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5560722Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5560725Z 2025-09-07T07:33:27.5560928Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5560931Z 2025-09-07T07:33:27.5560933Z 2025-09-07T07:33:27.5561006Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5561199Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5561202Z 2025-09-07T07:33:27.5561287Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5561361Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5561398Z inline_call [] 2025-09-07T07:33:27.5561457Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5561492Z inductor [] 2025-09-07T07:33:27.5561566Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5561639Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5561893Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5562002Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5562085Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5562234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5562322Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5562473Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5562593Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5564124Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5564171Z Traceback (most recent call last): 2025-09-07T07:33:27.5564322Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5564358Z self._run_test( 2025-09-07T07:33:27.5564469Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5564526Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5564566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5564749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5564799Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5564839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5564992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5565039Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5565077Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5565211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5565255Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5565293Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5565433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5565535Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5565573Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5565724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5565768Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5565917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5567350Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5567393Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5567534Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5567585Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5567624Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5567747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5567813Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5567858Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5567983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5568046Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5568088Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5568227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5568272Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5568309Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5568446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5568492Z return aot_autograd( 2025-09-07T07:33:27.5568573Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5568707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5568777Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5568822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5568982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5569067Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5570438Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5570624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5570668Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5570890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5570931Z fx_g = _create_graph( 2025-09-07T07:33:27.5570966Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5571129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5571163Z fx_g = make_fx( 2025-09-07T07:33:27.5571196Z ^^^^^^^^ 2025-09-07T07:33:27.5571347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5571393Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5571431Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5571578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5571641Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5571678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5571840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5571878Z t = dispatch_trace( 2025-09-07T07:33:27.5571913Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5572024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5572066Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5572101Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5573592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5573634Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5573671Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5573837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5573921Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5573961Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5574086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5574124Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5574159Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5574283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5574325Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5574359Z ^^^^^^^^^ 2025-09-07T07:33:27.5574491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5574530Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5574566Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5574747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5574797Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5574831Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5574987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5575048Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5575094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5575272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5576642Z outs_pair = fn(*args) 2025-09-07T07:33:27.5576678Z ^^^^^^^^^ 2025-09-07T07:33:27.5576893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5576962Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5577006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5577179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5577216Z outs_pair = fn(*args) 2025-09-07T07:33:27.5577251Z ^^^^^^^^^ 2025-09-07T07:33:27.5577425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5577484Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5577527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5577719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5577815Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5577862Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5578032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5578071Z outs_pair = fn(*args) 2025-09-07T07:33:27.5578104Z ^^^^^^^^^ 2025-09-07T07:33:27.5578293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5578338Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5578375Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5578542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5579923Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5579968Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5580096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5580137Z return handle_torch_function( 2025-09-07T07:33:27.5580175Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5580314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5580390Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5580435Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5580603Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5580643Z return func(*args, **kwargs) 2025-09-07T07:33:27.5580680Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5580805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5580866Z result = _engine_run_backward( 2025-09-07T07:33:27.5580902Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5581046Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5581165Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5581214Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5581340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5581381Z return user_fn(self, *args) 2025-09-07T07:33:27.5581417Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5581591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5581641Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5582996Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5583237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5583281Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5583318Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5583440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5583480Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5583516Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5583678Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5583729Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5583795Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5583936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5583987Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5584025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5584185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5584232Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5584271Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5584428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5584466Z t = dispatch_trace( 2025-09-07T07:33:27.5584500Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5584611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5584661Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5586035Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5586160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5586199Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5586234Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5586392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5586470Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5586511Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5586636Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5586674Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5586710Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5586837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5586905Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5586940Z ^^^^^^^^^ 2025-09-07T07:33:27.5587087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5587135Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5587170Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5587211Z File "", line 1, in 2025-09-07T07:33:27.5587355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5587432Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5587479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5587659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5587710Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5589076Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5589269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5589312Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5589350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5589519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5589563Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5589599Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5589742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5589803Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5589846Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5589981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5590068Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5590115Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5590240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5590300Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5590344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5590470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5590508Z leaves = list(leaves) 2025-09-07T07:33:27.5590544Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5590668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5590706Z return func(x) 2025-09-07T07:33:27.5590739Z ^^^^^^^ 2025-09-07T07:33:27.5592196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5592261Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5592304Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5592469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5592511Z return func(*args, **kwargs) 2025-09-07T07:33:27.5592547Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5592726Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5592814Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5592840Z 2025-09-07T07:33:27.5593045Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5593047Z 2025-09-07T07:33:27.5593049Z 2025-09-07T07:33:27.5593182Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5593383Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5593385Z 2025-09-07T07:33:27.5593470Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5593544Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5593579Z inline_call [] 2025-09-07T07:33:27.5593633Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5593669Z inductor [] 2025-09-07T07:33:27.5593783Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5593855Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5594111Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5594222Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5594305Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5595785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5595873Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5596029Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5596151Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5596221Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5596257Z inline_call [] 2025-09-07T07:33:27.5596310Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5596383Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5596452Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5596710Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5596820Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5596907Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5597061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5597148Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5597276Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5597393Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5597443Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5597555Z _ WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.5597600Z Traceback (most recent call last): 2025-09-07T07:33:27.5597749Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1230, in test_while_loop_simple_control_flow 2025-09-07T07:33:27.5597807Z self._run_test( 2025-09-07T07:33:27.5597919Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5599317Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5599358Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5599489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5599535Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5599575Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5599724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5599770Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5599808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5599943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5600024Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5600063Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5600203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5600283Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5600322Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5600480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5600525Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5600674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5600727Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5600785Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5600931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5600984Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5602348Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5602469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5602534Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5602578Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5602703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5602766Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5602809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5602956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5603001Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5603038Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5603230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5603269Z return aot_autograd( 2025-09-07T07:33:27.5603305Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5603439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5603511Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5603556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5603716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5603803Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5603871Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5604057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5604100Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5604284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5605667Z fx_g = _create_graph( 2025-09-07T07:33:27.5605702Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5605865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5605899Z fx_g = make_fx( 2025-09-07T07:33:27.5605933Z ^^^^^^^^ 2025-09-07T07:33:27.5606123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5606173Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5606211Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5606358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5606399Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5606436Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5606598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5606636Z t = dispatch_trace( 2025-09-07T07:33:27.5606670Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5606827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5606870Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5606923Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5607055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5607095Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5607132Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5607291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5608702Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5608745Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5608872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5608911Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5608946Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5609071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5609115Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5609155Z ^^^^^^^^^ 2025-09-07T07:33:27.5609289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5609330Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5609366Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5609513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5609564Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5609597Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5609754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5609815Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5609860Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5610038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5610102Z outs_pair = fn(*args) 2025-09-07T07:33:27.5610137Z ^^^^^^^^^ 2025-09-07T07:33:27.5610306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5610372Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5611741Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5611914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5611952Z outs_pair = fn(*args) 2025-09-07T07:33:27.5611987Z ^^^^^^^^^ 2025-09-07T07:33:27.5612167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5612263Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5612306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5612499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5612570Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5612615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5612787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5612825Z outs_pair = fn(*args) 2025-09-07T07:33:27.5612859Z ^^^^^^^^^ 2025-09-07T07:33:27.5613048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5613153Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5613191Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5613357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5613403Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5613440Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5613565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5613607Z return handle_torch_function( 2025-09-07T07:33:27.5614981Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5615123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5615198Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5615252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5615419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5615460Z return func(*args, **kwargs) 2025-09-07T07:33:27.5615496Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5615619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5615661Z result = _engine_run_backward( 2025-09-07T07:33:27.5615696Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5615841Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5615960Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5616009Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5616168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5616209Z return user_fn(self, *args) 2025-09-07T07:33:27.5616245Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5616386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5616430Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5616466Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5616621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5616664Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5616701Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5618141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5618184Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5618268Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5618433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5618483Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5618525Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5618661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5618710Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5618748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5618910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5618957Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5619018Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5619175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5619216Z t = dispatch_trace( 2025-09-07T07:33:27.5619250Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5619364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5619406Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5619442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5619565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5619603Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5619639Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5619799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5621204Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5621253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5621380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5621418Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5621454Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5621578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5621620Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5621654Z ^^^^^^^^^ 2025-09-07T07:33:27.5621802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5621851Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5621885Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5621927Z File "", line 1, in 2025-09-07T07:33:27.5622077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5622176Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5622222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5622358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5622406Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5622443Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5622633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5622676Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5622711Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5624252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5624347Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5624385Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5624528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5624571Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5624606Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5624740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5624827Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5624874Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5624998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5625079Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5625127Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5625253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5625291Z leaves = list(leaves) 2025-09-07T07:33:27.5625326Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5625447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5625482Z return func(x) 2025-09-07T07:33:27.5625514Z ^^^^^^^ 2025-09-07T07:33:27.5625653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5625716Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5625758Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5625921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5627302Z return func(*args, **kwargs) 2025-09-07T07:33:27.5627339Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5627519Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5627603Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5627606Z 2025-09-07T07:33:27.5627810Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5627812Z 2025-09-07T07:33:27.5627814Z 2025-09-07T07:33:27.5627887Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5628083Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5628087Z 2025-09-07T07:33:27.5628196Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5628274Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5628309Z inline_call [] 2025-09-07T07:33:27.5628364Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5628398Z inductor [] 2025-09-07T07:33:27.5628472Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5628543Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5628799Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5628909Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5628992Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5629173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5629259Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5629389Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5629507Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5630900Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5630938Z inline_call [] 2025-09-07T07:33:27.5630991Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5631064Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5631133Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5631418Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5631530Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5631612Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5631760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5631844Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5631973Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5632091Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5632162Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5632200Z inline_call [] 2025-09-07T07:33:27.5632254Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-09-07T07:33:27.5632324Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5632394Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5632654Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5632763Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 781, in forward 2025-09-07T07:33:27.5632843Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [ci, a, b]) 2025-09-07T07:33:27.5632991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5633129Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5634632Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5634749Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5634966Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-0ab937ba44569cc4.xml - 2025-09-07T07:33:27.5635024Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5635390Z FAILED [0.6901s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5635474Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5635479Z 2025-09-07T07:33:27.5635723Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5635725Z 2025-09-07T07:33:27.5635727Z 2025-09-07T07:33:27.5635799Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5635992Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.5635994Z 2025-09-07T07:33:27.5636078Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5636140Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5636206Z ================== 1 failed, 220 deselected, 2 rerun in 2.67s ================== 2025-09-07T07:33:27.5636241Z Got exit code 1 2025-09-07T07:33:27.5636384Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.5636805Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5636845Z import pkg_resources 2025-09-07T07:33:27.5637012Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-2337f75162fb7c2f.xml 2025-09-07T07:33:27.5637067Z ============================= test session starts ============================== 2025-09-07T07:33:27.5637178Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5637218Z cachedir: .pytest_cache 2025-09-07T07:33:27.5637375Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5638756Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5638796Z configfile: pytest.ini 2025-09-07T07:33:27.5638956Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5639030Z collecting ... collected 467 items / 38 deselected / 429 selected 2025-09-07T07:33:27.5639081Z stepcurrent: skipping 38 already run items. 2025-09-07T07:33:27.5639124Z Running 183 items in this shard 2025-09-07T07:33:27.5639126Z 2025-09-07T07:33:27.5639289Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_stack_output_simple_device_cpu_dynamic_False PASSED [1.3272s] [ 0%] 2025-09-07T07:33:27.5639561Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_conv_device_cuda_dynamic_False_autograd_False [W907 07:24:13.321564247 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.5639699Z [W907 07:24:13.378969539 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.5639801Z [W907 07:24:13.494217279 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.5639901Z [W907 07:24:14.071905540 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.5639998Z [W907 07:24:14.081480005 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.5640095Z [W907 07:24:14.127942972 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.5640190Z [W907 07:24:14.128587623 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.5640229Z PASSED [0.8565s] [ 1%] 2025-09-07T07:33:27.5640410Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cpu_dynamic_True_autograd_True PASSED [1.8830s] [ 1%] 2025-09-07T07:33:27.5640622Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cuda_dynamic_False_autograd_False PASSED [0.8852s] [ 2%] 2025-09-07T07:33:27.5640801Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cuda_dynamic_False_autograd_True PASSED [0.8520s] [ 2%] 2025-09-07T07:33:27.5640976Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_device_cuda_dynamic_True_autograd_True PASSED [1.7615s] [ 3%] 2025-09-07T07:33:27.5641133Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_mismatch_dynamic_False PASSED [0.0516s] [ 3%] 2025-09-07T07:33:27.5641289Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_in_out_mismatch_dynamic_True PASSED [0.0528s] [ 4%] 2025-09-07T07:33:27.5642788Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_ops_device_cpu_dynamic_False_autograd_True PASSED [0.6447s] [ 4%] 2025-09-07T07:33:27.5642991Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_ops_device_cuda_dynamic_False_autograd_True PASSED [0.8002s] [ 5%] 2025-09-07T07:33:27.5643214Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_data_dependent_ops_device_cuda_dynamic_True_autograd_False PASSED [1.6684s] [ 6%] 2025-09-07T07:33:27.5643391Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_False PASSED [0.7382s] [ 6%] 2025-09-07T07:33:27.5643585Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2702s] [ 7%] 2025-09-07T07:33:27.5643778Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2441s] [ 7%] 2025-09-07T07:33:27.5643946Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True FAILED [0.2353s] [ 7%] 2025-09-07T07:33:27.5643952Z 2025-09-07T07:33:27.5644004Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5644115Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5644161Z Traceback (most recent call last): 2025-09-07T07:33:27.5644313Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5644350Z self._run_test( 2025-09-07T07:33:27.5644462Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5644519Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5644560Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5644696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5644771Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5644811Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5644963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5645009Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5645047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5646522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5646567Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5646606Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5646977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5647059Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5647147Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5647304Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5647352Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5647501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5647554Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5647595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5647735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5647786Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5647826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5647942Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5648033Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5648078Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5648207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5648270Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5648313Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5648450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5648497Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5649879Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5650020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5650061Z return aot_autograd( 2025-09-07T07:33:27.5650101Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5650244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5650314Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5650360Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5650520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5650603Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5650649Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5650830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5650874Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5651064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5651123Z fx_g = _create_graph( 2025-09-07T07:33:27.5651158Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5651321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5651355Z fx_g = make_fx( 2025-09-07T07:33:27.5651387Z ^^^^^^^^ 2025-09-07T07:33:27.5651539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5651586Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5651624Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5653137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5653183Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5653221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5653426Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5653464Z t = dispatch_trace( 2025-09-07T07:33:27.5653499Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5653613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5653655Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5653691Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5653819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5653859Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5653895Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5654056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5654166Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5654208Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5654333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5654371Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5654406Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5654531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5654574Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5654608Z ^^^^^^^^^ 2025-09-07T07:33:27.5654741Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5656112Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5656149Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5656301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5656355Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5656389Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5656544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5656606Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5656650Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5656824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5656863Z outs_pair = fn(*args) 2025-09-07T07:33:27.5656898Z ^^^^^^^^^ 2025-09-07T07:33:27.5657068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5657136Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5657204Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5657379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5657417Z outs_pair = fn(*args) 2025-09-07T07:33:27.5657452Z ^^^^^^^^^ 2025-09-07T07:33:27.5657628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5657688Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5657730Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5657923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5657994Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5659413Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5659586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5659625Z outs_pair = fn(*args) 2025-09-07T07:33:27.5659659Z ^^^^^^^^^ 2025-09-07T07:33:27.5659847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5659892Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5659929Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5660095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5660142Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5660194Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5660326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5660368Z return handle_torch_function( 2025-09-07T07:33:27.5660405Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5660545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5660623Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5660669Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5660835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5660879Z return func(*args, **kwargs) 2025-09-07T07:33:27.5660914Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5661037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5661084Z result = _engine_run_backward( 2025-09-07T07:33:27.5662441Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5662591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5662711Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5662760Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5662889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5662930Z return user_fn(self, *args) 2025-09-07T07:33:27.5662966Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5663173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5663220Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5663284Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5663441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5663485Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5663521Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5663644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5663684Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5663719Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5663882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5663933Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5663973Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5664140Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5664191Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5664230Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5665723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5665773Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5665812Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5665968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5666007Z t = dispatch_trace( 2025-09-07T07:33:27.5666041Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5666155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5666218Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5666258Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5666385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5666424Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5666460Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5666619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5666699Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5666739Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5666862Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5666900Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5666935Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5667060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5667110Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5667144Z ^^^^^^^^^ 2025-09-07T07:33:27.5668613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5668664Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5668699Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5668740Z File "", line 1, in 2025-09-07T07:33:27.5668883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5668961Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5669007Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5669142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5669191Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5669249Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5669439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5669483Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5669518Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5669687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5669731Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5669768Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5669910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5669953Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5669991Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5670151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5670242Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5670288Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5671736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5671799Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5671843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5671974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5672013Z leaves = list(leaves) 2025-09-07T07:33:27.5672047Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5672169Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5672234Z return func(x) 2025-09-07T07:33:27.5672267Z ^^^^^^^ 2025-09-07T07:33:27.5672404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5672468Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5672510Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5672678Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5672720Z return func(*args, **kwargs) 2025-09-07T07:33:27.5672755Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5672937Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5673024Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5673027Z 2025-09-07T07:33:27.5673316Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5673321Z 2025-09-07T07:33:27.5673322Z 2025-09-07T07:33:27.5673394Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5673590Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5673592Z 2025-09-07T07:33:27.5673678Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5675075Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5675111Z inline_call [] 2025-09-07T07:33:27.5675169Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5675243Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5675319Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5675605Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5675718Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5675799Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5675949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5676033Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5676168Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5676287Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5676440Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5676485Z Traceback (most recent call last): 2025-09-07T07:33:27.5676633Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5676668Z self._run_test( 2025-09-07T07:33:27.5676779Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5676835Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5676875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5677007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5677053Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5677093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5678592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5678643Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5678681Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5678817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5678862Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5678901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5679046Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5679127Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5679165Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5679316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5679369Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5679519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5679572Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5679613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5679752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5679804Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5679842Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5679958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5680023Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5680067Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5680198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5681604Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5681648Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5681787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5681831Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5681868Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5682006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5682045Z return aot_autograd( 2025-09-07T07:33:27.5682080Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5682214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5682316Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5682365Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5682526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5682608Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5682653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5682834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5682878Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5683061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5683182Z fx_g = _create_graph( 2025-09-07T07:33:27.5683217Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5683383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5683417Z fx_g = make_fx( 2025-09-07T07:33:27.5683450Z ^^^^^^^^ 2025-09-07T07:33:27.5684933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5684982Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5685020Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5685165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5685207Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5685244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5685402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5685447Z t = dispatch_trace( 2025-09-07T07:33:27.5685482Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5685595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5685636Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5685672Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5685799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5685838Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5685875Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5686035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5686114Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5686155Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5686285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5686347Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5686382Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5686507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5687948Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5687983Z ^^^^^^^^^ 2025-09-07T07:33:27.5688115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5688155Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5688191Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5688337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5688387Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5688422Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5688621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5688685Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5688730Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5688902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5688942Z outs_pair = fn(*args) 2025-09-07T07:33:27.5688976Z ^^^^^^^^^ 2025-09-07T07:33:27.5689149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5689214Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5689261Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5689452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5689492Z outs_pair = fn(*args) 2025-09-07T07:33:27.5689526Z ^^^^^^^^^ 2025-09-07T07:33:27.5689699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5691089Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5691134Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5691329Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5691399Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5691445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5691620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5691661Z outs_pair = fn(*args) 2025-09-07T07:33:27.5691694Z ^^^^^^^^^ 2025-09-07T07:33:27.5691883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5691928Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5691966Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5692133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5692181Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5692218Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5692343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5692386Z return handle_torch_function( 2025-09-07T07:33:27.5692450Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5692590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5692665Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5692710Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5692877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5692917Z return func(*args, **kwargs) 2025-09-07T07:33:27.5694345Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5694469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5694513Z result = _engine_run_backward( 2025-09-07T07:33:27.5694548Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5694737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5694859Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5694912Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5695038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5695079Z return user_fn(self, *args) 2025-09-07T07:33:27.5695115Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5695258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5695301Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5695338Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5695496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5695559Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5695596Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5695718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5695758Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5695793Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5695955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5696007Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5697371Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5697509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5697559Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5697606Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5697767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5697814Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5697854Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5698009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5698048Z t = dispatch_trace( 2025-09-07T07:33:27.5698082Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5698195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5698236Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5698273Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5698396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5698468Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5698503Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5698661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5698740Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5698781Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5698904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5698942Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5698977Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5700419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5700463Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5700497Z ^^^^^^^^^ 2025-09-07T07:33:27.5700685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5700737Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5700772Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5700813Z File "", line 1, in 2025-09-07T07:33:27.5700957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5701035Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5701082Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5701216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5701264Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5701302Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5701509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5701554Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5701591Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5701758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5701803Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5701839Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5701981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5702023Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5703441Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5703577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5703673Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5703721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5703846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5703906Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5703950Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5704075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5704113Z leaves = list(leaves) 2025-09-07T07:33:27.5704148Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5704269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5704305Z return func(x) 2025-09-07T07:33:27.5704337Z ^^^^^^^ 2025-09-07T07:33:27.5704479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5704570Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5704612Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5704777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5704819Z return func(*args, **kwargs) 2025-09-07T07:33:27.5704854Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5705034Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5705121Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5705124Z 2025-09-07T07:33:27.5705327Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5705333Z 2025-09-07T07:33:27.5705373Z 2025-09-07T07:33:27.5706785Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5706983Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5706986Z 2025-09-07T07:33:27.5707071Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5707145Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5707180Z inline_call [] 2025-09-07T07:33:27.5707238Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5707311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5707383Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5707646Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5707781Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5707861Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5708011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5708094Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5708229Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5708350Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5708421Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5708458Z inline_call [] 2025-09-07T07:33:27.5708517Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5708588Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5708658Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5708909Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5710346Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5710427Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5710576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5710658Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5710791Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5710930Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5710981Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5711092Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5711137Z Traceback (most recent call last): 2025-09-07T07:33:27.5711284Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5711319Z self._run_test( 2025-09-07T07:33:27.5711431Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5711485Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5711528Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5711702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5711749Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5711788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5711936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5711982Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5712021Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5712155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5712200Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5713610Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5713754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5713871Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5713910Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5714060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5714107Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5714255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5714309Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5714349Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5714493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5714544Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5714583Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5714702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5714771Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5714814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5714940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5715002Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5715044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5715181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5715226Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5715262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5716725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5716797Z return aot_autograd( 2025-09-07T07:33:27.5716833Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5716969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5717038Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5717084Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5717242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5717324Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5717370Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5717549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5717631Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5717818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5717857Z fx_g = _create_graph( 2025-09-07T07:33:27.5717893Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5718054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5718089Z fx_g = make_fx( 2025-09-07T07:33:27.5718122Z ^^^^^^^^ 2025-09-07T07:33:27.5718272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5718318Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5718357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5718501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5718571Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5719926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5720086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5720123Z t = dispatch_trace( 2025-09-07T07:33:27.5720158Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5720269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5720312Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5720347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5720471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5720511Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5720547Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5720714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5720797Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5720838Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5720961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5721000Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5721035Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5721163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5721204Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5721239Z ^^^^^^^^^ 2025-09-07T07:33:27.5721372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5721414Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5721449Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5722940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5722990Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5723025Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5723237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5723300Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5723343Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5723521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5723560Z outs_pair = fn(*args) 2025-09-07T07:33:27.5723595Z ^^^^^^^^^ 2025-09-07T07:33:27.5723806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5723876Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5723920Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5724091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5724129Z outs_pair = fn(*args) 2025-09-07T07:33:27.5724164Z ^^^^^^^^^ 2025-09-07T07:33:27.5724337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5724397Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5724439Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5724636Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5724723Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5724769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5726275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5726316Z outs_pair = fn(*args) 2025-09-07T07:33:27.5726350Z ^^^^^^^^^ 2025-09-07T07:33:27.5726539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5726584Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5726621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5726839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5726895Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5726932Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5727056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5727100Z return handle_torch_function( 2025-09-07T07:33:27.5727136Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5727276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5727350Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5727396Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5727561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5728496Z return func(*args, **kwargs) 2025-09-07T07:33:27.5728537Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5728690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5728732Z result = _engine_run_backward( 2025-09-07T07:33:27.5730452Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5730606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5730733Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5730785Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5730913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5730954Z return user_fn(self, *args) 2025-09-07T07:33:27.5730992Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5731167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5731214Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5731252Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5731408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5731452Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5731488Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5731611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5731651Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5731687Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5731850Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5731918Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5731960Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5732097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5732146Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5733847Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5734013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5734067Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5734106Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5734263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5734301Z t = dispatch_trace( 2025-09-07T07:33:27.5734337Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5734454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5734503Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5734538Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5734662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5734702Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5734736Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5734895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5734974Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5735017Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5735139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5735178Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5735274Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5735418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5735459Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5735495Z ^^^^^^^^^ 2025-09-07T07:33:27.5735642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5735695Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5735731Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5735776Z File "", line 1, in 2025-09-07T07:33:27.5735919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5736000Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5736048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5736211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5736262Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5736301Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5736500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5736544Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5737970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5738145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5738193Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5738229Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5738375Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5738443Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5738485Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5738618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5738709Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5738756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5738880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5738941Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5738984Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5739109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5739149Z leaves = list(leaves) 2025-09-07T07:33:27.5739184Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5739309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5739344Z return func(x) 2025-09-07T07:33:27.5739380Z ^^^^^^^ 2025-09-07T07:33:27.5739516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5739581Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5739622Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5741092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5741135Z return func(*args, **kwargs) 2025-09-07T07:33:27.5741171Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5741376Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5741465Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5741483Z 2025-09-07T07:33:27.5741688Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5741691Z 2025-09-07T07:33:27.5741692Z 2025-09-07T07:33:27.5741766Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5741963Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5741965Z 2025-09-07T07:33:27.5742052Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5742126Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5742162Z inline_call [] 2025-09-07T07:33:27.5742222Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5742318Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5742390Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5742648Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5742760Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5742841Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5742991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5743179Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5743337Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5743462Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5744861Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5744899Z inline_call [] 2025-09-07T07:33:27.5744956Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5745031Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5745100Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5745356Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5745465Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5745551Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5745705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5745789Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5745918Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5746034Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5746104Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5746138Z inline_call [] 2025-09-07T07:33:27.5746194Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5746264Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5746359Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5746612Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5747112Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5747193Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5747344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5747427Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5748869Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5748986Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5749227Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-2337f75162fb7c2f.xml - 2025-09-07T07:33:27.5749287Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5749650Z FAILED [0.2353s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5749734Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5749737Z 2025-09-07T07:33:27.5749940Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5749943Z 2025-09-07T07:33:27.5749944Z 2025-09-07T07:33:27.5750036Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5750234Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5750236Z 2025-09-07T07:33:27.5750321Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5750380Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5750450Z ============ 1 failed, 12 passed, 38 deselected, 2 rerun in 12.46s ============= 2025-09-07T07:33:27.5750484Z Got exit code 1 2025-09-07T07:33:27.5750524Z Retrying single test... 2025-09-07T07:33:27.5750950Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5750991Z import pkg_resources 2025-09-07T07:33:27.5751162Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-676021e9b7ec0e57.xml 2025-09-07T07:33:27.5751218Z ============================= test session starts ============================== 2025-09-07T07:33:27.5751330Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5751370Z cachedir: .pytest_cache 2025-09-07T07:33:27.5751525Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5752871Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5752910Z configfile: pytest.ini 2025-09-07T07:33:27.5753127Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5753229Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.5753479Z stepcurrent: skipping 50 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5753522Z Running 1 items in this shard 2025-09-07T07:33:27.5753524Z 2025-09-07T07:33:27.5753720Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.3867s] [100%] 2025-09-07T07:33:27.5753912Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2222s] [100%] 2025-09-07T07:33:27.5754078Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True FAILED [0.2228s] [100%] 2025-09-07T07:33:27.5754081Z 2025-09-07T07:33:27.5754131Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5754263Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5754311Z Traceback (most recent call last): 2025-09-07T07:33:27.5754462Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5754497Z self._run_test( 2025-09-07T07:33:27.5754613Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5754668Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5754710Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5754845Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5754892Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5754931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5755107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5756465Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5756506Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5756642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5756687Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5756725Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5756869Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5756951Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5756990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5757143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5757191Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5757346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5757400Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5757441Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5757582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5757635Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5757673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5757790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5757857Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5757902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5758049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5758127Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5758168Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5759608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5759654Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5759693Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5759830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5759870Z return aot_autograd( 2025-09-07T07:33:27.5759904Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5760044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5760116Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5760188Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5760349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5760433Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5760479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5760660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5760704Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5760889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5760929Z fx_g = _create_graph( 2025-09-07T07:33:27.5760985Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5761148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5761184Z fx_g = make_fx( 2025-09-07T07:33:27.5761218Z ^^^^^^^^ 2025-09-07T07:33:27.5761369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5762704Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5762743Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5762890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5762933Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5762970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5763193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5763233Z t = dispatch_trace( 2025-09-07T07:33:27.5763272Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5763385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5763426Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5763464Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5763588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5763629Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5763665Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5763825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5763904Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5763946Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5764097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5764164Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5764200Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5764325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5764367Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5765710Z ^^^^^^^^^ 2025-09-07T07:33:27.5765845Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5765885Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5765921Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5766071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5766122Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5766156Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5766335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5766400Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5766445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5766617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5766658Z outs_pair = fn(*args) 2025-09-07T07:33:27.5766753Z ^^^^^^^^^ 2025-09-07T07:33:27.5766923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5766989Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5767036Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5767215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5767276Z outs_pair = fn(*args) 2025-09-07T07:33:27.5767309Z ^^^^^^^^^ 2025-09-07T07:33:27.5767485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5767545Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5768896Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5769093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5769164Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5769209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5769385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5769428Z outs_pair = fn(*args) 2025-09-07T07:33:27.5769463Z ^^^^^^^^^ 2025-09-07T07:33:27.5769651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5769695Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5769733Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5769903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5769950Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5769986Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5770111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5770170Z return handle_torch_function( 2025-09-07T07:33:27.5770209Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5770361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5770437Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5770482Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5770648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5770689Z return func(*args, **kwargs) 2025-09-07T07:33:27.5770725Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5772140Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5772184Z result = _engine_run_backward( 2025-09-07T07:33:27.5772220Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5772382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5772506Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5772557Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5772684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5772726Z return user_fn(self, *args) 2025-09-07T07:33:27.5772762Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5772906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5772949Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5772987Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5773209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5773278Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5773314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5773434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5773475Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5773512Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5773675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5773726Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5773767Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5773902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5775266Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5775308Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5775470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5775518Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5775557Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5775714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5775753Z t = dispatch_trace( 2025-09-07T07:33:27.5775788Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5775901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5775943Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5775980Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5776105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5776169Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5776224Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5776384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5776463Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5776504Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5776626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5776664Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5776699Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5776824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5778159Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5778195Z ^^^^^^^^^ 2025-09-07T07:33:27.5778368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5778422Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5778457Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5778499Z File "", line 1, in 2025-09-07T07:33:27.5778642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5778720Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5778767Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5778901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5778949Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5778987Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5779177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5779239Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5779276Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5779448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5779493Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5779530Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5779673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5779716Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5779752Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5779884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5781270Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5781321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5781450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5781510Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5781554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5781679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5781719Z leaves = list(leaves) 2025-09-07T07:33:27.5781753Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5781874Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5781909Z return func(x) 2025-09-07T07:33:27.5781942Z ^^^^^^^ 2025-09-07T07:33:27.5782100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5782183Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5782226Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5782392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5782434Z return func(*args, **kwargs) 2025-09-07T07:33:27.5782471Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5782652Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5782738Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5782740Z 2025-09-07T07:33:27.5782949Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5782953Z 2025-09-07T07:33:27.5782955Z 2025-09-07T07:33:27.5783047Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5784611Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5784614Z 2025-09-07T07:33:27.5784701Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5784775Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5784809Z inline_call [] 2025-09-07T07:33:27.5784867Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5784901Z inductor [] 2025-09-07T07:33:27.5784976Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5785047Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5785311Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5785451Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5785533Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5785685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5785770Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5785900Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5786019Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5786130Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5786175Z Traceback (most recent call last): 2025-09-07T07:33:27.5786324Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5786360Z self._run_test( 2025-09-07T07:33:27.5786472Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5786527Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5786568Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5787998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5788045Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5788085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5788234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5788314Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5788354Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5788507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5788551Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5788589Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5788731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5788812Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5788849Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5788999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5789046Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5789196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5789268Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5789309Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5789451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5789502Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5789541Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5789656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5791024Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5791070Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5791197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5791282Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5791332Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5791472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5791517Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5791554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5791690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5791728Z return aot_autograd( 2025-09-07T07:33:27.5791764Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5791898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5791968Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5792014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5792177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5792261Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5792306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5792486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5792529Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5792712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5792753Z fx_g = _create_graph( 2025-09-07T07:33:27.5792787Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5794317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5794358Z fx_g = make_fx( 2025-09-07T07:33:27.5794410Z ^^^^^^^^ 2025-09-07T07:33:27.5794563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5794609Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5794647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5794793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5794836Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5794872Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5795029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5795066Z t = dispatch_trace( 2025-09-07T07:33:27.5795102Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5795215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5795275Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5795311Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5795436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5795476Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5795512Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5795672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5795750Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5795791Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5797216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5797257Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5797323Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5797452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5797496Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5797530Z ^^^^^^^^^ 2025-09-07T07:33:27.5797664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5797704Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5797739Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5797891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5797941Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5797975Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5798131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5798194Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5798243Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5798417Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5798456Z outs_pair = fn(*args) 2025-09-07T07:33:27.5798492Z ^^^^^^^^^ 2025-09-07T07:33:27.5798661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5798727Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5798770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5798941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5800286Z outs_pair = fn(*args) 2025-09-07T07:33:27.5800323Z ^^^^^^^^^ 2025-09-07T07:33:27.5800518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5800577Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5800619Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5800811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5800880Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5800926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5801099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5801138Z outs_pair = fn(*args) 2025-09-07T07:33:27.5801174Z ^^^^^^^^^ 2025-09-07T07:33:27.5801382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5801427Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5801464Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5801631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5801678Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5801715Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5801838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5801881Z return handle_torch_function( 2025-09-07T07:33:27.5801917Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5802058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5802150Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5803574Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5803740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5803781Z return func(*args, **kwargs) 2025-09-07T07:33:27.5803817Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5803939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5803980Z result = _engine_run_backward( 2025-09-07T07:33:27.5804017Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5804161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5804284Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5804341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5804466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5804507Z return user_fn(self, *args) 2025-09-07T07:33:27.5804543Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5804687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5804731Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5804767Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5804924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5804968Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5805030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5805154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5805214Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5806549Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5806772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5806823Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5806863Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5806998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5807047Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5807085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5807245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5807320Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5807359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5807517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5807555Z t = dispatch_trace( 2025-09-07T07:33:27.5807590Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5807701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5807745Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5807780Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5807905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5807943Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5807979Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5808165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5808246Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5808287Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5809712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5809752Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5809788Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5809913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5809955Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5809989Z ^^^^^^^^^ 2025-09-07T07:33:27.5810137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5810187Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5810223Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5810269Z File "", line 1, in 2025-09-07T07:33:27.5810410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5810488Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5810534Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5810676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5810723Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5810762Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5810951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5811036Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5811076Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5811263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5811307Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5812636Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5812780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5812823Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5812859Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5812993Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5813145Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5813193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5813346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5813411Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5813454Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5813581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5813620Z leaves = list(leaves) 2025-09-07T07:33:27.5813655Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5813776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5813811Z return func(x) 2025-09-07T07:33:27.5813843Z ^^^^^^^ 2025-09-07T07:33:27.5813978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5814045Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5814106Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5814275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5814316Z return func(*args, **kwargs) 2025-09-07T07:33:27.5814353Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5815841Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5815929Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5815931Z 2025-09-07T07:33:27.5816140Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5816143Z 2025-09-07T07:33:27.5816144Z 2025-09-07T07:33:27.5816219Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5816418Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5816422Z 2025-09-07T07:33:27.5816507Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5816581Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5816616Z inline_call [] 2025-09-07T07:33:27.5816673Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5816708Z inductor [] 2025-09-07T07:33:27.5816781Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5816853Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5817130Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5817246Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5817347Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5817498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5817582Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5817714Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5817832Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5817903Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5817937Z inline_call [] 2025-09-07T07:33:27.5819292Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5819369Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5819469Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5819725Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5819835Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5819915Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5820064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5820148Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5820279Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5820414Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5820466Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5820575Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5820620Z Traceback (most recent call last): 2025-09-07T07:33:27.5820767Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5820804Z self._run_test( 2025-09-07T07:33:27.5820915Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5820970Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5821011Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5821144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5821192Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5821232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5821381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5822723Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5822763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5822901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5822945Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5822983Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5823210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5823291Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5823358Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5823531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5823577Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5823728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5823782Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5823822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5823963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5824015Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5824054Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5824170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5824255Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5824301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5824427Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5824489Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5825839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5825979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5826025Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5826062Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5826201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5826239Z return aot_autograd( 2025-09-07T07:33:27.5826306Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5826444Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5826517Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5826562Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5826722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5826804Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5826850Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5827029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5827072Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5827258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5827302Z fx_g = _create_graph( 2025-09-07T07:33:27.5827337Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5827499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5827533Z fx_g = make_fx( 2025-09-07T07:33:27.5827565Z ^^^^^^^^ 2025-09-07T07:33:27.5827716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5829054Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5829093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5829239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5829283Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5829343Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5829517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5829555Z t = dispatch_trace( 2025-09-07T07:33:27.5829590Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5829703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5829746Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5829782Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5829907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5829947Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5829983Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5830142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5830223Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5830288Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5830412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5830450Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5830485Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5830609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5831943Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5831979Z ^^^^^^^^^ 2025-09-07T07:33:27.5832113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5832152Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5832188Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5832337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5832408Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5832442Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5832598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5832660Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5832703Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5832877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5832916Z outs_pair = fn(*args) 2025-09-07T07:33:27.5832951Z ^^^^^^^^^ 2025-09-07T07:33:27.5833192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5833261Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5833310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5833481Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5833519Z outs_pair = fn(*args) 2025-09-07T07:33:27.5833553Z ^^^^^^^^^ 2025-09-07T07:33:27.5833728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5833793Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5835141Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5835337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5835430Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5835479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5835668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5835707Z outs_pair = fn(*args) 2025-09-07T07:33:27.5835740Z ^^^^^^^^^ 2025-09-07T07:33:27.5835928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5835973Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5836010Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5836176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5836222Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5836262Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5836408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5836454Z return handle_torch_function( 2025-09-07T07:33:27.5836491Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5836631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5836706Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5836751Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5836917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5836958Z return func(*args, **kwargs) 2025-09-07T07:33:27.5836993Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5838413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5838481Z result = _engine_run_backward( 2025-09-07T07:33:27.5838522Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5838666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5838786Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5838836Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5838962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5839002Z return user_fn(self, *args) 2025-09-07T07:33:27.5839038Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5839180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5839227Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5839265Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5839425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5839468Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5839504Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5839627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5839666Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5839702Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5839867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5839918Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5839958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5841400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5841470Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5841509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5841669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5841716Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5841754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5841911Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5841949Z t = dispatch_trace( 2025-09-07T07:33:27.5841984Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5842096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5842140Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5842178Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5842321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5842361Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5842396Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5842554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5842633Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5842674Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5842797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5842835Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5842870Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5842999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5844436Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5844474Z ^^^^^^^^^ 2025-09-07T07:33:27.5844627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5844676Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5844710Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5844752Z File "", line 1, in 2025-09-07T07:33:27.5844895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5844973Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5845019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5845155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5845206Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5845247Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5845436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5845480Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5845515Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5845686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5845729Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5845767Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5845909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5845952Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5846011Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5847511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5847626Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5847673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5847799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5847859Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5847903Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5848029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5848068Z leaves = list(leaves) 2025-09-07T07:33:27.5848103Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5848226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5848262Z return func(x) 2025-09-07T07:33:27.5848314Z ^^^^^^^ 2025-09-07T07:33:27.5848452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5848516Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5848557Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5848722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5848764Z return func(*args, **kwargs) 2025-09-07T07:33:27.5848800Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5848979Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5849065Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5849097Z 2025-09-07T07:33:27.5849303Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5849307Z 2025-09-07T07:33:27.5849309Z 2025-09-07T07:33:27.5849382Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5850879Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5850882Z 2025-09-07T07:33:27.5850968Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5851043Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5851077Z inline_call [] 2025-09-07T07:33:27.5851135Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5851169Z inductor [] 2025-09-07T07:33:27.5851247Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5851322Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5851586Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5851697Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5851777Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5851929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5852013Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5852145Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5852284Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5852383Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5852418Z inline_call [] 2025-09-07T07:33:27.5852474Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5852546Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5852616Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5852867Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5854345Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5854428Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5854608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5854695Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5854826Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5854944Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5855014Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5855049Z inline_call [] 2025-09-07T07:33:27.5855105Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5855176Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5855245Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5855498Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5855627Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5855705Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5855852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5855934Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5856063Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5856179Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5856395Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-676021e9b7ec0e57.xml - 2025-09-07T07:33:27.5856455Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5856813Z FAILED [0.2228s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5856896Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5858220Z 2025-09-07T07:33:27.5858429Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5858432Z 2025-09-07T07:33:27.5858433Z 2025-09-07T07:33:27.5858506Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5858727Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5858757Z 2025-09-07T07:33:27.5858840Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5858900Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5858965Z ================== 1 failed, 220 deselected, 2 rerun in 1.01s ================== 2025-09-07T07:33:27.5859001Z Got exit code 1 2025-09-07T07:33:27.5859039Z Retrying single test... 2025-09-07T07:33:27.5859456Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5859495Z import pkg_resources 2025-09-07T07:33:27.5859683Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-12a707d3033caf3a.xml 2025-09-07T07:33:27.5859740Z ============================= test session starts ============================== 2025-09-07T07:33:27.5859851Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5859890Z cachedir: .pytest_cache 2025-09-07T07:33:27.5860048Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5860093Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5860132Z configfile: pytest.ini 2025-09-07T07:33:27.5860291Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5860367Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.5860604Z stepcurrent: skipping 50 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5860664Z Running 1 items in this shard 2025-09-07T07:33:27.5860666Z 2025-09-07T07:33:27.5862157Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.4063s] [100%] 2025-09-07T07:33:27.5862350Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2436s] [100%] 2025-09-07T07:33:27.5862517Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True FAILED [0.2199s] [100%] 2025-09-07T07:33:27.5862520Z 2025-09-07T07:33:27.5862568Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5862687Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5862734Z Traceback (most recent call last): 2025-09-07T07:33:27.5862889Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5862924Z self._run_test( 2025-09-07T07:33:27.5863036Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5863171Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5863212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5863347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5863393Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5863433Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5863582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5863657Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5863717Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5863853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5863897Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5863935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5864077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5865467Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5865507Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5865659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5865705Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5865878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5865937Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5865979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5866119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5866172Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5866211Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5866327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5866393Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5866438Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5866563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5866654Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5866698Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5866837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5866882Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5866919Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5867057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5867095Z return aot_autograd( 2025-09-07T07:33:27.5867131Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5868562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5868635Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5868682Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5868848Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5868934Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5868981Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5869162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5869206Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5869391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5869431Z fx_g = _create_graph( 2025-09-07T07:33:27.5869465Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5869646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5869703Z fx_g = make_fx( 2025-09-07T07:33:27.5869737Z ^^^^^^^^ 2025-09-07T07:33:27.5869887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5869934Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5869972Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5870119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5870161Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5870198Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5870354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5871691Z t = dispatch_trace( 2025-09-07T07:33:27.5871726Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5871861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5871907Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5871943Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5872070Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5872111Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5872147Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5872307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5872387Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5872428Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5872553Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5872609Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5872645Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5872772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5872814Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5872849Z ^^^^^^^^^ 2025-09-07T07:33:27.5872981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5873021Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5873057Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5873272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5873323Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5874655Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5874815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5874881Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5874928Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5875106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5875146Z outs_pair = fn(*args) 2025-09-07T07:33:27.5875180Z ^^^^^^^^^ 2025-09-07T07:33:27.5875351Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5875418Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5875463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5875635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5875711Z outs_pair = fn(*args) 2025-09-07T07:33:27.5875768Z ^^^^^^^^^ 2025-09-07T07:33:27.5875944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5876005Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5876047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5876240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5876311Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5876357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5876528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5876569Z outs_pair = fn(*args) 2025-09-07T07:33:27.5876603Z ^^^^^^^^^ 2025-09-07T07:33:27.5878119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5878164Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5878201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5878368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5878416Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5878452Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5878578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5878619Z return handle_torch_function( 2025-09-07T07:33:27.5878656Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5878799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5878893Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5878941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5879108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5879148Z return func(*args, **kwargs) 2025-09-07T07:33:27.5879185Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5879306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5879348Z result = _engine_run_backward( 2025-09-07T07:33:27.5879383Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5879528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5879650Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5879701Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5881124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5881167Z return user_fn(self, *args) 2025-09-07T07:33:27.5881203Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5881347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5881390Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5881428Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5881586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5881629Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5881684Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5881825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5881866Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5881901Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5882065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5882117Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5882157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5882293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5882342Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5882380Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5882540Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5882604Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5882645Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5882801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5884203Z t = dispatch_trace( 2025-09-07T07:33:27.5884239Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5884355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5884397Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5884434Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5884556Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5884596Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5884630Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5884821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5884902Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5884943Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5885068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5885106Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5885141Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5885266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5885309Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5885343Z ^^^^^^^^^ 2025-09-07T07:33:27.5885492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5885544Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5885582Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5885624Z File "", line 1, in 2025-09-07T07:33:27.5887151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5887232Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5887278Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5887413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5887461Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5887499Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5887689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5887758Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5887796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5887984Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5888028Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5888064Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5888207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5888248Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5888285Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5888421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5888512Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5888562Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5888706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5888769Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5888813Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5888939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5890282Z leaves = list(leaves) 2025-09-07T07:33:27.5890320Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5890442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5890478Z return func(x) 2025-09-07T07:33:27.5890510Z ^^^^^^^ 2025-09-07T07:33:27.5890648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5890714Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5890778Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5890947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5890988Z return func(*args, **kwargs) 2025-09-07T07:33:27.5891025Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5891205Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5891288Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5891291Z 2025-09-07T07:33:27.5891496Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5891498Z 2025-09-07T07:33:27.5891500Z 2025-09-07T07:33:27.5891573Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5891772Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5891777Z 2025-09-07T07:33:27.5891861Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5891935Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5891969Z inline_call [] 2025-09-07T07:33:27.5892026Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5892060Z inductor [] 2025-09-07T07:33:27.5893706Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5893782Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5894068Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5894182Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5894284Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5894434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5894518Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5894649Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5894767Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5894875Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5894920Z Traceback (most recent call last): 2025-09-07T07:33:27.5895086Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5895125Z self._run_test( 2025-09-07T07:33:27.5895236Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5895291Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5895332Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5895463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5895510Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5895549Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5895698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5895744Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5895783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5897262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5897311Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5897349Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5897493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5897573Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5897612Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5897763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5897809Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5897957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5898012Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5898054Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5898196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5898247Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5898287Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5898402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5898468Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5898511Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5898636Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5898698Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5898756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5898897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5900262Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5900300Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5900438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5900477Z return aot_autograd( 2025-09-07T07:33:27.5900513Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5900648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5900717Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5900762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5900928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5901028Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5901077Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5901258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5901302Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5901487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5901527Z fx_g = _create_graph( 2025-09-07T07:33:27.5901562Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5901723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5901757Z fx_g = make_fx( 2025-09-07T07:33:27.5901806Z ^^^^^^^^ 2025-09-07T07:33:27.5901958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5902004Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5902043Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5903553Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5903599Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5903635Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5903793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5903830Z t = dispatch_trace( 2025-09-07T07:33:27.5903865Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5903976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5904021Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5904058Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5904192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5904231Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5904267Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5904427Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5904505Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5904545Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5904670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5904708Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5904742Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5904902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5904967Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5905003Z ^^^^^^^^^ 2025-09-07T07:33:27.5905134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5906479Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5906515Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5906664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5906714Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5906748Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5906903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5906964Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5907010Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5907219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5907259Z outs_pair = fn(*args) 2025-09-07T07:33:27.5907294Z ^^^^^^^^^ 2025-09-07T07:33:27.5907462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5907528Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5907573Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5907746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5907784Z outs_pair = fn(*args) 2025-09-07T07:33:27.5907818Z ^^^^^^^^^ 2025-09-07T07:33:27.5907996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5908079Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5908122Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5908315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5909682Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5909730Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5909902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5909941Z outs_pair = fn(*args) 2025-09-07T07:33:27.5909974Z ^^^^^^^^^ 2025-09-07T07:33:27.5910167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5910214Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5910250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5910417Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5910463Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5910501Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5910625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5910668Z return handle_torch_function( 2025-09-07T07:33:27.5910704Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5910843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5910937Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5910999Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5911168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5911209Z return func(*args, **kwargs) 2025-09-07T07:33:27.5911244Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5911368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5911409Z result = _engine_run_backward( 2025-09-07T07:33:27.5912735Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5912881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5913000Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5913149Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5913279Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5913320Z return user_fn(self, *args) 2025-09-07T07:33:27.5913356Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5913498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5913542Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5913578Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5913733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5913776Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5913812Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5913936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5913996Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5914032Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5914194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5914246Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5914285Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5914422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5914470Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5915810Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5915971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5916020Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5916060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5916222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5916260Z t = dispatch_trace( 2025-09-07T07:33:27.5916295Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5916407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5916450Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5916485Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5916609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5916648Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5916683Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5916859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5916941Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5916996Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5917119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5917157Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5917191Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5917317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5917358Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5917393Z ^^^^^^^^^ 2025-09-07T07:33:27.5918829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5918879Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5918912Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5918958Z File "", line 1, in 2025-09-07T07:33:27.5919124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5919206Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5919252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5919391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5919438Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5919476Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5919667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5919710Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5919746Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5919935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5919979Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5920017Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5920158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5920201Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5920237Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5920372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5920461Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5921802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5921929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5921993Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5922039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5922164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5922202Z leaves = list(leaves) 2025-09-07T07:33:27.5922237Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5922361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5922396Z return func(x) 2025-09-07T07:33:27.5922429Z ^^^^^^^ 2025-09-07T07:33:27.5922564Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5922629Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5922670Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5922855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5922909Z return func(*args, **kwargs) 2025-09-07T07:33:27.5922946Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5923211Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5923296Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5923298Z 2025-09-07T07:33:27.5923502Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5923505Z 2025-09-07T07:33:27.5923506Z 2025-09-07T07:33:27.5923579Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5923775Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5923804Z 2025-09-07T07:33:27.5923891Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5925272Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5925308Z inline_call [] 2025-09-07T07:33:27.5925365Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5925400Z inductor [] 2025-09-07T07:33:27.5925473Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5925545Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5925803Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5925918Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5926026Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5926180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5926264Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5926394Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5926513Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5926583Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5926617Z inline_call [] 2025-09-07T07:33:27.5926674Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5926813Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5926886Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5927141Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5927251Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5927331Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5928786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5928871Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5929003Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5929148Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5929204Z =================================== FAILURES =================================== 2025-09-07T07:33:27.5929337Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5929382Z Traceback (most recent call last): 2025-09-07T07:33:27.5929531Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5929566Z self._run_test( 2025-09-07T07:33:27.5929677Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5929732Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5929772Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5929904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5929950Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5929993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5930157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5930206Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5930244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5930378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5930423Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5930461Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5930601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5931983Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5932022Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5932177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5932244Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5932393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5932447Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5932487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5932631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5932682Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5932722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5932840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5932906Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5932951Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5933175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5933238Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5933279Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5933419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5933464Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5933501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5933638Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5933677Z return aot_autograd( 2025-09-07T07:33:27.5935014Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5935178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5935271Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5935316Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5935477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5935560Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5935606Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5935787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5935831Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5936022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5936063Z fx_g = _create_graph( 2025-09-07T07:33:27.5936124Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5936287Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5936323Z fx_g = make_fx( 2025-09-07T07:33:27.5936355Z ^^^^^^^^ 2025-09-07T07:33:27.5936507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5936552Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5936591Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5936735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5936778Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5936814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5936976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5938341Z t = dispatch_trace( 2025-09-07T07:33:27.5938377Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5938490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5938532Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5938567Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5938690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5938730Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5938766Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5938930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5939009Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5939054Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5939179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5939221Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5939255Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5939383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5939427Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5939462Z ^^^^^^^^^ 2025-09-07T07:33:27.5939593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5939634Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5939668Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5939816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5939882Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5941213Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5941398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5941461Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5941505Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5941680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5941719Z outs_pair = fn(*args) 2025-09-07T07:33:27.5941754Z ^^^^^^^^^ 2025-09-07T07:33:27.5941923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5941989Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5942034Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5942225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5942267Z outs_pair = fn(*args) 2025-09-07T07:33:27.5942301Z ^^^^^^^^^ 2025-09-07T07:33:27.5942477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5942536Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5942579Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5942774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5942843Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5942894Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5943171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5943213Z outs_pair = fn(*args) 2025-09-07T07:33:27.5944557Z ^^^^^^^^^ 2025-09-07T07:33:27.5944749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5944794Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5944831Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5944998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5945044Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5945080Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5945206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5945253Z return handle_torch_function( 2025-09-07T07:33:27.5945292Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5945432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5945506Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5945552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5945719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5945760Z return func(*args, **kwargs) 2025-09-07T07:33:27.5945795Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5945917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5945959Z result = _engine_run_backward( 2025-09-07T07:33:27.5946024Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5946170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5946309Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5946360Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5947781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5947824Z return user_fn(self, *args) 2025-09-07T07:33:27.5947860Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5948003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5948046Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5948083Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5948265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5948310Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5948346Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5948468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5948508Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5948542Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5948705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5948756Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5948796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5948931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5949002Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5949043Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5949202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5949250Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5949288Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5950742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5950781Z t = dispatch_trace( 2025-09-07T07:33:27.5950817Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5950929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5950973Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5951009Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5951134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5951176Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5951212Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5951370Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5951448Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5951488Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5951612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5951650Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5951684Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5951809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5951851Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5951907Z ^^^^^^^^^ 2025-09-07T07:33:27.5952056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5952119Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5952153Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5952195Z File "", line 1, in 2025-09-07T07:33:27.5953698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5953779Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5953824Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5953961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5954008Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5954049Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5954268Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5954314Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5954349Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5954518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5954562Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5954599Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5954740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5954783Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5954818Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5954953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5955060Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5955108Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5955231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5955292Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5955334Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5956763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5956804Z leaves = list(leaves) 2025-09-07T07:33:27.5956839Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5956961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5956996Z return func(x) 2025-09-07T07:33:27.5957030Z ^^^^^^^ 2025-09-07T07:33:27.5957168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5957236Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5957277Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5957443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5957484Z return func(*args, **kwargs) 2025-09-07T07:33:27.5957521Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5957701Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5957786Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5957788Z 2025-09-07T07:33:27.5958014Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5958034Z 2025-09-07T07:33:27.5958037Z 2025-09-07T07:33:27.5958109Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5958303Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5958307Z 2025-09-07T07:33:27.5958391Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5958464Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5958499Z inline_call [] 2025-09-07T07:33:27.5958555Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5958590Z inductor [] 2025-09-07T07:33:27.5959958Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5960033Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5960305Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5960418Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5960499Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5960648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5960733Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5960864Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5960983Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5961073Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5961110Z inline_call [] 2025-09-07T07:33:27.5961167Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5961239Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5961309Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5961561Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5961670Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5961749Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5961898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5961984Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5962114Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5962230Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5963662Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.5963699Z inline_call [] 2025-09-07T07:33:27.5963756Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.5963828Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.5963897Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.5964182Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.5964292Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.5964394Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.5964543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.5964626Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.5964754Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.5964870Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5965085Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-12a707d3033caf3a.xml - 2025-09-07T07:33:27.5965143Z =========================== short test summary info ============================ 2025-09-07T07:33:27.5965527Z FAILED [0.2199s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5965611Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5965613Z 2025-09-07T07:33:27.5965816Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.5965818Z 2025-09-07T07:33:27.5965820Z 2025-09-07T07:33:27.5965891Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.5966086Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.5966110Z 2025-09-07T07:33:27.5966193Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.5966254Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.5967703Z ================== 1 failed, 220 deselected, 2 rerun in 1.17s ================== 2025-09-07T07:33:27.5967740Z Got exit code 1 2025-09-07T07:33:27.5967864Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.5968292Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.5968332Z import pkg_resources 2025-09-07T07:33:27.5968503Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-55fb2def44e02386.xml 2025-09-07T07:33:27.5968562Z ============================= test session starts ============================== 2025-09-07T07:33:27.5968674Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.5968714Z cachedir: .pytest_cache 2025-09-07T07:33:27.5968869Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.5968913Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.5968952Z configfile: pytest.ini 2025-09-07T07:33:27.5969111Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.5969186Z collecting ... collected 467 items / 51 deselected / 416 selected 2025-09-07T07:33:27.5969236Z stepcurrent: skipping 51 already run items. 2025-09-07T07:33:27.5969301Z Running 170 items in this shard 2025-09-07T07:33:27.5969303Z 2025-09-07T07:33:27.5969515Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5708s] [ 0%] 2025-09-07T07:33:27.5969711Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2286s] [ 0%] 2025-09-07T07:33:27.5969879Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True FAILED [0.2257s] [ 0%] 2025-09-07T07:33:27.5969881Z 2025-09-07T07:33:27.5969931Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.5970041Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.5970085Z Traceback (most recent call last): 2025-09-07T07:33:27.5971536Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.5971592Z self._run_test( 2025-09-07T07:33:27.5971707Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.5971764Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.5971805Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5971939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.5971986Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.5972026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5972176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.5972222Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.5972260Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5972418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.5972463Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.5972501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5972643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.5972724Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.5972763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5972914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.5972961Z raise BackendCompilerFailed( 2025-09-07T07:33:27.5973201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.5973256Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5974606Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5974751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.5974804Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.5974843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5974959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.5975027Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.5975071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5975196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.5975259Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.5975300Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5975468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.5975531Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.5975568Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5975705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.5975744Z return aot_autograd( 2025-09-07T07:33:27.5975780Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.5975913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.5975983Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.5976028Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5976189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.5976291Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.5976339Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5977817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.5977863Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.5978048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.5978089Z fx_g = _create_graph( 2025-09-07T07:33:27.5978124Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5978286Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.5978320Z fx_g = make_fx( 2025-09-07T07:33:27.5978353Z ^^^^^^^^ 2025-09-07T07:33:27.5978529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.5978577Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.5978615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5978762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.5978805Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.5978842Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5978998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5979037Z t = dispatch_trace( 2025-09-07T07:33:27.5979071Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5979182Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5979225Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5979261Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5979388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5979428Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5980752Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5980914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5980994Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5981034Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5981159Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5981197Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5981232Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5981372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5981417Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5981466Z ^^^^^^^^^ 2025-09-07T07:33:27.5981598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.5981639Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.5981674Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5981823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5981874Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5981907Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5982062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.5982124Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.5982168Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5982355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5982395Z outs_pair = fn(*args) 2025-09-07T07:33:27.5983810Z ^^^^^^^^^ 2025-09-07T07:33:27.5983983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.5984050Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.5984094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5984267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5984305Z outs_pair = fn(*args) 2025-09-07T07:33:27.5984339Z ^^^^^^^^^ 2025-09-07T07:33:27.5984517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.5984611Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.5984653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5984846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.5984916Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.5984963Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5985135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.5985174Z outs_pair = fn(*args) 2025-09-07T07:33:27.5985208Z ^^^^^^^^^ 2025-09-07T07:33:27.5985397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5985444Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5985481Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5985647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.5985694Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.5985730Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5987160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.5987203Z return handle_torch_function( 2025-09-07T07:33:27.5987240Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5987381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.5987481Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.5987529Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5987735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5987776Z return func(*args, **kwargs) 2025-09-07T07:33:27.5987812Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5987934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.5987976Z result = _engine_run_backward( 2025-09-07T07:33:27.5988012Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5988155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.5988275Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.5988325Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5988476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.5988518Z return user_fn(self, *args) 2025-09-07T07:33:27.5988555Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5988699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.5988744Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.5988781Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5990229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.5990275Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.5990312Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5990440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5990498Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5990535Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5990698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.5990749Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.5990789Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5990924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.5990973Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.5991011Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5991171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.5991217Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.5991259Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5991416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.5991455Z t = dispatch_trace( 2025-09-07T07:33:27.5991488Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5991600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.5991643Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.5991678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5991807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5993215Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5993252Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5993414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.5993521Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.5993589Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5993714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.5993753Z return fn(*args, **kwargs) 2025-09-07T07:33:27.5993789Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5993914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.5993956Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.5993991Z ^^^^^^^^^ 2025-09-07T07:33:27.5994139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.5994188Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.5994222Z ^^^^^^^^^^^ 2025-09-07T07:33:27.5994264Z File "", line 1, in 2025-09-07T07:33:27.5994429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.5994508Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.5994554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5994688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.5994736Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.5994774Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5996271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.5996317Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.5996353Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5996526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.5996594Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.5996631Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5996775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.5996818Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.5996854Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5996987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.5997074Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.5997120Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5997244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.5997307Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.5997352Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5997478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.5997516Z leaves = list(leaves) 2025-09-07T07:33:27.5997551Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.5997671Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.5997706Z return func(x) 2025-09-07T07:33:27.5997738Z ^^^^^^^ 2025-09-07T07:33:27.5997874Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.5999227Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.5999270Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5999454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.5999512Z return func(*args, **kwargs) 2025-09-07T07:33:27.5999548Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.5999729Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.5999813Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.5999815Z 2025-09-07T07:33:27.6000023Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6000025Z 2025-09-07T07:33:27.6000027Z 2025-09-07T07:33:27.6000099Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6000294Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6000298Z 2025-09-07T07:33:27.6000396Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6000470Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6000504Z inline_call [] 2025-09-07T07:33:27.6000561Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6000595Z inductor [] 2025-09-07T07:33:27.6000669Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6000740Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6000996Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6001106Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6001203Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6001354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6002738Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6002871Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6002989Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6003191Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6003236Z Traceback (most recent call last): 2025-09-07T07:33:27.6003382Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6003417Z self._run_test( 2025-09-07T07:33:27.6003533Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6003590Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6003630Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6003761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6003807Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6003845Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6003997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6004043Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6004081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6004216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6004286Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6004325Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6004484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6004564Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6004603Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6006072Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6006120Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6006269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6006324Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6006363Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6006505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6006583Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6006623Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6006868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6006936Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6006982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6007108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6007170Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6007213Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6007352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6007418Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6007456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6007593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6007632Z return aot_autograd( 2025-09-07T07:33:27.6007667Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6007802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6009183Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6009230Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6009390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6009473Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6009521Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6009705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6009747Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6009933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6009972Z fx_g = _create_graph( 2025-09-07T07:33:27.6010007Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6010171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6010206Z fx_g = make_fx( 2025-09-07T07:33:27.6010238Z ^^^^^^^^ 2025-09-07T07:33:27.6010408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6010455Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6010508Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6010653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6010696Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6010732Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6010889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6010926Z t = dispatch_trace( 2025-09-07T07:33:27.6010961Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6012364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6012409Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6012444Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6012571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6012629Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6012666Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6012827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6012906Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6012947Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6013132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6013172Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6013206Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6013331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6013373Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6013430Z ^^^^^^^^^ 2025-09-07T07:33:27.6013562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6013605Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6013639Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6013792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6013841Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6013876Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6014031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6015398Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6015443Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6015621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6015663Z outs_pair = fn(*args) 2025-09-07T07:33:27.6015698Z ^^^^^^^^^ 2025-09-07T07:33:27.6015868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6015935Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6015979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6016151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6016189Z outs_pair = fn(*args) 2025-09-07T07:33:27.6016223Z ^^^^^^^^^ 2025-09-07T07:33:27.6016397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6016482Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6016526Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6016735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6016806Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6016852Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6017026Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6017063Z outs_pair = fn(*args) 2025-09-07T07:33:27.6017098Z ^^^^^^^^^ 2025-09-07T07:33:27.6017286Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6018628Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6018667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6018857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6018904Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6018942Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6019067Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6019110Z return handle_torch_function( 2025-09-07T07:33:27.6019146Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6019285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6019360Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6019405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6019590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6019632Z return func(*args, **kwargs) 2025-09-07T07:33:27.6019667Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6019789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6019830Z result = _engine_run_backward( 2025-09-07T07:33:27.6019867Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6020011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6020130Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6020179Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6020308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6020352Z return user_fn(self, *args) 2025-09-07T07:33:27.6021679Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6021823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6021868Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6021904Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6022062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6022105Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6022141Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6022264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6022303Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6022357Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6022522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6022589Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6022628Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6022766Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6022815Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6022854Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6023012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6023123Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6023162Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6023321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6023382Z t = dispatch_trace( 2025-09-07T07:33:27.6024717Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6024831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6024874Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6024909Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6025034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6025073Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6025109Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6025267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6025345Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6025387Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6025539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6025578Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6025612Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6025738Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6025779Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6025815Z ^^^^^^^^^ 2025-09-07T07:33:27.6025963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6026013Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6026046Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6026088Z File "", line 1, in 2025-09-07T07:33:27.6026231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6026312Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6027647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6027784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6027831Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6027870Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6028058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6028101Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6028137Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6028309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6028377Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6028415Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6028583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6028626Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6028662Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6028798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6028886Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6028933Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6029057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6029118Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6029162Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6029300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6029341Z leaves = list(leaves) 2025-09-07T07:33:27.6029375Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6030817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6030852Z return func(x) 2025-09-07T07:33:27.6030886Z ^^^^^^^ 2025-09-07T07:33:27.6031022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6031086Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6031128Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6031297Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6031339Z return func(*args, **kwargs) 2025-09-07T07:33:27.6031393Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6031579Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6031664Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6031666Z 2025-09-07T07:33:27.6031874Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6031877Z 2025-09-07T07:33:27.6031878Z 2025-09-07T07:33:27.6031952Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6032147Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6032149Z 2025-09-07T07:33:27.6032237Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6032311Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6032348Z inline_call [] 2025-09-07T07:33:27.6032404Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6032439Z inductor [] 2025-09-07T07:33:27.6032512Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6032583Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6034188Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6034302Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6034383Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6034561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6034665Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6034796Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6034915Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6034986Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6035021Z inline_call [] 2025-09-07T07:33:27.6035077Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6035148Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6035219Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6035491Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6035604Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6035683Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6035833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6035915Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6036045Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6036162Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6036212Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6036325Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6037700Z Traceback (most recent call last): 2025-09-07T07:33:27.6037850Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6037885Z self._run_test( 2025-09-07T07:33:27.6037997Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6038052Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6038093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6038224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6038270Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6038310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6038460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6038509Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6038548Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6038683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6038728Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6038765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6038906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6038986Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6039025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6039175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6039221Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6039389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6039457Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6040794Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6040937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6040989Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6041029Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6041143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6041209Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6041252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6041379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6041458Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6041502Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6041639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6041684Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6041721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6041861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6041900Z return aot_autograd( 2025-09-07T07:33:27.6041935Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6042069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6042137Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6042201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6042362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6042445Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6043853Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6044036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6044080Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6044264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6044304Z fx_g = _create_graph( 2025-09-07T07:33:27.6044338Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6044501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6044538Z fx_g = make_fx( 2025-09-07T07:33:27.6044570Z ^^^^^^^^ 2025-09-07T07:33:27.6044721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6044767Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6044806Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6044951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6044994Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6045030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6045191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6045228Z t = dispatch_trace( 2025-09-07T07:33:27.6045292Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6045407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6045468Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6045503Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6045629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6047034Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6047075Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6047238Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6047316Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6047358Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6047483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6047523Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6047583Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6047710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6047752Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6047788Z ^^^^^^^^^ 2025-09-07T07:33:27.6047919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6047961Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6047996Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6048144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6048193Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6048227Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6048384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6048467Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6048511Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6048690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6048729Z outs_pair = fn(*args) 2025-09-07T07:33:27.6050061Z ^^^^^^^^^ 2025-09-07T07:33:27.6050232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6050299Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6050342Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6050517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6050556Z outs_pair = fn(*args) 2025-09-07T07:33:27.6050593Z ^^^^^^^^^ 2025-09-07T07:33:27.6050768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6050828Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6050870Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6051069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6051141Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6051187Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6051383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6051424Z outs_pair = fn(*args) 2025-09-07T07:33:27.6051472Z ^^^^^^^^^ 2025-09-07T07:33:27.6051661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6051707Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6051743Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6051911Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6051957Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6053343Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6053470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6053514Z return handle_torch_function( 2025-09-07T07:33:27.6053550Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6053712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6053788Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6053835Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6054001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6054042Z return func(*args, **kwargs) 2025-09-07T07:33:27.6054078Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6054201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6054242Z result = _engine_run_backward( 2025-09-07T07:33:27.6054279Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6054424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6054561Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6054611Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6054737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6054777Z return user_fn(self, *args) 2025-09-07T07:33:27.6054813Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6054955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6054999Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6055036Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6056490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6056537Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6056575Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6056702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6056742Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6056777Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6056939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6056991Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6057030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6057165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6057214Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6057253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6057431Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6057492Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6057530Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6057687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6057725Z t = dispatch_trace( 2025-09-07T07:33:27.6057760Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6057871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6057914Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6057950Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6059366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6059407Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6059446Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6059622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6059703Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6059744Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6059868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6059906Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6059943Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6060072Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6060113Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6060148Z ^^^^^^^^^ 2025-09-07T07:33:27.6060296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6060359Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6060394Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6060437Z File "", line 1, in 2025-09-07T07:33:27.6060578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6060656Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6060701Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6060839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6060886Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6060923Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6062406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6062453Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6062491Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6062660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6062704Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6062741Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6062882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6062925Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6062960Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6063154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6063242Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6063315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6063456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6063518Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6063562Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6063686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6063725Z leaves = list(leaves) 2025-09-07T07:33:27.6063759Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6063880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6063915Z return func(x) 2025-09-07T07:33:27.6063948Z ^^^^^^^ 2025-09-07T07:33:27.6064084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6065454Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6065519Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6065685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6065726Z return func(*args, **kwargs) 2025-09-07T07:33:27.6065762Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6065942Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6066028Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6066030Z 2025-09-07T07:33:27.6066234Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6066237Z 2025-09-07T07:33:27.6066238Z 2025-09-07T07:33:27.6066331Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6066527Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6066530Z 2025-09-07T07:33:27.6066615Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6066688Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6066723Z inline_call [] 2025-09-07T07:33:27.6066779Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6066814Z inductor [] 2025-09-07T07:33:27.6066887Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6066958Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6067213Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6067325Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6067406Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6067556Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6068938Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6069072Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6069190Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6069260Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6069294Z inline_call [] 2025-09-07T07:33:27.6069369Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6069444Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6069527Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6069777Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6069886Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6069965Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6070113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6070196Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6070328Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6070458Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6070529Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6070563Z inline_call [] 2025-09-07T07:33:27.6070619Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6070689Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6070758Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6071009Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6072414Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6072516Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6072666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6072748Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6072876Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6072991Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6073258Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-55fb2def44e02386.xml - 2025-09-07T07:33:27.6073315Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6073678Z FAILED [0.2257s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6073763Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6073765Z 2025-09-07T07:33:27.6073971Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6073973Z 2025-09-07T07:33:27.6073975Z 2025-09-07T07:33:27.6074046Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6074241Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6074244Z 2025-09-07T07:33:27.6074326Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6074413Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6074494Z ================== 1 failed, 51 deselected, 2 rerun in 1.21s =================== 2025-09-07T07:33:27.6074531Z Got exit code 1 2025-09-07T07:33:27.6074569Z Retrying single test... 2025-09-07T07:33:27.6074989Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6075027Z import pkg_resources 2025-09-07T07:33:27.6075195Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-b55e8363da5bd99f.xml 2025-09-07T07:33:27.6075252Z ============================= test session starts ============================== 2025-09-07T07:33:27.6076676Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6076740Z cachedir: .pytest_cache 2025-09-07T07:33:27.6076896Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6076941Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6076979Z configfile: pytest.ini 2025-09-07T07:33:27.6077139Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6077215Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.6077448Z stepcurrent: skipping 51 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6077491Z Running 1 items in this shard 2025-09-07T07:33:27.6077493Z 2025-09-07T07:33:27.6077691Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5503s] [100%] 2025-09-07T07:33:27.6077908Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2231s] [100%] 2025-09-07T07:33:27.6078075Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True FAILED [0.2197s] [100%] 2025-09-07T07:33:27.6078078Z 2025-09-07T07:33:27.6078127Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6078238Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6078283Z Traceback (most recent call last): 2025-09-07T07:33:27.6078433Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6078471Z self._run_test( 2025-09-07T07:33:27.6078584Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6078641Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6078682Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6078816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6080157Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6080199Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6080349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6080396Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6080434Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6080590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6080636Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6080690Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6080833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6080914Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6080953Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6081106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6081152Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6081301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6081354Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6081395Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6081550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6081603Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6081642Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6081759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6081826Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6081871Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6083390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6083453Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6083497Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6083637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6083710Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6083749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6083889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6083927Z return aot_autograd( 2025-09-07T07:33:27.6083963Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6084100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6084171Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6084216Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6084375Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6084459Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6084507Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6084689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6084733Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6084918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6084958Z fx_g = _create_graph( 2025-09-07T07:33:27.6084993Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6085154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6086492Z fx_g = make_fx( 2025-09-07T07:33:27.6086527Z ^^^^^^^^ 2025-09-07T07:33:27.6086750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6086799Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6086855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6087002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6087045Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6087081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6087239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6087276Z t = dispatch_trace( 2025-09-07T07:33:27.6087311Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6087424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6087466Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6087502Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6087651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6087692Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6087729Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6087888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6087967Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6088008Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6088133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6088172Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6089506Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6089633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6089676Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6089731Z ^^^^^^^^^ 2025-09-07T07:33:27.6089868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6089909Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6089945Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6090091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6090142Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6090176Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6090331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6090393Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6090437Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6090612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6090653Z outs_pair = fn(*args) 2025-09-07T07:33:27.6090688Z ^^^^^^^^^ 2025-09-07T07:33:27.6090860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6090929Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6090973Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6091146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6091184Z outs_pair = fn(*args) 2025-09-07T07:33:27.6092509Z ^^^^^^^^^ 2025-09-07T07:33:27.6092687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6092766Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6092822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6093015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6093355Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6093402Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6093572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6093611Z outs_pair = fn(*args) 2025-09-07T07:33:27.6093645Z ^^^^^^^^^ 2025-09-07T07:33:27.6093885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6093933Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6093995Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6094163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6094211Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6094247Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6094372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6094414Z return handle_torch_function( 2025-09-07T07:33:27.6094450Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6094596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6094670Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6094718Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6096227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6096272Z return func(*args, **kwargs) 2025-09-07T07:33:27.6096308Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6096433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6096475Z result = _engine_run_backward( 2025-09-07T07:33:27.6096512Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6096656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6096776Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6096825Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6096954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6096997Z return user_fn(self, *args) 2025-09-07T07:33:27.6097034Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6097177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6097221Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6097258Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6097414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6097457Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6097493Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6097616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6097657Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6097719Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6099180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6099254Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6099295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6099429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6099479Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6099517Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6099676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6099723Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6099763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6099934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6099975Z t = dispatch_trace( 2025-09-07T07:33:27.6100010Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6100122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6100165Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6100201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6100325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6100363Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6100399Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6100558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6100638Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6100695Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6100820Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6102148Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6102185Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6102312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6102355Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6102389Z ^^^^^^^^^ 2025-09-07T07:33:27.6102542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6102591Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6102625Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6102667Z File "", line 1, in 2025-09-07T07:33:27.6102810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6102889Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6102937Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6103138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6103187Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6103224Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6103414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6103457Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6103492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6103662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6103728Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6103783Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6103926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6105273Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6105309Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6105444Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6105531Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6105578Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6105702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6105762Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6105808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6105958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6105997Z leaves = list(leaves) 2025-09-07T07:33:27.6106032Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6106154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6106189Z return func(x) 2025-09-07T07:33:27.6106221Z ^^^^^^^ 2025-09-07T07:33:27.6106358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6106421Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6106463Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6106627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6106686Z return func(*args, **kwargs) 2025-09-07T07:33:27.6106724Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6106904Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6108280Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6108283Z 2025-09-07T07:33:27.6108488Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6108491Z 2025-09-07T07:33:27.6108493Z 2025-09-07T07:33:27.6108565Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6108761Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6108764Z 2025-09-07T07:33:27.6108852Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6108927Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6108962Z inline_call [] 2025-09-07T07:33:27.6109019Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6109053Z inductor [] 2025-09-07T07:33:27.6109127Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6109201Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6109466Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6109576Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6109657Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6109832Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6109931Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6110061Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6110181Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6110293Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6110337Z Traceback (most recent call last): 2025-09-07T07:33:27.6110485Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6111810Z self._run_test( 2025-09-07T07:33:27.6111924Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6111982Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6112039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6112171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6112218Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6112256Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6112407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6112452Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6112491Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6112626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6112671Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6112708Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6112865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6112946Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6112985Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6113187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6113234Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6113382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6113435Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6113475Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6113616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6114968Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6115012Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6115128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6115194Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6115238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6115364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6115425Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6115467Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6115605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6115649Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6115713Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6115851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6116611Z return aot_autograd( 2025-09-07T07:33:27.6116646Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6116785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6116854Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6116901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6117061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6117144Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6117189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6117389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6117434Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6118932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6118972Z fx_g = _create_graph( 2025-09-07T07:33:27.6119008Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6119168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6119203Z fx_g = make_fx( 2025-09-07T07:33:27.6119235Z ^^^^^^^^ 2025-09-07T07:33:27.6119385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6119431Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6119492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6119639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6119684Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6119720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6119877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6119914Z t = dispatch_trace( 2025-09-07T07:33:27.6119949Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6120061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6120102Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6120138Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6120263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6120305Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6120340Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6121792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6121873Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6121914Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6122038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6122079Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6122113Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6122239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6122280Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6122315Z ^^^^^^^^^ 2025-09-07T07:33:27.6122464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6122520Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6122555Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6122703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6122752Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6122786Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6122941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6123003Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6123046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6123282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6123322Z outs_pair = fn(*args) 2025-09-07T07:33:27.6123359Z ^^^^^^^^^ 2025-09-07T07:33:27.6123560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6124928Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6124974Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6125147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6125185Z outs_pair = fn(*args) 2025-09-07T07:33:27.6125218Z ^^^^^^^^^ 2025-09-07T07:33:27.6125394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6125453Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6125498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6125711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6125783Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6125829Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6126000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6126037Z outs_pair = fn(*args) 2025-09-07T07:33:27.6126072Z ^^^^^^^^^ 2025-09-07T07:33:27.6126262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6126309Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6126345Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6126516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6126562Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6126599Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6126780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6128120Z return handle_torch_function( 2025-09-07T07:33:27.6128159Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6128302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6128376Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6128422Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6128614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6128659Z return func(*args, **kwargs) 2025-09-07T07:33:27.6128711Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6128834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6128876Z result = _engine_run_backward( 2025-09-07T07:33:27.6128912Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6129056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6129174Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6129223Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6129349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6129392Z return user_fn(self, *args) 2025-09-07T07:33:27.6129428Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6129592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6129636Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6129674Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6129830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6129874Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6131203Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6131328Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6131368Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6131405Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6131572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6131645Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6131685Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6131822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6131871Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6131910Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6132069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6132119Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6132157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6132315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6132355Z t = dispatch_trace( 2025-09-07T07:33:27.6132391Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6132505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6132548Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6132584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6132707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6132747Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6134172Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6134334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6134414Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6134455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6134607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6134650Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6134703Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6134829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6134870Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6134906Z ^^^^^^^^^ 2025-09-07T07:33:27.6135057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6135106Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6135140Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6135183Z File "", line 1, in 2025-09-07T07:33:27.6135324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6135403Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6135467Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6135604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6135651Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6135690Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6135879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6135923Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6137269Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6137442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6137487Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6137524Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6137690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6137735Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6137770Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6137903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6137991Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6138037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6138165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6138225Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6138270Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6138398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6138440Z leaves = list(leaves) 2025-09-07T07:33:27.6138476Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6138598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6138632Z return func(x) 2025-09-07T07:33:27.6138666Z ^^^^^^^ 2025-09-07T07:33:27.6138802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6138867Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6138908Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6140368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6140410Z return func(*args, **kwargs) 2025-09-07T07:33:27.6140447Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6140654Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6140753Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6140756Z 2025-09-07T07:33:27.6140961Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6140963Z 2025-09-07T07:33:27.6140965Z 2025-09-07T07:33:27.6141038Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6141232Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6141235Z 2025-09-07T07:33:27.6141321Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6141396Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6141433Z inline_call [] 2025-09-07T07:33:27.6141505Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6141542Z inductor [] 2025-09-07T07:33:27.6141615Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6141691Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6141949Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6142061Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6142141Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6142291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6142391Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6142523Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6144011Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6144086Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6144122Z inline_call [] 2025-09-07T07:33:27.6144179Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6144251Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6144321Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6144575Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6144687Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6144768Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6144918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6145002Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6145133Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6145250Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6145302Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6145412Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6145505Z Traceback (most recent call last): 2025-09-07T07:33:27.6145654Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6145707Z self._run_test( 2025-09-07T07:33:27.6145819Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6145873Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6145915Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6147366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6147414Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6147453Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6147604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6147651Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6147692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6147856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6147902Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6147939Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6148081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6148161Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6148201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6148351Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6148397Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6148546Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6148620Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6148661Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6148804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6148855Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6148895Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6149010Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6149076Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6150416Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6150544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6150608Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6150653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6150792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6150837Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6150875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6151011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6151050Z return aot_autograd( 2025-09-07T07:33:27.6151085Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6151220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6151289Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6151335Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6151514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6151611Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6151656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6151837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6151881Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6152069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6152108Z fx_g = _create_graph( 2025-09-07T07:33:27.6152144Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6152307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6153723Z fx_g = make_fx( 2025-09-07T07:33:27.6153787Z ^^^^^^^^ 2025-09-07T07:33:27.6153939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6153985Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6154025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6154172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6154216Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6154252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6154409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6154447Z t = dispatch_trace( 2025-09-07T07:33:27.6154482Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6154595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6154662Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6154698Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6154822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6154863Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6154898Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6155058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6155136Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6155178Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6155303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6156655Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6156692Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6156825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6156868Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6156904Z ^^^^^^^^^ 2025-09-07T07:33:27.6157036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6157077Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6157113Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6157261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6157310Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6157345Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6157500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6157588Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6157651Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6157825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6157864Z outs_pair = fn(*args) 2025-09-07T07:33:27.6157899Z ^^^^^^^^^ 2025-09-07T07:33:27.6158068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6158136Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6158180Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6158353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6158391Z outs_pair = fn(*args) 2025-09-07T07:33:27.6159716Z ^^^^^^^^^ 2025-09-07T07:33:27.6159910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6159972Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6160014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6160212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6160282Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6160327Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6160498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6160536Z outs_pair = fn(*args) 2025-09-07T07:33:27.6160595Z ^^^^^^^^^ 2025-09-07T07:33:27.6160784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6160830Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6160867Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6161035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6161081Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6161119Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6161243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6161286Z return handle_torch_function( 2025-09-07T07:33:27.6161322Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6161464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6161539Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6162881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6163049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6163180Z return func(*args, **kwargs) 2025-09-07T07:33:27.6163216Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6163339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6163381Z result = _engine_run_backward( 2025-09-07T07:33:27.6163418Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6163566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6163715Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6163786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6163912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6163953Z return user_fn(self, *args) 2025-09-07T07:33:27.6163990Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6164134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6164179Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6164216Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6164375Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6164420Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6164456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6164601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6164642Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6164679Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6166158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6166212Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6166253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6166389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6166438Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6166478Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6166639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6166746Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6166787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6166946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6166985Z t = dispatch_trace( 2025-09-07T07:33:27.6167020Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6167132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6167176Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6167212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6167335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6167373Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6167408Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6167568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6167649Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6167691Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6169114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6169155Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6169190Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6169318Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6169360Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6169395Z ^^^^^^^^^ 2025-09-07T07:33:27.6169542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6169591Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6169645Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6169690Z File "", line 1, in 2025-09-07T07:33:27.6169844Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6169923Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6169968Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6170103Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6170150Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6170189Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6170382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6170426Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6170464Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6170648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6170695Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6170733Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6172167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6172212Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6172248Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6172382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6172470Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6172516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6172661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6172725Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6172769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6172893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6172933Z leaves = list(leaves) 2025-09-07T07:33:27.6172967Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6173149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6173185Z return func(x) 2025-09-07T07:33:27.6173218Z ^^^^^^^ 2025-09-07T07:33:27.6173355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6173419Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6173463Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6173635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6173677Z return func(*args, **kwargs) 2025-09-07T07:33:27.6173714Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6173892Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6175275Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6175279Z 2025-09-07T07:33:27.6175483Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6175485Z 2025-09-07T07:33:27.6175487Z 2025-09-07T07:33:27.6175561Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6175778Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6175798Z 2025-09-07T07:33:27.6175884Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6175957Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6175992Z inline_call [] 2025-09-07T07:33:27.6176049Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6176084Z inductor [] 2025-09-07T07:33:27.6176156Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6176229Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6176485Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6176599Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6176697Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6176849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6176933Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6177067Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6177186Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6177257Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6177292Z inline_call [] 2025-09-07T07:33:27.6177349Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6178721Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6178815Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6179070Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6179181Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6179260Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6179409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6179492Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6179623Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6179744Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6179816Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6179851Z inline_call [] 2025-09-07T07:33:27.6179907Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6179978Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6180047Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6180297Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6180405Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6180485Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6180652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6180750Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6180879Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6180997Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6182514Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-b55e8363da5bd99f.xml - 2025-09-07T07:33:27.6182573Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6182935Z FAILED [0.2197s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6183043Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6183045Z 2025-09-07T07:33:27.6183384Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6183386Z 2025-09-07T07:33:27.6183388Z 2025-09-07T07:33:27.6183460Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6183654Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6183657Z 2025-09-07T07:33:27.6183739Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6183800Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6183887Z ================== 1 failed, 220 deselected, 2 rerun in 1.17s ================== 2025-09-07T07:33:27.6183926Z Got exit code 1 2025-09-07T07:33:27.6183965Z Retrying single test... 2025-09-07T07:33:27.6184390Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6184430Z import pkg_resources 2025-09-07T07:33:27.6184599Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-98c5883bee68f3ae.xml 2025-09-07T07:33:27.6184654Z ============================= test session starts ============================== 2025-09-07T07:33:27.6184767Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6184808Z cachedir: .pytest_cache 2025-09-07T07:33:27.6184967Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6185013Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6185052Z configfile: pytest.ini 2025-09-07T07:33:27.6185214Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6186622Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.6186857Z stepcurrent: skipping 51 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6186900Z Running 1 items in this shard 2025-09-07T07:33:27.6186902Z 2025-09-07T07:33:27.6187119Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5630s] [100%] 2025-09-07T07:33:27.6187316Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2297s] [100%] 2025-09-07T07:33:27.6187499Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True FAILED [0.2196s] [100%] 2025-09-07T07:33:27.6187502Z 2025-09-07T07:33:27.6187551Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6187662Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6187707Z Traceback (most recent call last): 2025-09-07T07:33:27.6187858Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6187894Z self._run_test( 2025-09-07T07:33:27.6188007Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6188081Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6188124Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6188258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6188306Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6188346Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6188496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6188543Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6188581Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6188718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6190065Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6190125Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6190269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6190351Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6190390Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6190542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6190588Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6190740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6190794Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6190833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6190977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6191031Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6191071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6191188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6191256Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6191300Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6191426Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6191489Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6191531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6191670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6191715Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6191768Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6193322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6193364Z return aot_autograd( 2025-09-07T07:33:27.6193400Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6193535Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6193603Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6193649Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6193809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6193893Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6193940Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6194148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6194195Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6194379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6194420Z fx_g = _create_graph( 2025-09-07T07:33:27.6194454Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6194620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6194655Z fx_g = make_fx( 2025-09-07T07:33:27.6194688Z ^^^^^^^^ 2025-09-07T07:33:27.6194837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6194883Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6194941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6195088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6196440Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6196479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6196637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6196675Z t = dispatch_trace( 2025-09-07T07:33:27.6196710Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6196823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6196867Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6196903Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6197028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6197073Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6197111Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6197272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6197351Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6197393Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6197517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6197555Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6197591Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6197716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6197759Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6197794Z ^^^^^^^^^ 2025-09-07T07:33:27.6197950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6198009Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6199447Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6199600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6199652Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6199685Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6199842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6199905Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6199949Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6200124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6200166Z outs_pair = fn(*args) 2025-09-07T07:33:27.6200220Z ^^^^^^^^^ 2025-09-07T07:33:27.6200392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6200459Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6200503Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6200676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6200714Z outs_pair = fn(*args) 2025-09-07T07:33:27.6200749Z ^^^^^^^^^ 2025-09-07T07:33:27.6200925Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6200985Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6201044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6201239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6201310Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6202731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6202906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6202946Z outs_pair = fn(*args) 2025-09-07T07:33:27.6202980Z ^^^^^^^^^ 2025-09-07T07:33:27.6203317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6203363Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6203402Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6203572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6203620Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6203657Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6203781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6203824Z return handle_torch_function( 2025-09-07T07:33:27.6203861Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6204001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6204076Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6204122Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6204317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6204376Z return func(*args, **kwargs) 2025-09-07T07:33:27.6204412Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6204536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6204577Z result = _engine_run_backward( 2025-09-07T07:33:27.6204614Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6206081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6206203Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6206257Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6206385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6206428Z return user_fn(self, *args) 2025-09-07T07:33:27.6206486Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6206631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6206675Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6206755Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6206914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6206958Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6206995Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6207117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6207158Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6207195Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6207361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6207430Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6207470Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6207604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6207654Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6207692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6209161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6209211Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6209251Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6209408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6209449Z t = dispatch_trace( 2025-09-07T07:33:27.6209485Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6209601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6209644Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6209680Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6209806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6209844Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6209881Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6210039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6210118Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6210159Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6210299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6210352Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6210388Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6210513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6210555Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6210589Z ^^^^^^^^^ 2025-09-07T07:33:27.6210738Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6212077Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6212113Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6212156Z File "", line 1, in 2025-09-07T07:33:27.6212299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6212377Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6212442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6212579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6212627Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6212666Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6212855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6212899Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6212935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6213170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6213215Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6213255Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6213416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6213460Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6213496Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6213629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6213716Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6213762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6213887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6215256Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6215301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6215429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6215471Z leaves = list(leaves) 2025-09-07T07:33:27.6215506Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6215629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6215664Z return func(x) 2025-09-07T07:33:27.6215697Z ^^^^^^^ 2025-09-07T07:33:27.6215834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6215898Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6215941Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6216107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6216149Z return func(*args, **kwargs) 2025-09-07T07:33:27.6216205Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6216390Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6216494Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6216496Z 2025-09-07T07:33:27.6216700Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6216703Z 2025-09-07T07:33:27.6216705Z 2025-09-07T07:33:27.6216777Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6216972Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6216975Z 2025-09-07T07:33:27.6217059Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6217136Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6218487Z inline_call [] 2025-09-07T07:33:27.6218548Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6218583Z inductor [] 2025-09-07T07:33:27.6218657Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6218731Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6218986Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6219098Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6219180Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6219332Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6219433Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6219565Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6219684Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6219796Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6219841Z Traceback (most recent call last): 2025-09-07T07:33:27.6219991Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6220026Z self._run_test( 2025-09-07T07:33:27.6220138Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6220192Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6220236Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6220368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6220417Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6220456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6221905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6221952Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6221992Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6222127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6222172Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6222210Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6222377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6222460Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6222513Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6222664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6222711Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6222860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6222914Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6222954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6223175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6223227Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6223268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6223407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6223476Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6223519Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6223644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6225020Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6225064Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6225203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6225249Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6225286Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6225425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6225498Z return aot_autograd( 2025-09-07T07:33:27.6225533Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6225669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6225737Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6225784Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6225943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6226027Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6226073Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6226256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6226301Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6226487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6226527Z fx_g = _create_graph( 2025-09-07T07:33:27.6226562Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6226723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6226758Z fx_g = make_fx( 2025-09-07T07:33:27.6226790Z ^^^^^^^^ 2025-09-07T07:33:27.6228230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6228278Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6228317Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6228484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6228552Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6228588Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6228746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6228784Z t = dispatch_trace( 2025-09-07T07:33:27.6228819Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6228933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6228975Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6229011Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6229136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6229176Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6229212Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6229388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6229467Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6229509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6229632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6229671Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6229706Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6231128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6231171Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6231207Z ^^^^^^^^^ 2025-09-07T07:33:27.6231340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6231383Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6231435Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6231588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6231637Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6231672Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6231830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6231892Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6231936Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6232111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6232150Z outs_pair = fn(*args) 2025-09-07T07:33:27.6232185Z ^^^^^^^^^ 2025-09-07T07:33:27.6232356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6232424Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6232468Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6232640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6232680Z outs_pair = fn(*args) 2025-09-07T07:33:27.6232714Z ^^^^^^^^^ 2025-09-07T07:33:27.6232890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6234305Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6234351Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6234575Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6234663Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6234709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6234881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6234919Z outs_pair = fn(*args) 2025-09-07T07:33:27.6234954Z ^^^^^^^^^ 2025-09-07T07:33:27.6235141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6235187Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6235224Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6235392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6235458Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6235498Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6235623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6235667Z return handle_torch_function( 2025-09-07T07:33:27.6235703Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6235844Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6235918Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6235964Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6236131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6237480Z return func(*args, **kwargs) 2025-09-07T07:33:27.6237540Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6237666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6237707Z result = _engine_run_backward( 2025-09-07T07:33:27.6237744Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6237888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6238012Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6238062Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6238188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6238230Z return user_fn(self, *args) 2025-09-07T07:33:27.6238265Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6238412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6238456Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6238494Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6238650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6238695Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6238731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6238853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6238893Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6238929Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6239091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6239156Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6240490Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6240645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6240694Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6240734Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6240893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6240940Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6240979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6241136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6241174Z t = dispatch_trace( 2025-09-07T07:33:27.6241209Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6241323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6241381Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6241418Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6241541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6241581Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6241615Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6241776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6241853Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6241894Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6242017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6242056Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6242113Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6243677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6243723Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6243759Z ^^^^^^^^^ 2025-09-07T07:33:27.6243905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6243956Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6243990Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6244033Z File "", line 1, in 2025-09-07T07:33:27.6244174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6244253Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6244298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6244436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6244485Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6244523Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6244718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6244762Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6244797Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6244968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6245011Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6245048Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6245219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6245263Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6246642Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6246836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6246925Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6246972Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6247097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6247157Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6247202Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6247326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6247366Z leaves = list(leaves) 2025-09-07T07:33:27.6247403Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6247552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6247588Z return func(x) 2025-09-07T07:33:27.6247622Z ^^^^^^^ 2025-09-07T07:33:27.6247758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6247823Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6247864Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6248032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6248072Z return func(*args, **kwargs) 2025-09-07T07:33:27.6248109Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6248291Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6248398Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6248401Z 2025-09-07T07:33:27.6248604Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6248606Z 2025-09-07T07:33:27.6248608Z 2025-09-07T07:33:27.6249988Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6250182Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6250184Z 2025-09-07T07:33:27.6250271Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6250345Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6250381Z inline_call [] 2025-09-07T07:33:27.6250440Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6250476Z inductor [] 2025-09-07T07:33:27.6250551Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6250624Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6250878Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6250990Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6251069Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6251219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6251302Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6251451Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6251584Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6251655Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6251690Z inline_call [] 2025-09-07T07:33:27.6251747Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6251820Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6251890Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6253519Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6253633Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6253741Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6253892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6253976Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6254107Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6254225Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6254276Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6254387Z _ WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6254433Z Traceback (most recent call last): 2025-09-07T07:33:27.6254580Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1302, in test_while_loop_with_outer_buffers 2025-09-07T07:33:27.6254639Z self._run_test( 2025-09-07T07:33:27.6254750Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6254805Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6254847Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6254979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6255027Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6255065Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6255216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6255264Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6255304Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6255441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6256803Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6256842Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6256986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6257066Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6257105Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6257256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6257302Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6257454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6257529Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6257571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6257732Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6257783Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6257823Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6257938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6258004Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6258048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6258173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6258237Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6258279Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6258439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6258484Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6259822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6259965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6260005Z return aot_autograd( 2025-09-07T07:33:27.6260040Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6260175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6260244Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6260290Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6260452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6260553Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6260599Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6260782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6260824Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6261008Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6261048Z fx_g = _create_graph( 2025-09-07T07:33:27.6261084Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6261245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6261280Z fx_g = make_fx( 2025-09-07T07:33:27.6261312Z ^^^^^^^^ 2025-09-07T07:33:27.6261466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6261513Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6261552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6261698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6263037Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6263144Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6263310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6263347Z t = dispatch_trace( 2025-09-07T07:33:27.6263382Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6263494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6263558Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6263596Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6263738Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6263778Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6263813Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6263974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6264052Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6264094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6264217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6264257Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6264292Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6264418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6264487Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6264524Z ^^^^^^^^^ 2025-09-07T07:33:27.6264656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6266013Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6266049Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6266199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6266248Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6266282Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6266437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6266500Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6266546Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6266742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6266783Z outs_pair = fn(*args) 2025-09-07T07:33:27.6266818Z ^^^^^^^^^ 2025-09-07T07:33:27.6266992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6267059Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6267103Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6267276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6267314Z outs_pair = fn(*args) 2025-09-07T07:33:27.6267348Z ^^^^^^^^^ 2025-09-07T07:33:27.6267526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6267587Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6267630Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6267823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6267895Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6269231Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6269404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6269442Z outs_pair = fn(*args) 2025-09-07T07:33:27.6269478Z ^^^^^^^^^ 2025-09-07T07:33:27.6269683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6269744Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6269780Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6269951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6269997Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6270034Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6270160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6270203Z return handle_torch_function( 2025-09-07T07:33:27.6270239Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6270379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6270454Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6270516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6270683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6270725Z return func(*args, **kwargs) 2025-09-07T07:33:27.6270760Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6270883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6270925Z result = _engine_run_backward( 2025-09-07T07:33:27.6272266Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6272413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6272533Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6272584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6272737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6272778Z return user_fn(self, *args) 2025-09-07T07:33:27.6272815Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6272959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6273003Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6273040Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6273259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6273304Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6273341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6273467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6273507Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6273546Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6273708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6273760Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6273800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6273935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6273984Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6274022Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6275491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6275541Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6275608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6275786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6275824Z t = dispatch_trace( 2025-09-07T07:33:27.6275859Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6275972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6276015Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6276051Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6276176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6276214Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6276250Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6276408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6276488Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6276548Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6276672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6276711Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6276746Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6276872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6276913Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6276948Z ^^^^^^^^^ 2025-09-07T07:33:27.6277096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6278446Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6278480Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6278524Z File "", line 1, in 2025-09-07T07:33:27.6278692Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6278772Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6278818Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6278955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6279003Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6279043Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6279232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6279277Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6279312Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6279483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6279528Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6279565Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6279707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6279750Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6279786Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6279921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6280010Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6280056Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6281476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6281557Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6281616Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6281741Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6281781Z leaves = list(leaves) 2025-09-07T07:33:27.6281815Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6281940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6281974Z return func(x) 2025-09-07T07:33:27.6282008Z ^^^^^^^ 2025-09-07T07:33:27.6282144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6282209Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6282250Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6282432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6282475Z return func(*args, **kwargs) 2025-09-07T07:33:27.6282512Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6282692Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6282776Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6282778Z 2025-09-07T07:33:27.6282982Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6282984Z 2025-09-07T07:33:27.6282986Z 2025-09-07T07:33:27.6283059Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6283374Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6283397Z 2025-09-07T07:33:27.6283485Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6283561Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6284922Z inline_call [] 2025-09-07T07:33:27.6284980Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6285018Z inductor [] 2025-09-07T07:33:27.6285093Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6285165Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6285420Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6285532Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6285614Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6285767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6285851Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6285983Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6286101Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6286171Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6286206Z inline_call [] 2025-09-07T07:33:27.6286262Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6286335Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6286431Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6286744Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6286876Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6286958Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6287112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6288509Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6288640Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6288757Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6288853Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6288890Z inline_call [] 2025-09-07T07:33:27.6288946Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.6289016Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6289086Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6289337Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6289445Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 857, in forward 2025-09-07T07:33:27.6289524Z return torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, a, b]) 2025-09-07T07:33:27.6289674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6289788Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6289917Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6290033Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6290248Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-98c5883bee68f3ae.xml - 2025-09-07T07:33:27.6290305Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6290672Z FAILED [0.2196s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6290758Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6290761Z 2025-09-07T07:33:27.6290967Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6290969Z 2025-09-07T07:33:27.6290971Z 2025-09-07T07:33:27.6291042Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6292545Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6292548Z 2025-09-07T07:33:27.6292632Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6292693Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6292759Z ================== 1 failed, 220 deselected, 2 rerun in 1.19s ================== 2025-09-07T07:33:27.6292813Z Got exit code 1 2025-09-07T07:33:27.6292937Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.6293436Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6293476Z import pkg_resources 2025-09-07T07:33:27.6293645Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-b173c77d67623166.xml 2025-09-07T07:33:27.6293701Z ============================= test session starts ============================== 2025-09-07T07:33:27.6293813Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6293852Z cachedir: .pytest_cache 2025-09-07T07:33:27.6294030Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6294076Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6294116Z configfile: pytest.ini 2025-09-07T07:33:27.6294277Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6294353Z collecting ... collected 467 items / 52 deselected / 415 selected 2025-09-07T07:33:27.6294403Z stepcurrent: skipping 52 already run items. 2025-09-07T07:33:27.6294445Z Running 169 items in this shard 2025-09-07T07:33:27.6294447Z 2025-09-07T07:33:27.6294614Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_False PASSED [2.4068s] [ 0%] 2025-09-07T07:33:27.6294804Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.6017s] [ 1%] 2025-09-07T07:33:27.6295008Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.2705s] [ 1%] 2025-09-07T07:33:27.6296487Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True FAILED [0.2690s] [ 1%] 2025-09-07T07:33:27.6296489Z 2025-09-07T07:33:27.6296539Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6296643Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6296687Z Traceback (most recent call last): 2025-09-07T07:33:27.6296836Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6296871Z self._run_test( 2025-09-07T07:33:27.6296985Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6297041Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6297085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6297219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6297266Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6297305Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6297456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6297502Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6297541Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6297676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6297721Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6297786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6297931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6298030Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6298069Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6299521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6299570Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6299720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6299774Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6299814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6299956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6300011Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6300067Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6300185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6300252Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6300298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6300423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6300489Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6300530Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6300669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6300714Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6300771Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6300909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6300950Z return aot_autograd( 2025-09-07T07:33:27.6300985Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6301120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6301188Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6302532Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6302692Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6302776Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6302821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6303007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6303051Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6303300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6303340Z fx_g = _create_graph( 2025-09-07T07:33:27.6303377Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6303538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6303573Z fx_g = make_fx( 2025-09-07T07:33:27.6303605Z ^^^^^^^^ 2025-09-07T07:33:27.6303755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6303801Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6303864Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6304037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6304080Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6304117Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6304275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6304314Z t = dispatch_trace( 2025-09-07T07:33:27.6304348Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6305766Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6305810Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6305848Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6305972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6306015Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6306072Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6306235Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6306313Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6306355Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6306478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6306518Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6306553Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6306680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6306722Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6306758Z ^^^^^^^^^ 2025-09-07T07:33:27.6306891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6306955Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6306994Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6307141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6307191Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6307225Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6307380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6308739Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6308787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6308964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6309006Z outs_pair = fn(*args) 2025-09-07T07:33:27.6309041Z ^^^^^^^^^ 2025-09-07T07:33:27.6309216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6309282Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6309328Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6309499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6309539Z outs_pair = fn(*args) 2025-09-07T07:33:27.6309573Z ^^^^^^^^^ 2025-09-07T07:33:27.6309750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6309810Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6309876Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6310070Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6310157Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6310203Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6310378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6310416Z outs_pair = fn(*args) 2025-09-07T07:33:27.6310451Z ^^^^^^^^^ 2025-09-07T07:33:27.6310638Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6311979Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6312017Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6312205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6312253Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6312291Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6312417Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6312460Z return handle_torch_function( 2025-09-07T07:33:27.6312497Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6312636Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6312712Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6312757Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6312926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6312985Z return func(*args, **kwargs) 2025-09-07T07:33:27.6313022Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6313206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6313249Z result = _engine_run_backward( 2025-09-07T07:33:27.6313285Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6313430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6313548Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6313598Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6313724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6313767Z return user_fn(self, *args) 2025-09-07T07:33:27.6315122Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6315269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6315313Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6315351Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6315507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6315551Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6315588Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6315715Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6315754Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6315790Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6315978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6316050Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6316091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6316227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6316276Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6316314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6316479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6316527Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6316566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6316723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6316764Z t = dispatch_trace( 2025-09-07T07:33:27.6316798Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6318229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6318272Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6318310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6318433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6318473Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6318508Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6318667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6318745Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6318786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6318910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6318970Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6319005Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6319132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6319173Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6319208Z ^^^^^^^^^ 2025-09-07T07:33:27.6319354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6319404Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6319438Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6319480Z File "", line 1, in 2025-09-07T07:33:27.6319622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6319700Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6321044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6321182Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6321230Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6321269Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6321460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6321503Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6321540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6321708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6321753Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6321806Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6321951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6322010Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6322046Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6322178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6322267Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6322315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6322442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6322502Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6322547Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6322674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6322729Z leaves = list(leaves) 2025-09-07T07:33:27.6322765Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6324265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6324302Z return func(x) 2025-09-07T07:33:27.6324336Z ^^^^^^^ 2025-09-07T07:33:27.6324473Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6324537Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6324578Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6324744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6324785Z return func(*args, **kwargs) 2025-09-07T07:33:27.6324821Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6325027Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6325113Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6325116Z 2025-09-07T07:33:27.6325323Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6325325Z 2025-09-07T07:33:27.6325327Z 2025-09-07T07:33:27.6325400Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6325592Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6325595Z 2025-09-07T07:33:27.6325680Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6325755Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6325792Z inline_call [] 2025-09-07T07:33:27.6325850Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6325924Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6325996Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6326251Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6327739Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6327821Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6327972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6328081Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6328229Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6328349Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6328452Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6328497Z Traceback (most recent call last): 2025-09-07T07:33:27.6328641Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6328676Z self._run_test( 2025-09-07T07:33:27.6328789Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6328844Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6328885Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6329034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6329083Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6329121Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6329271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6329317Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6329356Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6329491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6329536Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6329573Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6331020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6331125Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6331166Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6331317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6331363Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6331511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6331566Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6331605Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6331747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6331798Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6331837Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6331955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6332023Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6332067Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6332193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6332255Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6332296Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6332435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6332480Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6332518Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6332656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6334072Z return aot_autograd( 2025-09-07T07:33:27.6334128Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6334265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6334335Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6334386Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6334545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6334629Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6334674Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6334856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6334901Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6335105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6335147Z fx_g = _create_graph( 2025-09-07T07:33:27.6335183Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6335344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6335380Z fx_g = make_fx( 2025-09-07T07:33:27.6335412Z ^^^^^^^^ 2025-09-07T07:33:27.6335562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6335608Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6335647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6335795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6335855Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6335894Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6337359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6337398Z t = dispatch_trace( 2025-09-07T07:33:27.6337433Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6337547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6337590Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6337625Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6337750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6337790Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6337825Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6337987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6338069Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6338111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6338234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6338274Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6338309Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6338434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6338476Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6338511Z ^^^^^^^^^ 2025-09-07T07:33:27.6338642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6338683Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6338735Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6340184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6340251Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6340286Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6340441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6340503Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6340548Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6340727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6340766Z outs_pair = fn(*args) 2025-09-07T07:33:27.6340802Z ^^^^^^^^^ 2025-09-07T07:33:27.6340972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6341055Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6341102Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6341276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6341315Z outs_pair = fn(*args) 2025-09-07T07:33:27.6341349Z ^^^^^^^^^ 2025-09-07T07:33:27.6341524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6341585Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6341629Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6341821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6341906Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6341952Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6342123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6343523Z outs_pair = fn(*args) 2025-09-07T07:33:27.6343560Z ^^^^^^^^^ 2025-09-07T07:33:27.6343747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6343794Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6343830Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6343997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6344045Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6344084Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6344212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6344255Z return handle_torch_function( 2025-09-07T07:33:27.6344291Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6344432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6344505Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6344552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6344717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6344759Z return func(*args, **kwargs) 2025-09-07T07:33:27.6344794Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6344940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6344998Z result = _engine_run_backward( 2025-09-07T07:33:27.6345034Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6345179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6346600Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6346652Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6346779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6346820Z return user_fn(self, *args) 2025-09-07T07:33:27.6346857Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6347001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6347067Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6347105Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6347261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6347305Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6347341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6347467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6347506Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6347545Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6347707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6347760Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6347819Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6347956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6348005Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6348044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6348203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6348251Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6349583Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6349742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6349780Z t = dispatch_trace( 2025-09-07T07:33:27.6349815Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6349928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6349972Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6350010Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6350135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6350174Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6350209Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6350368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6350447Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6350489Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6350612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6350651Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6350686Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6350835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6350889Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6350924Z ^^^^^^^^^ 2025-09-07T07:33:27.6351073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6351122Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6351156Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6352485Z File "", line 1, in 2025-09-07T07:33:27.6352628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6352707Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6352752Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6352889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6352961Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6353001Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6353230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6353275Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6353310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6353485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6353529Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6353567Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6353708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6353752Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6353814Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6353948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6354037Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6354083Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6354212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6354272Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6355627Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6355754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6355793Z leaves = list(leaves) 2025-09-07T07:33:27.6355828Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6355953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6355988Z return func(x) 2025-09-07T07:33:27.6356022Z ^^^^^^^ 2025-09-07T07:33:27.6356158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6356223Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6356265Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6356430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6356471Z return func(*args, **kwargs) 2025-09-07T07:33:27.6356508Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6356687Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6356791Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6356810Z 2025-09-07T07:33:27.6357014Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6357017Z 2025-09-07T07:33:27.6357018Z 2025-09-07T07:33:27.6357091Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6357282Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6357285Z 2025-09-07T07:33:27.6357370Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6357443Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6357479Z inline_call [] 2025-09-07T07:33:27.6357535Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6358910Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6359006Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6359265Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6359377Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6359454Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6359603Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6359689Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6359822Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6359961Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6360032Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6360070Z inline_call [] 2025-09-07T07:33:27.6360125Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6360198Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6360267Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6360520Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6360629Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6360705Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6360854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6360940Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6361071Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6361190Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6362540Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6362645Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6362690Z Traceback (most recent call last): 2025-09-07T07:33:27.6362836Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6362888Z self._run_test( 2025-09-07T07:33:27.6363004Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6363146Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6363188Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6363319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6363365Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6363405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6363555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6363601Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6363639Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6363775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6363821Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6363881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6364023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6364104Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6364142Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6364293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6364339Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6365800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6365855Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6365896Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6366062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6366116Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6366155Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6366271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6366337Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6366383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6366508Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6366572Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6366613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6366812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6366860Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6366899Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6367035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6367074Z return aot_autograd( 2025-09-07T07:33:27.6367109Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6367244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6367314Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6367359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6368824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6368908Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6368979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6369184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6369228Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6369411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6369451Z fx_g = _create_graph( 2025-09-07T07:33:27.6369486Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6369647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6369682Z fx_g = make_fx( 2025-09-07T07:33:27.6369715Z ^^^^^^^^ 2025-09-07T07:33:27.6369866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6369949Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6369989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6370137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6370179Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6370215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6370372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6370411Z t = dispatch_trace( 2025-09-07T07:33:27.6370445Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6370557Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6370598Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6371928Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6372074Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6372116Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6372152Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6372317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6372397Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6372438Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6372564Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6372602Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6372638Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6372762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6372805Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6372841Z ^^^^^^^^^ 2025-09-07T07:33:27.6372975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6373016Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6373052Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6373285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6373336Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6373370Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6373526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6373589Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6374942Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6375144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6375208Z outs_pair = fn(*args) 2025-09-07T07:33:27.6375243Z ^^^^^^^^^ 2025-09-07T07:33:27.6375413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6375479Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6375525Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6375697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6375735Z outs_pair = fn(*args) 2025-09-07T07:33:27.6375770Z ^^^^^^^^^ 2025-09-07T07:33:27.6375948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6376012Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6376073Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6376268Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6376338Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6376383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6376553Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6376592Z outs_pair = fn(*args) 2025-09-07T07:33:27.6376626Z ^^^^^^^^^ 2025-09-07T07:33:27.6376814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6376880Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6376919Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6378386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6378435Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6378472Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6378598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6378640Z return handle_torch_function( 2025-09-07T07:33:27.6378678Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6378816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6378891Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6378938Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6379107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6379149Z return func(*args, **kwargs) 2025-09-07T07:33:27.6379185Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6379309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6379352Z result = _engine_run_backward( 2025-09-07T07:33:27.6379388Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6379533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6379651Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6379701Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6379843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6379900Z return user_fn(self, *args) 2025-09-07T07:33:27.6379936Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6381370Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6381414Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6381452Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6381610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6381656Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6381691Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6381814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6381855Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6381892Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6382073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6382126Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6382167Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6382301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6382351Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6382389Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6382551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6382598Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6382638Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6382795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6382853Z t = dispatch_trace( 2025-09-07T07:33:27.6382887Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6383000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6384407Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6384446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6384571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6384611Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6384646Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6384804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6384882Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6384925Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6385049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6385089Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6385124Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6385249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6385291Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6385325Z ^^^^^^^^^ 2025-09-07T07:33:27.6385474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6385522Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6385557Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6385599Z File "", line 1, in 2025-09-07T07:33:27.6385769Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6385850Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6385915Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6386053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6387403Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6387443Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6387633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6387676Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6387712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6387880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6387927Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6387989Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6388134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6388177Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6388213Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6388345Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6388433Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6388479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6388606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6388669Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6388730Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6388857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6388896Z leaves = list(leaves) 2025-09-07T07:33:27.6388932Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6389053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6390386Z return func(x) 2025-09-07T07:33:27.6390420Z ^^^^^^^ 2025-09-07T07:33:27.6390558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6390622Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6390665Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6390830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6390874Z return func(*args, **kwargs) 2025-09-07T07:33:27.6390911Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6391093Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6391177Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6391179Z 2025-09-07T07:33:27.6391389Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6391391Z 2025-09-07T07:33:27.6391393Z 2025-09-07T07:33:27.6391466Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6391657Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6391659Z 2025-09-07T07:33:27.6391763Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6391854Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6391889Z inline_call [] 2025-09-07T07:33:27.6391947Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6392020Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6392092Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6392346Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6392458Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6392533Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6394048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6394160Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6394293Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6394412Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6394483Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6394519Z inline_call [] 2025-09-07T07:33:27.6394576Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6394648Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6394718Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6394970Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6395101Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6395175Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6395324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6395408Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6395538Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6395655Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6395724Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6395759Z inline_call [] 2025-09-07T07:33:27.6395817Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6395889Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6395958Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6397521Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6397633Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6397706Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6397854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6397936Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6398098Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6398233Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6398447Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-b173c77d67623166.xml - 2025-09-07T07:33:27.6398504Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6398860Z FAILED [0.2690s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6398943Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6398945Z 2025-09-07T07:33:27.6399166Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6399170Z 2025-09-07T07:33:27.6399172Z 2025-09-07T07:33:27.6399243Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6399434Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6399436Z 2025-09-07T07:33:27.6399521Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6399582Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6399653Z ============= 1 failed, 1 passed, 52 deselected, 2 rerun in 3.75s ============== 2025-09-07T07:33:27.6399689Z Got exit code 1 2025-09-07T07:33:27.6399727Z Retrying single test... 2025-09-07T07:33:27.6400155Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6400211Z import pkg_resources 2025-09-07T07:33:27.6401687Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-e06efff6315965a7.xml 2025-09-07T07:33:27.6401745Z ============================= test session starts ============================== 2025-09-07T07:33:27.6401858Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6401897Z cachedir: .pytest_cache 2025-09-07T07:33:27.6402056Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6402100Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6402142Z configfile: pytest.ini 2025-09-07T07:33:27.6402302Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6402380Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.6402601Z stepcurrent: skipping 53 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6402645Z Running 1 items in this shard 2025-09-07T07:33:27.6402647Z 2025-09-07T07:33:27.6402836Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.4578s] [100%] 2025-09-07T07:33:27.6403023Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.2735s] [100%] 2025-09-07T07:33:27.6403273Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True FAILED [0.2690s] [100%] 2025-09-07T07:33:27.6403295Z 2025-09-07T07:33:27.6403346Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6403452Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6403496Z Traceback (most recent call last): 2025-09-07T07:33:27.6403643Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6403679Z self._run_test( 2025-09-07T07:33:27.6403791Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6403847Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6403889Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6405333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6405404Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6405447Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6405598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6405645Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6405683Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6405820Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6405864Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6405902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6406044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6406126Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6406183Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6406337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6406383Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6406533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6406586Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6406627Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6406813Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6406866Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6406907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6407023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6408397Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6408445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6408572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6408636Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6408678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6408821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6408867Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6408904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6409041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6409080Z return aot_autograd( 2025-09-07T07:33:27.6409136Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6409273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6409358Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6409403Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6409563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6409646Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6409694Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6409877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6409921Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6410123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6410166Z fx_g = _create_graph( 2025-09-07T07:33:27.6410201Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6411668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6411704Z fx_g = make_fx( 2025-09-07T07:33:27.6411737Z ^^^^^^^^ 2025-09-07T07:33:27.6411887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6411934Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6411972Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6412118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6412162Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6412219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6412382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6412420Z t = dispatch_trace( 2025-09-07T07:33:27.6412455Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6412568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6412611Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6412646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6412771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6412811Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6412847Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6413006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6413142Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6413186Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6414624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6414664Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6414700Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6414826Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6414869Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6414903Z ^^^^^^^^^ 2025-09-07T07:33:27.6415036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6415076Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6415113Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6415286Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6415355Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6415389Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6415544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6415608Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6415653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6415827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6415866Z outs_pair = fn(*args) 2025-09-07T07:33:27.6415902Z ^^^^^^^^^ 2025-09-07T07:33:27.6416071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6416141Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6416204Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6416377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6417714Z outs_pair = fn(*args) 2025-09-07T07:33:27.6417751Z ^^^^^^^^^ 2025-09-07T07:33:27.6417928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6417988Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6418030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6418226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6418298Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6418372Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6418544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6418584Z outs_pair = fn(*args) 2025-09-07T07:33:27.6418619Z ^^^^^^^^^ 2025-09-07T07:33:27.6418810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6418855Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6418893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6419059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6419106Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6419144Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6419271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6419315Z return handle_torch_function( 2025-09-07T07:33:27.6419352Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6419492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6420867Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6420914Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6421082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6421123Z return func(*args, **kwargs) 2025-09-07T07:33:27.6421159Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6421301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6421345Z result = _engine_run_backward( 2025-09-07T07:33:27.6421399Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6421544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6421666Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6421716Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6421842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6421884Z return user_fn(self, *args) 2025-09-07T07:33:27.6421921Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6422064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6422111Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6422160Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6422319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6422363Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6422400Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6422522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6422563Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6423984Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6424150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6424203Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6424244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6424380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6424457Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6424496Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6424656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6424703Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6424742Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6424899Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6424938Z t = dispatch_trace( 2025-09-07T07:33:27.6424972Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6425086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6425129Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6425167Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6425293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6425332Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6425369Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6425527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6425606Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6425647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6427081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6427121Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6427156Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6427303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6427347Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6427400Z ^^^^^^^^^ 2025-09-07T07:33:27.6427549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6427599Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6427633Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6427675Z File "", line 1, in 2025-09-07T07:33:27.6427818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6427895Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6427941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6428076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6428125Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6428180Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6428377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6428421Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6428456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6428626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6428670Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6430003Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6430146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6430190Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6430226Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6430379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6430468Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6430515Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6430642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6430703Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6430746Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6430871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6430910Z leaves = list(leaves) 2025-09-07T07:33:27.6430945Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6431066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6431102Z return func(x) 2025-09-07T07:33:27.6431137Z ^^^^^^^ 2025-09-07T07:33:27.6431273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6431337Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6431379Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6431544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6431585Z return func(*args, **kwargs) 2025-09-07T07:33:27.6431621Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6433166Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6433253Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6433256Z 2025-09-07T07:33:27.6433483Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6433504Z 2025-09-07T07:33:27.6433506Z 2025-09-07T07:33:27.6433579Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6433770Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6433772Z 2025-09-07T07:33:27.6433861Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6433937Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6433972Z inline_call [] 2025-09-07T07:33:27.6434029Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6434063Z inductor [] 2025-09-07T07:33:27.6434138Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6434227Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6434484Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6434595Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6434672Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6434821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6434907Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6435038Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6435177Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6435283Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6435328Z Traceback (most recent call last): 2025-09-07T07:33:27.6436787Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6436825Z self._run_test( 2025-09-07T07:33:27.6436938Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6436994Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6437035Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6437165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6437212Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6437252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6437405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6437452Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6437492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6437627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6437671Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6437709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6437852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6437932Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6437974Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6438141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6438205Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6438353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6438407Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6438447Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6439893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6439947Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6439990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6440106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6440172Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6440218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6440368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6440433Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6440476Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6440614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6440659Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6440696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6440831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6440871Z return aot_autograd( 2025-09-07T07:33:27.6440906Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6441044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6441129Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6441177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6441337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6441419Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6441464Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6442941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6442986Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6443236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6443278Z fx_g = _create_graph( 2025-09-07T07:33:27.6443314Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6443480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6443515Z fx_g = make_fx( 2025-09-07T07:33:27.6443547Z ^^^^^^^^ 2025-09-07T07:33:27.6443698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6443745Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6443784Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6443930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6443974Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6444010Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6444194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6444253Z t = dispatch_trace( 2025-09-07T07:33:27.6444288Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6444399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6444441Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6444478Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6444601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6444642Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6445985Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6446151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6446230Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6446273Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6446419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6446460Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6446495Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6446626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6446668Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6446744Z ^^^^^^^^^ 2025-09-07T07:33:27.6446878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6446919Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6446954Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6447102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6447152Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6447205Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6447362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6447425Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6447469Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6447643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6447681Z outs_pair = fn(*args) 2025-09-07T07:33:27.6449020Z ^^^^^^^^^ 2025-09-07T07:33:27.6449194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6449262Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6449306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6449482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6449521Z outs_pair = fn(*args) 2025-09-07T07:33:27.6449555Z ^^^^^^^^^ 2025-09-07T07:33:27.6449731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6449791Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6449834Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6450031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6450102Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6450147Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6450341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6450393Z outs_pair = fn(*args) 2025-09-07T07:33:27.6450428Z ^^^^^^^^^ 2025-09-07T07:33:27.6450616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6450662Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6450698Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6450869Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6450914Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6450952Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6452374Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6452421Z return handle_torch_function( 2025-09-07T07:33:27.6452476Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6452618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6452694Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6452740Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6452909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6452951Z return func(*args, **kwargs) 2025-09-07T07:33:27.6452987Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6453166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6453209Z result = _engine_run_backward( 2025-09-07T07:33:27.6453247Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6453412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6453537Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6453587Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6453714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6453755Z return user_fn(self, *args) 2025-09-07T07:33:27.6453790Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6453934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6453977Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6454015Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6454173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6455548Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6455585Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6455709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6455748Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6455785Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6455949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6456002Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6456044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6456183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6456253Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6456295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6456474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6456522Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6456561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6456720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6456758Z t = dispatch_trace( 2025-09-07T07:33:27.6456793Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6456905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6456948Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6456984Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6457109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6458470Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6458510Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6458670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6458749Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6458790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6458913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6458953Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6458987Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6459114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6459156Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6459191Z ^^^^^^^^^ 2025-09-07T07:33:27.6459355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6459405Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6459439Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6459482Z File "", line 1, in 2025-09-07T07:33:27.6459625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6459703Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6459748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6459885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6459932Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6459971Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6460163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6461506Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6461542Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6461712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6461755Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6461793Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6461934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6461978Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6462013Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6462145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6462256Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6462324Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6462449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6462509Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6462553Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6462680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6462720Z leaves = list(leaves) 2025-09-07T07:33:27.6462754Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6462877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6462911Z return func(x) 2025-09-07T07:33:27.6462945Z ^^^^^^^ 2025-09-07T07:33:27.6463176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6464550Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6464592Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6464767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6464808Z return func(*args, **kwargs) 2025-09-07T07:33:27.6464844Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6465026Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6465111Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6465113Z 2025-09-07T07:33:27.6465320Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6465350Z 2025-09-07T07:33:27.6465352Z 2025-09-07T07:33:27.6465426Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6465615Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6465617Z 2025-09-07T07:33:27.6465704Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6465776Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6465812Z inline_call [] 2025-09-07T07:33:27.6465868Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6465903Z inductor [] 2025-09-07T07:33:27.6465977Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6466049Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6466306Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6466417Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6466493Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6466648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6466733Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6468168Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6468288Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6468382Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6468434Z inline_call [] 2025-09-07T07:33:27.6468492Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6468564Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6468635Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6468887Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6468997Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6469071Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6469220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6469305Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6469449Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6469566Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6469617Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6469719Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6469764Z Traceback (most recent call last): 2025-09-07T07:33:27.6469910Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6469946Z self._run_test( 2025-09-07T07:33:27.6470059Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6470114Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6471470Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6471609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6471655Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6471694Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6471846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6471892Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6471931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6472068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6472113Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6472151Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6472295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6472377Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6472417Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6472567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6472614Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6472763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6472817Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6472857Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6472998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6473049Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6473172Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6473306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6474684Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6474731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6474858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6474921Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6474963Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6475101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6475147Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6475184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6475343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6475384Z return aot_autograd( 2025-09-07T07:33:27.6475419Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6475554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6475622Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6475669Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6475828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6475912Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6475957Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6476142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6476206Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6476391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6476430Z fx_g = _create_graph( 2025-09-07T07:33:27.6477762Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6477925Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6477961Z fx_g = make_fx( 2025-09-07T07:33:27.6477994Z ^^^^^^^^ 2025-09-07T07:33:27.6478144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6478191Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6478230Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6478378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6478423Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6478459Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6478617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6478655Z t = dispatch_trace( 2025-09-07T07:33:27.6478692Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6478806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6478849Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6478884Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6479011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6479052Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6479106Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6479269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6479365Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6479407Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6480831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6480872Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6480907Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6481033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6481074Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6481110Z ^^^^^^^^^ 2025-09-07T07:33:27.6481240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6481284Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6481336Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6481486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6481536Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6481571Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6481725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6481789Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6481834Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6482009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6482048Z outs_pair = fn(*args) 2025-09-07T07:33:27.6482083Z ^^^^^^^^^ 2025-09-07T07:33:27.6482272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6482339Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6482383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6483944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6483985Z outs_pair = fn(*args) 2025-09-07T07:33:27.6484020Z ^^^^^^^^^ 2025-09-07T07:33:27.6484197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6484258Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6484301Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6484497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6484569Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6484614Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6484789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6484827Z outs_pair = fn(*args) 2025-09-07T07:33:27.6484862Z ^^^^^^^^^ 2025-09-07T07:33:27.6485049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6485095Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6485132Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6485334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6485398Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6485436Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6485560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6485604Z return handle_torch_function( 2025-09-07T07:33:27.6485640Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6485782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6487229Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6487278Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6487451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6487495Z return func(*args, **kwargs) 2025-09-07T07:33:27.6487531Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6487681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6487724Z result = _engine_run_backward( 2025-09-07T07:33:27.6487761Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6487905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6488027Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6488078Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6488203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6488245Z return user_fn(self, *args) 2025-09-07T07:33:27.6488284Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6488446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6488491Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6488528Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6488684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6488730Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6488766Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6488889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6488929Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6490276Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6490441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6490496Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6490538Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6490674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6490724Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6490763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6490923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6490971Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6491009Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6491166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6491204Z t = dispatch_trace( 2025-09-07T07:33:27.6491240Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6491371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6491450Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6491486Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6491610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6491649Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6491683Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6491842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6491921Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6493331Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6493458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6493499Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6493534Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6493688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6493730Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6493766Z ^^^^^^^^^ 2025-09-07T07:33:27.6493913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6493964Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6493997Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6494040Z File "", line 1, in 2025-09-07T07:33:27.6494181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6494260Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6494307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6494464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6494512Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6494552Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6494742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6494786Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6494822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6494991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6495036Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6496377Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6496523Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6496569Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6496605Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6496739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6496826Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6496874Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6496998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6497058Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6497102Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6497227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6497292Z leaves = list(leaves) 2025-09-07T07:33:27.6497327Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6497467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6497502Z return func(x) 2025-09-07T07:33:27.6497535Z ^^^^^^^ 2025-09-07T07:33:27.6497672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6497737Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6497779Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6497945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6497985Z return func(*args, **kwargs) 2025-09-07T07:33:27.6499327Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6499511Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6499621Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6499623Z 2025-09-07T07:33:27.6499828Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6499831Z 2025-09-07T07:33:27.6499832Z 2025-09-07T07:33:27.6499906Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6500097Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6500099Z 2025-09-07T07:33:27.6500185Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6500258Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6500313Z inline_call [] 2025-09-07T07:33:27.6500369Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6500405Z inductor [] 2025-09-07T07:33:27.6500479Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6500550Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6500810Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6500921Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6500996Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6501146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6501232Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6501364Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6501483Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6501553Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6501588Z inline_call [] 2025-09-07T07:33:27.6502944Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6503018Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6503168Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6503424Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6503563Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6503656Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6503805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6503888Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6504017Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6504134Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6504205Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6504239Z inline_call [] 2025-09-07T07:33:27.6504295Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6504367Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6504456Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6504708Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6504817Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6504890Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6505037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6505121Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6505250Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6506685Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6506934Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-e06efff6315965a7.xml - 2025-09-07T07:33:27.6506992Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6507347Z FAILED [0.2690s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6507429Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6507431Z 2025-09-07T07:33:27.6507637Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6507641Z 2025-09-07T07:33:27.6507643Z 2025-09-07T07:33:27.6507716Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6507909Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6507911Z 2025-09-07T07:33:27.6507995Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6508055Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6508121Z ================== 1 failed, 220 deselected, 2 rerun in 1.19s ================== 2025-09-07T07:33:27.6508156Z Got exit code 1 2025-09-07T07:33:27.6508195Z Retrying single test... 2025-09-07T07:33:27.6508630Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6508684Z import pkg_resources 2025-09-07T07:33:27.6508852Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-e82845b3b905142e.xml 2025-09-07T07:33:27.6508907Z ============================= test session starts ============================== 2025-09-07T07:33:27.6509019Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6509059Z cachedir: .pytest_cache 2025-09-07T07:33:27.6509215Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6509260Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6510602Z configfile: pytest.ini 2025-09-07T07:33:27.6510765Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6510857Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.6511081Z stepcurrent: skipping 53 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6511124Z Running 1 items in this shard 2025-09-07T07:33:27.6511126Z 2025-09-07T07:33:27.6511315Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.4515s] [100%] 2025-09-07T07:33:27.6511503Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.2743s] [100%] 2025-09-07T07:33:27.6511664Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True FAILED [0.2654s] [100%] 2025-09-07T07:33:27.6511666Z 2025-09-07T07:33:27.6511730Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6511835Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6511880Z Traceback (most recent call last): 2025-09-07T07:33:27.6512029Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6512065Z self._run_test( 2025-09-07T07:33:27.6512177Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6512234Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6512276Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6512410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6512456Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6512498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6512650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6512698Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6512737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6514273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6514321Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6514359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6514501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6514582Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6514620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6514798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6514865Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6515015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6515070Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6515110Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6515253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6515304Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6515344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6515460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6515527Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6515572Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6515716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6515780Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6515823Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6515961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6517319Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6517359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6517497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6517536Z return aot_autograd( 2025-09-07T07:33:27.6517571Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6517708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6517806Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6517853Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6518016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6518099Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6518145Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6518326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6518370Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6518554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6518597Z fx_g = _create_graph( 2025-09-07T07:33:27.6518633Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6518797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6518831Z fx_g = make_fx( 2025-09-07T07:33:27.6518864Z ^^^^^^^^ 2025-09-07T07:33:27.6519015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6519061Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6519100Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6520545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6520590Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6520627Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6520805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6520859Z t = dispatch_trace( 2025-09-07T07:33:27.6520894Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6521006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6521049Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6521084Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6521209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6521249Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6521286Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6521447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6521526Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6521568Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6521709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6521749Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6521785Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6521910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6521953Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6521988Z ^^^^^^^^^ 2025-09-07T07:33:27.6523479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6523523Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6523560Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6523708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6523758Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6523818Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6523974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6524039Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6524084Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6524257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6524296Z outs_pair = fn(*args) 2025-09-07T07:33:27.6524332Z ^^^^^^^^^ 2025-09-07T07:33:27.6524502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6524569Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6524613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6524787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6524826Z outs_pair = fn(*args) 2025-09-07T07:33:27.6524861Z ^^^^^^^^^ 2025-09-07T07:33:27.6525037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6525098Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6525140Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6525333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6526766Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6526813Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6527013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6527069Z outs_pair = fn(*args) 2025-09-07T07:33:27.6527104Z ^^^^^^^^^ 2025-09-07T07:33:27.6527292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6527338Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6527375Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6527542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6527589Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6527625Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6527750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6527795Z return handle_torch_function( 2025-09-07T07:33:27.6527854Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6527996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6528070Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6528117Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6528283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6528326Z return func(*args, **kwargs) 2025-09-07T07:33:27.6528361Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6528485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6528526Z result = _engine_run_backward( 2025-09-07T07:33:27.6529879Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6530045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6530167Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6530217Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6530345Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6530387Z return user_fn(self, *args) 2025-09-07T07:33:27.6530424Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6530566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6530610Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6530648Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6530807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6530852Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6530889Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6531012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6531053Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6531088Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6531251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6531302Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6531343Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6531478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6531543Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6532886Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6533128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6533177Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6533217Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6533377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6533415Z t = dispatch_trace( 2025-09-07T07:33:27.6533450Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6533563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6533607Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6533642Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6533770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6533832Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6533870Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6534027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6534106Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6534147Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6534271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6534310Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6534345Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6534469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6534511Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6534545Z ^^^^^^^^^ 2025-09-07T07:33:27.6536025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6536077Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6536112Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6536154Z File "", line 1, in 2025-09-07T07:33:27.6536299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6536378Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6536425Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6536563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6536610Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6536649Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6536839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6536884Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6536920Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6537089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6537133Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6537171Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6537312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6537356Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6537392Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6537526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6537638Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6539005Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6539132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6539193Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6539236Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6539362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6539401Z leaves = list(leaves) 2025-09-07T07:33:27.6539436Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6539558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6539594Z return func(x) 2025-09-07T07:33:27.6539627Z ^^^^^^^ 2025-09-07T07:33:27.6539785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6539852Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6539893Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6540059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6540100Z return func(*args, **kwargs) 2025-09-07T07:33:27.6540137Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6540318Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6540405Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6540407Z 2025-09-07T07:33:27.6540612Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6540629Z 2025-09-07T07:33:27.6540632Z 2025-09-07T07:33:27.6540705Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6540897Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6540899Z 2025-09-07T07:33:27.6540984Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6542364Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6542401Z inline_call [] 2025-09-07T07:33:27.6542458Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6542492Z inductor [] 2025-09-07T07:33:27.6542568Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6542639Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6542897Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6543010Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6543178Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6543332Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6543417Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6543548Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6543666Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6543796Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6543860Z Traceback (most recent call last): 2025-09-07T07:33:27.6544005Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6544040Z self._run_test( 2025-09-07T07:33:27.6544152Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6544207Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6544248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6544379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6545745Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6545786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6545938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6545985Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6546050Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6546187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6546233Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6546270Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6546412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6546492Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6546531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6546684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6546730Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6546900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6546956Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6546996Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6547137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6547188Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6547228Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6547344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6547409Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6547454Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6548881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6548949Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6548993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6549133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6549177Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6549215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6549352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6549391Z return aot_autograd( 2025-09-07T07:33:27.6549427Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6549563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6549632Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6549696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6549861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6549965Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6550010Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6550194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6550237Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6550422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6550461Z fx_g = _create_graph( 2025-09-07T07:33:27.6550497Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6550660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6552011Z fx_g = make_fx( 2025-09-07T07:33:27.6552046Z ^^^^^^^^ 2025-09-07T07:33:27.6552198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6552243Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6552283Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6552427Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6552471Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6552507Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6552664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6552702Z t = dispatch_trace( 2025-09-07T07:33:27.6552737Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6552865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6552908Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6552944Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6553127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6553168Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6553204Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6553366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6553445Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6553486Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6553609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6553649Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6554988Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6555118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6555160Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6555196Z ^^^^^^^^^ 2025-09-07T07:33:27.6555327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6555369Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6555404Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6555552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6555602Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6555636Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6555813Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6555879Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6555941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6556114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6556154Z outs_pair = fn(*args) 2025-09-07T07:33:27.6556189Z ^^^^^^^^^ 2025-09-07T07:33:27.6556360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6556426Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6556471Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6556644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6556684Z outs_pair = fn(*args) 2025-09-07T07:33:27.6556742Z ^^^^^^^^^ 2025-09-07T07:33:27.6558223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6558284Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6558327Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6558519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6558589Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6558635Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6558805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6558867Z outs_pair = fn(*args) 2025-09-07T07:33:27.6558904Z ^^^^^^^^^ 2025-09-07T07:33:27.6559093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6559138Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6559175Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6559342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6559389Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6559427Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6559552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6559595Z return handle_torch_function( 2025-09-07T07:33:27.6559631Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6559774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6559849Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6559896Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6561357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6561401Z return func(*args, **kwargs) 2025-09-07T07:33:27.6561437Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6561560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6561603Z result = _engine_run_backward( 2025-09-07T07:33:27.6561640Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6561786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6561926Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6561991Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6562116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6562158Z return user_fn(self, *args) 2025-09-07T07:33:27.6562193Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6562336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6562379Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6562417Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6562573Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6562619Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6562656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6562795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6562835Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6562871Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6563038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6564461Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6564503Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6564640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6564689Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6564728Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6564889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6564963Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6565002Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6565159Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6565197Z t = dispatch_trace( 2025-09-07T07:33:27.6565232Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6565345Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6565388Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6565424Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6565547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6565587Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6565623Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6565785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6565863Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6565904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6566027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6567417Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6567454Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6567581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6567622Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6567658Z ^^^^^^^^^ 2025-09-07T07:33:27.6567809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6567883Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6567936Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6567979Z File "", line 1, in 2025-09-07T07:33:27.6568121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6568200Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6568245Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6568380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6568427Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6568466Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6568655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6568701Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6568754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6568923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6568967Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6569004Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6569145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6570491Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6570529Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6570661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6570750Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6570798Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6570943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6571003Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6571050Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6571175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6571215Z leaves = list(leaves) 2025-09-07T07:33:27.6571249Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6571371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6571406Z return func(x) 2025-09-07T07:33:27.6571440Z ^^^^^^^ 2025-09-07T07:33:27.6571576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6571642Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6571686Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6571853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6571893Z return func(*args, **kwargs) 2025-09-07T07:33:27.6571930Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6572110Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6573541Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6573544Z 2025-09-07T07:33:27.6573752Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6573754Z 2025-09-07T07:33:27.6573756Z 2025-09-07T07:33:27.6573862Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6574055Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6574075Z 2025-09-07T07:33:27.6574162Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6574235Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6574271Z inline_call [] 2025-09-07T07:33:27.6574326Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6574361Z inductor [] 2025-09-07T07:33:27.6574435Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6574508Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6574767Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6574897Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6574975Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6575125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6575210Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6575341Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6575459Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6575529Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6575564Z inline_call [] 2025-09-07T07:33:27.6575622Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6575713Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6577096Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6577349Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6577459Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6577533Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6577681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6577765Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6577896Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6578016Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6578069Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6578171Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6578217Z Traceback (most recent call last): 2025-09-07T07:33:27.6578361Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6578396Z self._run_test( 2025-09-07T07:33:27.6578509Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6578564Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6578605Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6578752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6578815Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6578855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6579005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6579051Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6580389Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6580526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6580572Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6580609Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6580751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6580832Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6580890Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6581043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6581089Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6581240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6581294Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6581335Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6581478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6581530Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6581569Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6581687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6581771Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6581815Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6581939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6582003Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6582044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6582182Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6583587Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6583626Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6583764Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6583805Z return aot_autograd( 2025-09-07T07:33:27.6583841Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6583980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6584049Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6584096Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6584255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6584339Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6584384Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6584566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6584609Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6584824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6584881Z fx_g = _create_graph( 2025-09-07T07:33:27.6584917Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6585078Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6585113Z fx_g = make_fx( 2025-09-07T07:33:27.6585145Z ^^^^^^^^ 2025-09-07T07:33:27.6585295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6585341Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6586686Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6586832Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6586879Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6586936Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6587096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6587133Z t = dispatch_trace( 2025-09-07T07:33:27.6587168Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6587282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6587324Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6587360Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6587483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6587524Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6587560Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6587723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6587826Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6587869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6587992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6588031Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6588066Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6588194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6588236Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6588272Z ^^^^^^^^^ 2025-09-07T07:33:27.6589701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6589744Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6589779Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6589932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6589982Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6590016Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6590171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6590234Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6590278Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6590451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6590489Z outs_pair = fn(*args) 2025-09-07T07:33:27.6590525Z ^^^^^^^^^ 2025-09-07T07:33:27.6590712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6590781Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6590842Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6591014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6591053Z outs_pair = fn(*args) 2025-09-07T07:33:27.6591087Z ^^^^^^^^^ 2025-09-07T07:33:27.6591263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6591323Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6591366Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6591563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6592945Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6593011Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6593248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6593287Z outs_pair = fn(*args) 2025-09-07T07:33:27.6593323Z ^^^^^^^^^ 2025-09-07T07:33:27.6593510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6593556Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6593593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6593760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6593806Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6593872Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6593998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6594042Z return handle_torch_function( 2025-09-07T07:33:27.6594079Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6594218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6594293Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6594339Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6594504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6594545Z return func(*args, **kwargs) 2025-09-07T07:33:27.6594581Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6594704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6596065Z result = _engine_run_backward( 2025-09-07T07:33:27.6596104Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6596249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6596370Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6596420Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6596547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6596589Z return user_fn(self, *args) 2025-09-07T07:33:27.6596625Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6596790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6596834Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6596895Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6597051Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6597096Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6597132Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6597256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6597296Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6597332Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6597494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6597546Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6597586Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6597742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6597794Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6599134Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6599295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6599343Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6599382Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6599542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6599580Z t = dispatch_trace( 2025-09-07T07:33:27.6599615Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6599730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6599797Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6599835Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6599960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6599999Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6600033Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6600192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6600269Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6600311Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6600434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6600474Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6600508Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6600635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6600679Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6602011Z ^^^^^^^^^ 2025-09-07T07:33:27.6602164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6602214Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6602248Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6602291Z File "", line 1, in 2025-09-07T07:33:27.6602432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6602510Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6602555Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6602709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6602759Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6602813Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6603007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6603051Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6603149Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6603319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6603363Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6603400Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6603542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6603584Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6603622Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6603781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6603872Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6605277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6605405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6605465Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6605509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6605634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6605673Z leaves = list(leaves) 2025-09-07T07:33:27.6605708Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6605833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6605911Z return func(x) 2025-09-07T07:33:27.6605945Z ^^^^^^^ 2025-09-07T07:33:27.6606081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6606147Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6606188Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6606359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6606400Z return func(*args, **kwargs) 2025-09-07T07:33:27.6606436Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6606615Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6606749Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6606752Z 2025-09-07T07:33:27.6606957Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6606960Z 2025-09-07T07:33:27.6606962Z 2025-09-07T07:33:27.6607035Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6607226Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6607228Z 2025-09-07T07:33:27.6608626Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6608700Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6608737Z inline_call [] 2025-09-07T07:33:27.6608793Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6608827Z inductor [] 2025-09-07T07:33:27.6608931Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6609022Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6609275Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6609388Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6609463Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6609613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6609697Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6609830Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6609970Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6610042Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6610077Z inline_call [] 2025-09-07T07:33:27.6610135Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6610206Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6610276Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6610527Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6610637Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6610713Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6612184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6612270Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6612400Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6612516Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6612585Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6612620Z inline_call [] 2025-09-07T07:33:27.6612675Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6612746Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6612816Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6613135Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6613243Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6613318Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6613464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6613548Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6613677Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6613793Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6614044Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-e82845b3b905142e.xml - 2025-09-07T07:33:27.6614121Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6614474Z FAILED [0.2654s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6614558Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6614560Z 2025-09-07T07:33:27.6614764Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6614766Z 2025-09-07T07:33:27.6614768Z 2025-09-07T07:33:27.6616158Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6616377Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True 2025-09-07T07:33:27.6616381Z 2025-09-07T07:33:27.6616466Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6616526Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6616591Z ================== 1 failed, 220 deselected, 2 rerun in 1.17s ================== 2025-09-07T07:33:27.6616628Z Got exit code 1 2025-09-07T07:33:27.6616751Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.6617175Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6617256Z import pkg_resources 2025-09-07T07:33:27.6617426Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-1222d0350e88758d.xml 2025-09-07T07:33:27.6617481Z ============================= test session starts ============================== 2025-09-07T07:33:27.6617592Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6617632Z cachedir: .pytest_cache 2025-09-07T07:33:27.6617787Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6617832Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6617871Z configfile: pytest.ini 2025-09-07T07:33:27.6618030Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6618106Z collecting ... collected 467 items / 54 deselected / 413 selected 2025-09-07T07:33:27.6618158Z stepcurrent: skipping 54 already run items. 2025-09-07T07:33:27.6618202Z Running 167 items in this shard 2025-09-07T07:33:27.6618204Z 2025-09-07T07:33:27.6618397Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.6753s] [ 0%] 2025-09-07T07:33:27.6619893Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.2749s] [ 0%] 2025-09-07T07:33:27.6620064Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True FAILED [0.2609s] [ 0%] 2025-09-07T07:33:27.6620066Z 2025-09-07T07:33:27.6620118Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6620223Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6620289Z Traceback (most recent call last): 2025-09-07T07:33:27.6620457Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6620493Z self._run_test( 2025-09-07T07:33:27.6620605Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6620661Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6620702Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6620836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6620883Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6620923Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6621074Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6621121Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6621176Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6621312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6621357Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6621394Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6621537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6621618Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6621658Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6623201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6623249Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6623402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6623480Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6623521Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6623665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6623716Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6623756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6623871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6623938Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6623982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6624108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6624172Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6624216Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6624356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6624402Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6624439Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6624576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6624614Z return aot_autograd( 2025-09-07T07:33:27.6624649Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6624783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6626177Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6626225Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6626413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6626513Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6626559Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6626742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6626786Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6626971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6627011Z fx_g = _create_graph( 2025-09-07T07:33:27.6627046Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6627209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6627245Z fx_g = make_fx( 2025-09-07T07:33:27.6627295Z ^^^^^^^^ 2025-09-07T07:33:27.6627446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6627493Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6627531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6627676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6627720Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6627756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6627914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6627952Z t = dispatch_trace( 2025-09-07T07:33:27.6627987Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6629393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6629456Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6629492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6629617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6629657Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6629694Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6629854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6629933Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6629975Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6630101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6630140Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6630177Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6630305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6630347Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6630383Z ^^^^^^^^^ 2025-09-07T07:33:27.6630515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6630556Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6630591Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6630739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6630788Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6630823Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6630978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6632357Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6632418Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6632594Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6632633Z outs_pair = fn(*args) 2025-09-07T07:33:27.6632668Z ^^^^^^^^^ 2025-09-07T07:33:27.6632838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6632905Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6632949Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6633186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6633225Z outs_pair = fn(*args) 2025-09-07T07:33:27.6633261Z ^^^^^^^^^ 2025-09-07T07:33:27.6633456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6633517Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6633559Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6633753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6633823Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6633869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6634039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6634078Z outs_pair = fn(*args) 2025-09-07T07:33:27.6634132Z ^^^^^^^^^ 2025-09-07T07:33:27.6634321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6635683Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6635721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6635889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6635936Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6635972Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6636096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6636139Z return handle_torch_function( 2025-09-07T07:33:27.6636175Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6636317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6636394Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6636441Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6636608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6636650Z return func(*args, **kwargs) 2025-09-07T07:33:27.6636686Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6636809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6636850Z result = _engine_run_backward( 2025-09-07T07:33:27.6636887Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6637032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6637174Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6637248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6637375Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6637416Z return user_fn(self, *args) 2025-09-07T07:33:27.6638751Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6638896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6638940Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6638977Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6639133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6639176Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6639215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6639357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6639399Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6639434Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6639599Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6639654Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6639694Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6639830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6639879Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6639918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6640079Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6640143Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6640183Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6640341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6640379Z t = dispatch_trace( 2025-09-07T07:33:27.6641711Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6641824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6641868Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6641905Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6642028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6642067Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6642104Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6642264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6642344Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6642385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6642509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6642548Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6642583Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6642707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6642749Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6642784Z ^^^^^^^^^ 2025-09-07T07:33:27.6642931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6642997Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6643033Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6643162Z File "", line 1, in 2025-09-07T07:33:27.6643308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6643387Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6644734Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6644872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6644920Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6644959Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6645152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6645197Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6645234Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6645428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6645473Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6645511Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6645652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6645695Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6645731Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6645865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6645954Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6646001Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6646145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6646208Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6646252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6646377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6646416Z leaves = list(leaves) 2025-09-07T07:33:27.6647831Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6647956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6647992Z return func(x) 2025-09-07T07:33:27.6648025Z ^^^^^^^ 2025-09-07T07:33:27.6648162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6648227Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6648271Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6648441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6648482Z return func(*args, **kwargs) 2025-09-07T07:33:27.6648519Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6648699Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6648788Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6648790Z 2025-09-07T07:33:27.6648997Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6648999Z 2025-09-07T07:33:27.6649001Z 2025-09-07T07:33:27.6649075Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6649291Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6649314Z 2025-09-07T07:33:27.6649400Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6649473Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6649509Z inline_call [] 2025-09-07T07:33:27.6649565Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6649600Z inductor [] 2025-09-07T07:33:27.6649674Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6649746Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6651306Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6651439Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6651517Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6651667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6651751Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6651886Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6652005Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6652109Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6652153Z Traceback (most recent call last): 2025-09-07T07:33:27.6652300Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6652352Z self._run_test( 2025-09-07T07:33:27.6652465Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6652520Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6652562Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6652693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6652740Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6652779Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6652928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6652975Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6653014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6653214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6654568Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6654608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6654751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6654832Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6654871Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6655021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6655067Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6655218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6655273Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6655336Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6655494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6655547Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6655588Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6655703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6655769Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6655813Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6655938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6656001Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6656042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6656201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6656248Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6656286Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6657727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6657769Z return aot_autograd( 2025-09-07T07:33:27.6657804Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6657940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6658008Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6658057Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6658216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6658321Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6658368Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6658550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6658593Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6658778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6658817Z fx_g = _create_graph( 2025-09-07T07:33:27.6658853Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6659014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6659049Z fx_g = make_fx( 2025-09-07T07:33:27.6659081Z ^^^^^^^^ 2025-09-07T07:33:27.6659234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6659282Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6659320Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6659466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6660816Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6660855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6661013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6661052Z t = dispatch_trace( 2025-09-07T07:33:27.6661086Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6661199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6661241Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6661303Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6661441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6661482Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6661518Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6661679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6661757Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6661799Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6661922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6661962Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6661997Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6662123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6662166Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6662215Z ^^^^^^^^^ 2025-09-07T07:33:27.6662348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6662389Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6663794Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6663945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6663995Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6664029Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6664185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6664247Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6664294Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6664493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6664535Z outs_pair = fn(*args) 2025-09-07T07:33:27.6664569Z ^^^^^^^^^ 2025-09-07T07:33:27.6664739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6664805Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6664851Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6665027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6665066Z outs_pair = fn(*args) 2025-09-07T07:33:27.6665101Z ^^^^^^^^^ 2025-09-07T07:33:27.6665278Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6665340Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6665383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6665576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6665647Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6665692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6667168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6667208Z outs_pair = fn(*args) 2025-09-07T07:33:27.6667243Z ^^^^^^^^^ 2025-09-07T07:33:27.6667453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6667523Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6667560Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6667730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6667776Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6667813Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6667938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6667981Z return handle_torch_function( 2025-09-07T07:33:27.6668017Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6668156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6668232Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6668296Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6668466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6668506Z return func(*args, **kwargs) 2025-09-07T07:33:27.6668543Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6668664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6668707Z result = _engine_run_backward( 2025-09-07T07:33:27.6668743Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6670183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6670305Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6670357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6670504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6670546Z return user_fn(self, *args) 2025-09-07T07:33:27.6670582Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6670726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6670770Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6670807Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6670964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6671008Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6671044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6671168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6671208Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6671247Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6671409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6671462Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6671502Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6671637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6671686Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6671725Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6671886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6673297Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6673363Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6673524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6673581Z t = dispatch_trace( 2025-09-07T07:33:27.6673615Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6673728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6673770Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6673808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6673931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6673971Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6674006Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6674165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6674244Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6674303Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6674427Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6674466Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6674500Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6674626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6674667Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6674702Z ^^^^^^^^^ 2025-09-07T07:33:27.6674849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6676205Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6676240Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6676284Z File "", line 1, in 2025-09-07T07:33:27.6676451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6676531Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6676577Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6676713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6676760Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6676799Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6676988Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6677031Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6677068Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6677237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6677284Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6677321Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6677463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6677505Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6677542Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6677673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6677761Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6677807Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6677933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6679306Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6679367Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6679494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6679533Z leaves = list(leaves) 2025-09-07T07:33:27.6679568Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6679690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6679725Z return func(x) 2025-09-07T07:33:27.6679759Z ^^^^^^^ 2025-09-07T07:33:27.6679896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6679960Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6680001Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6680169Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6680226Z return func(*args, **kwargs) 2025-09-07T07:33:27.6680263Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6680444Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6680530Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6680534Z 2025-09-07T07:33:27.6680739Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6680741Z 2025-09-07T07:33:27.6680743Z 2025-09-07T07:33:27.6680817Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6681009Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6681029Z 2025-09-07T07:33:27.6681118Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6681191Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6682526Z inline_call [] 2025-09-07T07:33:27.6682585Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6682620Z inductor [] 2025-09-07T07:33:27.6682694Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6682766Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6683021Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6683203Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6683282Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6683435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6683520Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6683652Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6683771Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6683842Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6683877Z inline_call [] 2025-09-07T07:33:27.6683933Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6684006Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6684097Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6684352Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6684479Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6684554Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6684702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6684787Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6686235Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6686357Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6686409Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6686540Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6686585Z Traceback (most recent call last): 2025-09-07T07:33:27.6686783Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6686819Z self._run_test( 2025-09-07T07:33:27.6686931Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6686988Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6687029Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6687160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6687208Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6687248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6687418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6687465Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6687505Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6687639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6687684Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6687721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6687863Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6687943Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6689288Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6689443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6689493Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6689643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6689697Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6689737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6689879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6689930Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6689969Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6690086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6690151Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6690214Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6690343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6690421Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6690462Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6690601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6690645Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6690684Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6690821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6690861Z return aot_autograd( 2025-09-07T07:33:27.6690896Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6691032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6692397Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6692463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6692624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6692708Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6692753Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6692933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6692976Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6693241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6693305Z fx_g = _create_graph( 2025-09-07T07:33:27.6693341Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6693507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6693542Z fx_g = make_fx( 2025-09-07T07:33:27.6693574Z ^^^^^^^^ 2025-09-07T07:33:27.6693725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6693771Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6693810Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6693954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6693997Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6694034Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6694192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6694232Z t = dispatch_trace( 2025-09-07T07:33:27.6694268Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6695694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6695737Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6695774Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6695897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6695938Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6695974Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6696134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6696212Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6696254Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6696400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6696456Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6696491Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6696616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6696657Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6696693Z ^^^^^^^^^ 2025-09-07T07:33:27.6696826Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6696868Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6696903Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6697051Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6697101Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6697137Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6698611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6698678Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6698722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6698895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6698935Z outs_pair = fn(*args) 2025-09-07T07:33:27.6698969Z ^^^^^^^^^ 2025-09-07T07:33:27.6699139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6699205Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6699250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6699437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6699478Z outs_pair = fn(*args) 2025-09-07T07:33:27.6699512Z ^^^^^^^^^ 2025-09-07T07:33:27.6699688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6699748Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6699792Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6699984Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6700054Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6700099Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6700274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6700313Z outs_pair = fn(*args) 2025-09-07T07:33:27.6700349Z ^^^^^^^^^ 2025-09-07T07:33:27.6700536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6701883Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6701921Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6702089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6702135Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6702173Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6702298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6702360Z return handle_torch_function( 2025-09-07T07:33:27.6702415Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6702556Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6702631Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6702678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6702843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6702885Z return func(*args, **kwargs) 2025-09-07T07:33:27.6702920Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6703042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6703149Z result = _engine_run_backward( 2025-09-07T07:33:27.6703185Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6703356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6703477Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6703528Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6703654Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6705012Z return user_fn(self, *args) 2025-09-07T07:33:27.6705050Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6705195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6705238Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6705276Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6705434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6705502Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6705539Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6705662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6705702Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6705738Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6705900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6705952Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6705992Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6706128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6706179Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6706219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6706381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6706429Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6706468Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6706624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6706663Z t = dispatch_trace( 2025-09-07T07:33:27.6707996Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6708110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6708153Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6708190Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6708337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6708379Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6708433Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6708592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6708669Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6708711Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6708834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6708874Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6708908Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6709034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6709076Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6709111Z ^^^^^^^^^ 2025-09-07T07:33:27.6709273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6709324Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6709358Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6709400Z File "", line 1, in 2025-09-07T07:33:27.6709541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6710915Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6710963Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6711099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6711146Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6711186Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6711378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6711439Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6711475Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6711646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6711690Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6711727Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6711870Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6711912Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6711949Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6712082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6712173Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6712221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6712347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6712407Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6712451Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6712576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6712615Z leaves = list(leaves) 2025-09-07T07:33:27.6714026Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6714151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6714185Z return func(x) 2025-09-07T07:33:27.6714219Z ^^^^^^^ 2025-09-07T07:33:27.6714383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6714468Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6714510Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6714677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6714718Z return func(*args, **kwargs) 2025-09-07T07:33:27.6714754Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6714932Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6715018Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6715020Z 2025-09-07T07:33:27.6715224Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6715228Z 2025-09-07T07:33:27.6715246Z 2025-09-07T07:33:27.6715320Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6715510Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6715512Z 2025-09-07T07:33:27.6715598Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6715671Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6715708Z inline_call [] 2025-09-07T07:33:27.6715764Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6715799Z inductor [] 2025-09-07T07:33:27.6715873Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6717257Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6717538Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6717652Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6717727Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6717878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6717963Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6718095Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6718213Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6718284Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6718320Z inline_call [] 2025-09-07T07:33:27.6718380Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6718452Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6718521Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6718774Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6718883Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6718958Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6719106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6719204Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6719347Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6719464Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6719533Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6719568Z inline_call [] 2025-09-07T07:33:27.6720919Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6720993Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6721062Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6721313Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6721438Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6721515Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6721663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6721748Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6721876Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6721994Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6722208Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-1222d0350e88758d.xml - 2025-09-07T07:33:27.6722268Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6722636Z FAILED [0.2609s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6722722Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6722724Z 2025-09-07T07:33:27.6722929Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6722931Z 2025-09-07T07:33:27.6722933Z 2025-09-07T07:33:27.6723005Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6723276Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6723280Z 2025-09-07T07:33:27.6723365Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6723427Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6723491Z ================== 1 failed, 54 deselected, 2 rerun in 1.38s =================== 2025-09-07T07:33:27.6723528Z Got exit code 1 2025-09-07T07:33:27.6724873Z Retrying single test... 2025-09-07T07:33:27.6725299Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6725338Z import pkg_resources 2025-09-07T07:33:27.6725509Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-a1dca5e1e556d008.xml 2025-09-07T07:33:27.6725586Z ============================= test session starts ============================== 2025-09-07T07:33:27.6725725Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6725764Z cachedir: .pytest_cache 2025-09-07T07:33:27.6725920Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6725964Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6726004Z configfile: pytest.ini 2025-09-07T07:33:27.6726163Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6726239Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.6726462Z stepcurrent: skipping 54 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6726507Z Running 1 items in this shard 2025-09-07T07:33:27.6726509Z 2025-09-07T07:33:27.6726767Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.6550s] [100%] 2025-09-07T07:33:27.6726956Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.2832s] [100%] 2025-09-07T07:33:27.6727119Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True FAILED [0.2770s] [100%] 2025-09-07T07:33:27.6727121Z 2025-09-07T07:33:27.6727171Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6727275Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6727320Z Traceback (most recent call last): 2025-09-07T07:33:27.6727468Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6728832Z self._run_test( 2025-09-07T07:33:27.6728947Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6729005Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6729046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6729180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6729227Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6729268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6729418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6729464Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6729503Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6729640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6729687Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6729725Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6729868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6729949Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6729989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6730139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6730186Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6730334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6730389Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6730448Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6730605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6731953Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6731994Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6732111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6732177Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6732221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6732349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6732411Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6732453Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6732612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6732659Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6732696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6732833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6732872Z return aot_autograd( 2025-09-07T07:33:27.6732908Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6733043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6733169Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6733216Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6733377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6733486Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6733533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6733715Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6735082Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6735269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6735309Z fx_g = _create_graph( 2025-09-07T07:33:27.6735346Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6735511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6735546Z fx_g = make_fx( 2025-09-07T07:33:27.6735578Z ^^^^^^^^ 2025-09-07T07:33:27.6735731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6735779Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6735817Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6735962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6736006Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6736042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6736201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6736239Z t = dispatch_trace( 2025-09-07T07:33:27.6736274Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6736387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6736429Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6736487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6736629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6736670Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6736706Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6738167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6738248Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6738289Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6738414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6738452Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6738487Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6738615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6738658Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6738716Z ^^^^^^^^^ 2025-09-07T07:33:27.6738849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6738892Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6738927Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6739076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6739125Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6739161Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6739316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6739378Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6739424Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6739613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6739654Z outs_pair = fn(*args) 2025-09-07T07:33:27.6739689Z ^^^^^^^^^ 2025-09-07T07:33:27.6739859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6741222Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6741268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6741442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6741480Z outs_pair = fn(*args) 2025-09-07T07:33:27.6741514Z ^^^^^^^^^ 2025-09-07T07:33:27.6741691Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6741754Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6741796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6741988Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6742058Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6742104Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6742275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6742313Z outs_pair = fn(*args) 2025-09-07T07:33:27.6742348Z ^^^^^^^^^ 2025-09-07T07:33:27.6742551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6742611Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6742648Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6742815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6742862Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6742900Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6743023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6744464Z return handle_torch_function( 2025-09-07T07:33:27.6744502Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6744644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6744720Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6744796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6744963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6745005Z return func(*args, **kwargs) 2025-09-07T07:33:27.6745041Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6745165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6745207Z result = _engine_run_backward( 2025-09-07T07:33:27.6745244Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6745389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6745509Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6745561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6745707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6745749Z return user_fn(self, *args) 2025-09-07T07:33:27.6745785Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6745928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6745972Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6746009Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6746166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6746211Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6747553Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6747679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6747721Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6747759Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6747921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6747974Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6748015Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6748150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6748199Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6748239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6748398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6748446Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6748513Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6748673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6748729Z t = dispatch_trace( 2025-09-07T07:33:27.6748764Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6748877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6748920Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6748956Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6749080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6749119Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6750663Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6750827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6750910Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6750969Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6751094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6751133Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6751168Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6751294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6751335Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6751371Z ^^^^^^^^^ 2025-09-07T07:33:27.6751518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6751569Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6751602Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6751645Z File "", line 1, in 2025-09-07T07:33:27.6751803Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6751883Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6751933Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6752073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6752120Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6752159Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6752348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6752392Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6754074Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6754255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6754304Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6754341Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6754484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6754528Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6754564Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6754698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6754786Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6754833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6754957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6755049Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6755113Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6755239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6755279Z leaves = list(leaves) 2025-09-07T07:33:27.6755313Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6755436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6755470Z return func(x) 2025-09-07T07:33:27.6755506Z ^^^^^^^ 2025-09-07T07:33:27.6755643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6755709Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6755750Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6757265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6757329Z return func(*args, **kwargs) 2025-09-07T07:33:27.6757368Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6757549Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6757634Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6757636Z 2025-09-07T07:33:27.6757840Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6757843Z 2025-09-07T07:33:27.6757845Z 2025-09-07T07:33:27.6757918Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6758109Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6758129Z 2025-09-07T07:33:27.6758217Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6758291Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6758327Z inline_call [] 2025-09-07T07:33:27.6758383Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6758418Z inductor [] 2025-09-07T07:33:27.6758492Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6758565Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6758822Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6758934Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6759013Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6759165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6759251Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6759383Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6760804Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6760911Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6760955Z Traceback (most recent call last): 2025-09-07T07:33:27.6761102Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6761137Z self._run_test( 2025-09-07T07:33:27.6761266Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6761336Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6761378Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6761509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6761556Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6761595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6761746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6761791Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6761830Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6761964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6762010Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6762048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6762223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6762306Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6762344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6762496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6763914Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6764068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6764123Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6764163Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6764307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6764389Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6764429Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6764545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6764611Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6764656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6764781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6764845Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6764886Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6765026Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6765072Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6765111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6765248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6765288Z return aot_autograd( 2025-09-07T07:33:27.6765323Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6765458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6765527Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6765574Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6767099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6767185Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6767254Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6767459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6767502Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6767688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6767727Z fx_g = _create_graph( 2025-09-07T07:33:27.6767763Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6767925Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6767960Z fx_g = make_fx( 2025-09-07T07:33:27.6767993Z ^^^^^^^^ 2025-09-07T07:33:27.6768144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6768194Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6768251Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6768398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6768441Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6768479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6768637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6768675Z t = dispatch_trace( 2025-09-07T07:33:27.6768709Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6768822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6768863Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6770200Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6770328Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6770398Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6770434Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6770595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6770674Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6770716Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6770841Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6770881Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6770915Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6771041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6771083Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6771117Z ^^^^^^^^^ 2025-09-07T07:33:27.6771252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6771294Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6771330Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6771478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6771528Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6771563Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6771720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6771781Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6773194Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6773393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6773436Z outs_pair = fn(*args) 2025-09-07T07:33:27.6773490Z ^^^^^^^^^ 2025-09-07T07:33:27.6773661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6773727Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6773773Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6773946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6773985Z outs_pair = fn(*args) 2025-09-07T07:33:27.6774019Z ^^^^^^^^^ 2025-09-07T07:33:27.6774197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6774257Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6774323Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6774519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6774590Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6774635Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6774807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6774845Z outs_pair = fn(*args) 2025-09-07T07:33:27.6774880Z ^^^^^^^^^ 2025-09-07T07:33:27.6775068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6775113Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6775169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6776663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6776712Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6776750Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6776875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6776918Z return handle_torch_function( 2025-09-07T07:33:27.6776954Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6777094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6777169Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6777214Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6777385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6777426Z return func(*args, **kwargs) 2025-09-07T07:33:27.6777463Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6777585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6777628Z result = _engine_run_backward( 2025-09-07T07:33:27.6777663Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6777810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6777930Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6777980Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6778125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6778171Z return user_fn(self, *args) 2025-09-07T07:33:27.6778219Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6779660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6779704Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6779742Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6779899Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6779944Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6779980Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6780103Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6780142Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6780178Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6780358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6780412Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6780452Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6780588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6780637Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6780676Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6780839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6780887Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6780926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6781083Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6781142Z t = dispatch_trace( 2025-09-07T07:33:27.6781178Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6781291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6782634Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6782673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6782797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6782837Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6782872Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6783032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6783181Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6783222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6783349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6783389Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6783424Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6783550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6783591Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6783626Z ^^^^^^^^^ 2025-09-07T07:33:27.6783774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6783823Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6783857Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6783899Z File "", line 1, in 2025-09-07T07:33:27.6784040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6784144Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6784206Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6784343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6785707Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6785745Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6785937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6785980Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6786017Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6786185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6786231Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6786269Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6786439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6786483Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6786519Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6786652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6786741Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6786787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6786913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6786973Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6787018Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6787165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6787205Z leaves = list(leaves) 2025-09-07T07:33:27.6787240Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6787362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6788696Z return func(x) 2025-09-07T07:33:27.6788731Z ^^^^^^^ 2025-09-07T07:33:27.6788875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6788941Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6788983Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6789150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6789191Z return func(*args, **kwargs) 2025-09-07T07:33:27.6789229Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6789411Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6789497Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6789499Z 2025-09-07T07:33:27.6789706Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6789708Z 2025-09-07T07:33:27.6789710Z 2025-09-07T07:33:27.6789783Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6789972Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6789974Z 2025-09-07T07:33:27.6790079Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6790155Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6790206Z inline_call [] 2025-09-07T07:33:27.6790262Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6790296Z inductor [] 2025-09-07T07:33:27.6790372Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6790443Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6790699Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6792141Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6792221Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6792374Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6792487Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6792620Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6792740Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6792810Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6792846Z inline_call [] 2025-09-07T07:33:27.6792902Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6792975Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6793045Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6793357Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6793489Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6793565Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6793713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6793797Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6793927Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6794044Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6794093Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6794201Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6794249Z Traceback (most recent call last): 2025-09-07T07:33:27.6794394Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6795746Z self._run_test( 2025-09-07T07:33:27.6795861Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6795916Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6795958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6796089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6796136Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6796175Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6796350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6796397Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6796458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6796593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6796639Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6796676Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6796819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6796900Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6796939Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6797092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6797138Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6797307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6797361Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6797403Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6797545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6798905Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6798944Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6799062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6799129Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6799173Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6799300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6799382Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6799425Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6799565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6799609Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6799647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6799783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6799823Z return aot_autograd( 2025-09-07T07:33:27.6799857Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6799993Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6800061Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6800109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6800270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6800354Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6800399Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6800580Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6801920Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6802107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6802148Z fx_g = _create_graph( 2025-09-07T07:33:27.6802184Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6802361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6802413Z fx_g = make_fx( 2025-09-07T07:33:27.6802446Z ^^^^^^^^ 2025-09-07T07:33:27.6802598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6802645Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6802682Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6802829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6802873Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6802910Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6803152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6803192Z t = dispatch_trace( 2025-09-07T07:33:27.6803227Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6803361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6803405Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6803441Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6803565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6803606Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6803642Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6805115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6805196Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6805239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6805364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6805425Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6805462Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6805589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6805630Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6805666Z ^^^^^^^^^ 2025-09-07T07:33:27.6805797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6805838Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6805874Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6806022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6806072Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6806106Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6806263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6806327Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6806373Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6806548Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6806588Z outs_pair = fn(*args) 2025-09-07T07:33:27.6806622Z ^^^^^^^^^ 2025-09-07T07:33:27.6808146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6808214Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6808259Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6808455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6808497Z outs_pair = fn(*args) 2025-09-07T07:33:27.6808550Z ^^^^^^^^^ 2025-09-07T07:33:27.6808729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6808788Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6808831Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6809026Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6809096Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6809141Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6809313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6809353Z outs_pair = fn(*args) 2025-09-07T07:33:27.6809406Z ^^^^^^^^^ 2025-09-07T07:33:27.6809596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6809641Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6809678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6809846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6809893Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6809931Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6810057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6811402Z return handle_torch_function( 2025-09-07T07:33:27.6811439Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6811600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6811676Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6811722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6811889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6811930Z return func(*args, **kwargs) 2025-09-07T07:33:27.6811967Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6812089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6812132Z result = _engine_run_backward( 2025-09-07T07:33:27.6812168Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6812312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6812434Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6812486Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6812612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6812654Z return user_fn(self, *args) 2025-09-07T07:33:27.6812690Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6812832Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6812875Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6812913Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6813147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6814526Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6814567Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6814716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6814756Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6814792Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6814955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6815008Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6815048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6815184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6815233Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6815272Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6815449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6815499Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6815539Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6815696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6815735Z t = dispatch_trace( 2025-09-07T07:33:27.6815769Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6815883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6815926Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6815963Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6816087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6816126Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6817468Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6817651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6817731Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6817773Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6817898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6817937Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6817972Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6818098Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6818140Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6818174Z ^^^^^^^^^ 2025-09-07T07:33:27.6818321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6818373Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6818408Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6818450Z File "", line 1, in 2025-09-07T07:33:27.6818593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6818671Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6818718Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6818852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6818900Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6818938Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6819129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6819186Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6820538Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6820709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6820755Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6820792Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6820935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6820977Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6821014Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6821146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6821235Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6821282Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6821427Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6821488Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6821532Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6821658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6821698Z leaves = list(leaves) 2025-09-07T07:33:27.6821733Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6821855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6821890Z return func(x) 2025-09-07T07:33:27.6821924Z ^^^^^^^ 2025-09-07T07:33:27.6822060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6822125Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6823574Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6823746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6823787Z return func(*args, **kwargs) 2025-09-07T07:33:27.6823822Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6824005Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6824090Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6824093Z 2025-09-07T07:33:27.6824300Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6824303Z 2025-09-07T07:33:27.6824304Z 2025-09-07T07:33:27.6824379Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6824572Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6824575Z 2025-09-07T07:33:27.6824662Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6824734Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6824770Z inline_call [] 2025-09-07T07:33:27.6824827Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6824861Z inductor [] 2025-09-07T07:33:27.6824935Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6825006Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6825283Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6825414Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6825492Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6825642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6825728Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6827168Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6827289Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6827360Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6827395Z inline_call [] 2025-09-07T07:33:27.6827452Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6827545Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6827616Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6827873Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6827983Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6828058Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6828207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6828292Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6828422Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6828560Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6828629Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6828664Z inline_call [] 2025-09-07T07:33:27.6828719Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6828791Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6828859Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6829114Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6829223Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6829299Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6830745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6830831Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6830960Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6831076Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6831291Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-a1dca5e1e556d008.xml - 2025-09-07T07:33:27.6831350Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6831722Z FAILED [0.2770s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6831820Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6831822Z 2025-09-07T07:33:27.6832027Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6832031Z 2025-09-07T07:33:27.6832032Z 2025-09-07T07:33:27.6832104Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6832294Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6832297Z 2025-09-07T07:33:27.6832381Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6832443Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6832524Z ================== 1 failed, 220 deselected, 2 rerun in 1.39s ================== 2025-09-07T07:33:27.6832561Z Got exit code 1 2025-09-07T07:33:27.6832599Z Retrying single test... 2025-09-07T07:33:27.6833020Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6833109Z import pkg_resources 2025-09-07T07:33:27.6833278Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-e188454e95ac62b4.xml 2025-09-07T07:33:27.6833334Z ============================= test session starts ============================== 2025-09-07T07:33:27.6833447Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6834828Z cachedir: .pytest_cache 2025-09-07T07:33:27.6834989Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6835034Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6835074Z configfile: pytest.ini 2025-09-07T07:33:27.6835233Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6835309Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.6835534Z stepcurrent: skipping 54 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6835576Z Running 1 items in this shard 2025-09-07T07:33:27.6835580Z 2025-09-07T07:33:27.6835773Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.6495s] [100%] 2025-09-07T07:33:27.6835964Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.2723s] [100%] 2025-09-07T07:33:27.6836128Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True FAILED [0.2634s] [100%] 2025-09-07T07:33:27.6836130Z 2025-09-07T07:33:27.6836180Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6836284Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6836329Z Traceback (most recent call last): 2025-09-07T07:33:27.6836478Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6836513Z self._run_test( 2025-09-07T07:33:27.6836655Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6836728Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6836770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6836903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6836951Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6836990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6838449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6838496Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6838535Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6838670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6838717Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6838755Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6838924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6839005Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6839045Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6839196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6839243Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6839392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6839446Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6839486Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6839633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6839701Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6839740Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6839857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6839924Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6839968Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6840094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6841462Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6841507Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6841647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6841695Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6841734Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6841872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6841911Z return aot_autograd( 2025-09-07T07:33:27.6841946Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6842082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6842152Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6842198Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6842358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6842442Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6842504Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6842701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6842745Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6842932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6842971Z fx_g = _create_graph( 2025-09-07T07:33:27.6843007Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6843247Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6843284Z fx_g = make_fx( 2025-09-07T07:33:27.6843316Z ^^^^^^^^ 2025-09-07T07:33:27.6844784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6844834Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6844902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6845049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6845093Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6845129Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6845286Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6845324Z t = dispatch_trace( 2025-09-07T07:33:27.6845359Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6845471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6845513Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6845549Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6845673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6845734Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6845770Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6845930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6846008Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6846051Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6846175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6846214Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6846249Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6847729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6847774Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6847812Z ^^^^^^^^^ 2025-09-07T07:33:27.6847946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6847989Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6848025Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6848173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6848222Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6848257Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6848413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6848476Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6848520Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6848716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6848758Z outs_pair = fn(*args) 2025-09-07T07:33:27.6848811Z ^^^^^^^^^ 2025-09-07T07:33:27.6848982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6849050Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6849094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6849267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6849306Z outs_pair = fn(*args) 2025-09-07T07:33:27.6849340Z ^^^^^^^^^ 2025-09-07T07:33:27.6849517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6850880Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6850941Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6851140Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6851212Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6851258Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6851430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6851468Z outs_pair = fn(*args) 2025-09-07T07:33:27.6851503Z ^^^^^^^^^ 2025-09-07T07:33:27.6851691Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6851738Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6851790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6851959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6852006Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6852043Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6852168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6852211Z return handle_torch_function( 2025-09-07T07:33:27.6852248Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6852389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6852465Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6852516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6852684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6854086Z return func(*args, **kwargs) 2025-09-07T07:33:27.6854124Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6854248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6854290Z result = _engine_run_backward( 2025-09-07T07:33:27.6854327Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6854474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6854597Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6854647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6854800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6854967Z return user_fn(self, *args) 2025-09-07T07:33:27.6855004Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6855146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6855190Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6855229Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6855386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6855433Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6855469Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6855595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6855635Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6855671Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6855853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6855907Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6857253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6857391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6857440Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6857480Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6857640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6857688Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6857727Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6857886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6857952Z t = dispatch_trace( 2025-09-07T07:33:27.6857988Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6858101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6858144Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6858179Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6858303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6858341Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6858376Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6858535Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6858614Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6858656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6858784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6858827Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6858862Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6860288Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6860331Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6860368Z ^^^^^^^^^ 2025-09-07T07:33:27.6860515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6860565Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6860599Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6860641Z File "", line 1, in 2025-09-07T07:33:27.6860783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6860885Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6860948Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6861085Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6861132Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6861171Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6861361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6861404Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6861440Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6861612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6861658Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6861697Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6861856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6861900Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6863337Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6863475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6863564Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6863612Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6863737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6863799Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6863843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6863996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6864037Z leaves = list(leaves) 2025-09-07T07:33:27.6864072Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6864194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6864228Z return func(x) 2025-09-07T07:33:27.6864262Z ^^^^^^^ 2025-09-07T07:33:27.6864400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6864465Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6864507Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6864673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6864713Z return func(*args, **kwargs) 2025-09-07T07:33:27.6864753Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6864933Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6865019Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6865021Z 2025-09-07T07:33:27.6865225Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6865227Z 2025-09-07T07:33:27.6865228Z 2025-09-07T07:33:27.6866624Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6866813Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6866816Z 2025-09-07T07:33:27.6866925Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6867002Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6867054Z inline_call [] 2025-09-07T07:33:27.6867111Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6867147Z inductor [] 2025-09-07T07:33:27.6867221Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6867293Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6867548Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6867659Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6867735Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6867886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6867991Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6868123Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6868241Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6868346Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6868390Z Traceback (most recent call last): 2025-09-07T07:33:27.6868536Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6868571Z self._run_test( 2025-09-07T07:33:27.6868684Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6870048Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6870107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6870244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6870291Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6870330Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6870481Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6870527Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6870566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6870701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6870745Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6870783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6870926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6871010Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6871049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6871201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6871246Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6871395Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6871449Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6871490Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6871632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6871684Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6871739Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6873254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6873321Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6873367Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6873492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6873555Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6873597Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6873735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6873779Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6873817Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6873977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6874018Z return aot_autograd( 2025-09-07T07:33:27.6874053Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6874188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6874258Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6874305Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6874465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6874548Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6874593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6874775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6874839Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6875023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6876373Z fx_g = _create_graph( 2025-09-07T07:33:27.6876411Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6876574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6876609Z fx_g = make_fx( 2025-09-07T07:33:27.6876642Z ^^^^^^^^ 2025-09-07T07:33:27.6876793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6876840Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6876878Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6877027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6877071Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6877108Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6877265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6877303Z t = dispatch_trace( 2025-09-07T07:33:27.6877337Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6877449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6877491Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6877527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6877650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6877691Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6877749Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6877910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6878004Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6879340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6879465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6879505Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6879539Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6879666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6879708Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6879744Z ^^^^^^^^^ 2025-09-07T07:33:27.6879875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6879918Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6879978Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6880126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6880176Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6880210Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6880367Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6880429Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6880474Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6880646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6880686Z outs_pair = fn(*args) 2025-09-07T07:33:27.6880720Z ^^^^^^^^^ 2025-09-07T07:33:27.6880905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6880973Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6882312Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6882488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6882527Z outs_pair = fn(*args) 2025-09-07T07:33:27.6882561Z ^^^^^^^^^ 2025-09-07T07:33:27.6882737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6882796Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6882839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6883033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6883185Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6883231Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6883402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6883440Z outs_pair = fn(*args) 2025-09-07T07:33:27.6883475Z ^^^^^^^^^ 2025-09-07T07:33:27.6883666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6883713Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6883749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6883938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6884002Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6884039Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6884164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6884206Z return handle_torch_function( 2025-09-07T07:33:27.6884243Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6885699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6885776Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6885823Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6885989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6886031Z return func(*args, **kwargs) 2025-09-07T07:33:27.6886089Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6886214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6886257Z result = _engine_run_backward( 2025-09-07T07:33:27.6886293Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6886437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6886556Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6886607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6886768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6886810Z return user_fn(self, *args) 2025-09-07T07:33:27.6886869Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6887014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6887059Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6887096Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6887254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6887298Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6887333Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6888769Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6888810Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6888846Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6889009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6889063Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6889106Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6889241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6889291Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6889330Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6889490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6889537Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6889577Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6889733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6889772Z t = dispatch_trace( 2025-09-07T07:33:27.6889824Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6889939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6890001Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6890037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6890159Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6890199Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6890234Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6890394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6891769Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6891812Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6891936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6891979Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6892013Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6892155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6892197Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6892232Z ^^^^^^^^^ 2025-09-07T07:33:27.6892380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6892429Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6892464Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6892506Z File "", line 1, in 2025-09-07T07:33:27.6892648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6892726Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6892773Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6892924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6892974Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6893012Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6893259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6893302Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6893338Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6893506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6894866Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6894904Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6895048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6895093Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6895130Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6895263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6895351Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6895397Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6895522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6895581Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6895625Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6895750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6895816Z leaves = list(leaves) 2025-09-07T07:33:27.6895853Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6895992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6896028Z return func(x) 2025-09-07T07:33:27.6896061Z ^^^^^^^ 2025-09-07T07:33:27.6896198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6896261Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6896304Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6896469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6897807Z return func(*args, **kwargs) 2025-09-07T07:33:27.6897844Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6898026Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6898133Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6898136Z 2025-09-07T07:33:27.6898342Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6898344Z 2025-09-07T07:33:27.6898346Z 2025-09-07T07:33:27.6898419Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6898609Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6898612Z 2025-09-07T07:33:27.6898698Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6898771Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6898824Z inline_call [] 2025-09-07T07:33:27.6898881Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6898917Z inductor [] 2025-09-07T07:33:27.6898992Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6899063Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6899319Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6899430Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6899506Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6899655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6899741Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6899874Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6899993Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6900063Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6901403Z inline_call [] 2025-09-07T07:33:27.6901461Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6901533Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6901602Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6901857Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6901988Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6902086Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6902234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6902318Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6902447Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6902565Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6902614Z =================================== FAILURES =================================== 2025-09-07T07:33:27.6902718Z _ WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.6902762Z Traceback (most recent call last): 2025-09-07T07:33:27.6902926Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1267, in test_while_loop_with_outer_code 2025-09-07T07:33:27.6902963Z self._run_test( 2025-09-07T07:33:27.6903137Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6903192Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6903234Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6903365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6903412Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6904765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6904918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6904964Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6905005Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6905168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6905214Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6905252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6905397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6905478Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6905516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6905667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6905713Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6905862Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6905918Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6905961Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6906102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6906154Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6906193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6906309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6906375Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6906420Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6906545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6907913Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6907978Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6908120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6908181Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6908218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6908357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6908396Z return aot_autograd( 2025-09-07T07:33:27.6908431Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6908568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6908640Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6908687Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6908849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6908951Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6908997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6909179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6909222Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6909406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6909445Z fx_g = _create_graph( 2025-09-07T07:33:27.6909480Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6909642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6909676Z fx_g = make_fx( 2025-09-07T07:33:27.6911030Z ^^^^^^^^ 2025-09-07T07:33:27.6911185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6911233Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6911271Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6911417Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6911460Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6911498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6911656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6911695Z t = dispatch_trace( 2025-09-07T07:33:27.6911729Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6911842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6911886Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6911924Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6912054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6912095Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6912131Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6912292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6912369Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6912411Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6912533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6912572Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6912607Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6914108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6914170Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6914206Z ^^^^^^^^^ 2025-09-07T07:33:27.6914339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6914379Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6914415Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6914562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6914613Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6914647Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6914802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6914864Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6914912Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6915122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6915163Z outs_pair = fn(*args) 2025-09-07T07:33:27.6915198Z ^^^^^^^^^ 2025-09-07T07:33:27.6915368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6915434Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6915478Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6915649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6915689Z outs_pair = fn(*args) 2025-09-07T07:33:27.6915723Z ^^^^^^^^^ 2025-09-07T07:33:27.6917226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6917288Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6917332Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6917525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6917595Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6917640Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6917811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6917849Z outs_pair = fn(*args) 2025-09-07T07:33:27.6917884Z ^^^^^^^^^ 2025-09-07T07:33:27.6918080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6918128Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6918165Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6918334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6918379Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6918416Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6918541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6918583Z return handle_torch_function( 2025-09-07T07:33:27.6918620Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6918761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6918856Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6918918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6919084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6920425Z return func(*args, **kwargs) 2025-09-07T07:33:27.6920463Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6920586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6920629Z result = _engine_run_backward( 2025-09-07T07:33:27.6920665Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6920810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6920929Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6921000Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6921127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6921169Z return user_fn(self, *args) 2025-09-07T07:33:27.6921205Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6921348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6921391Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6921429Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6921584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6921629Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6921664Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6921789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6921846Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6921881Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6922047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6923440Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6923482Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6923619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6923669Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6923707Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6923868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6923916Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6923958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6924116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6924155Z t = dispatch_trace( 2025-09-07T07:33:27.6924189Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6924303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6924345Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6924382Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6924505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6924544Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6924579Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6924760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6924841Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6924897Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6925021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6925060Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6926396Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6926524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6926566Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6926601Z ^^^^^^^^^ 2025-09-07T07:33:27.6926830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6926880Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6926914Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6926959Z File "", line 1, in 2025-09-07T07:33:27.6927135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6927215Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6927261Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6927398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6927446Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6927484Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6927674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6927717Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6927754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6927943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6927989Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6928025Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6928167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6928210Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6929559Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6929696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6929785Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6929831Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6929958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6930021Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6930066Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6930192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6930231Z leaves = list(leaves) 2025-09-07T07:33:27.6930265Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6930388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6930422Z return func(x) 2025-09-07T07:33:27.6930455Z ^^^^^^^ 2025-09-07T07:33:27.6930592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6930657Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6930698Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6930888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6930949Z return func(*args, **kwargs) 2025-09-07T07:33:27.6930985Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6931166Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6931249Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6931251Z 2025-09-07T07:33:27.6932753Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6932757Z 2025-09-07T07:33:27.6932759Z 2025-09-07T07:33:27.6932833Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6933023Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6933045Z 2025-09-07T07:33:27.6933216Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6933290Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6933326Z inline_call [] 2025-09-07T07:33:27.6933381Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6933415Z inductor [] 2025-09-07T07:33:27.6933490Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6933561Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6933816Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6933928Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6934026Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6934176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6934263Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6934393Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6934511Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6934581Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6934617Z inline_call [] 2025-09-07T07:33:27.6934673Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6934746Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6934817Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6936395Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6936505Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6936582Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6936731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6936815Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6936943Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6937077Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6937149Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6937199Z inline_call [] 2025-09-07T07:33:27.6937254Z stats [('calls_captured', 13), ('unique_graphs', 1)] 2025-09-07T07:33:27.6937326Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6937395Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6937646Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6937754Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 838, in forward 2025-09-07T07:33:27.6937828Z _, f, g = torch._higher_order_ops.while_loop(cond_fn, body_fn, [c, d, e]) 2025-09-07T07:33:27.6937974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6938073Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6938202Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6938319Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6938532Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-e188454e95ac62b4.xml - 2025-09-07T07:33:27.6938590Z =========================== short test summary info ============================ 2025-09-07T07:33:27.6940249Z FAILED [0.2634s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6940352Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6940355Z 2025-09-07T07:33:27.6940559Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6940562Z 2025-09-07T07:33:27.6940564Z 2025-09-07T07:33:27.6940635Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6940824Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.6940826Z 2025-09-07T07:33:27.6940910Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6940971Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.6941038Z ================== 1 failed, 220 deselected, 2 rerun in 1.35s ================== 2025-09-07T07:33:27.6941074Z Got exit code 1 2025-09-07T07:33:27.6941200Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.6941619Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.6941658Z import pkg_resources 2025-09-07T07:33:27.6941827Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-3a62d9bd5291dd97.xml 2025-09-07T07:33:27.6941881Z ============================= test session starts ============================== 2025-09-07T07:33:27.6941993Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.6942048Z cachedir: .pytest_cache 2025-09-07T07:33:27.6942205Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.6942265Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.6942304Z configfile: pytest.ini 2025-09-07T07:33:27.6942465Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.6942539Z collecting ... collected 467 items / 55 deselected / 412 selected 2025-09-07T07:33:27.6943991Z stepcurrent: skipping 55 already run items. 2025-09-07T07:33:27.6944035Z Running 166 items in this shard 2025-09-07T07:33:27.6944037Z 2025-09-07T07:33:27.6944213Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cpu_dynamic_False_autograd_False PASSED [1.6050s] [ 0%] 2025-09-07T07:33:27.6944377Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cpu_dynamic_True_autograd_False PASSED [1.9818s] [ 1%] 2025-09-07T07:33:27.6944598Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2752s] [ 1%] 2025-09-07T07:33:27.6944790Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2183s] [ 1%] 2025-09-07T07:33:27.6944954Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True FAILED [0.2140s] [ 1%] 2025-09-07T07:33:27.6944956Z 2025-09-07T07:33:27.6945006Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.6945112Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6945156Z Traceback (most recent call last): 2025-09-07T07:33:27.6945304Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.6945367Z self._run_test( 2025-09-07T07:33:27.6945482Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6945538Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6945580Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6945713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6945761Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6945800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6945954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6945999Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6946039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6946173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6947536Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6947575Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6947718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6947798Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6947838Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6947990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6948037Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6948185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6948239Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6948496Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6948658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6948710Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6948749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6948865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6948935Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6948978Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6949107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6949170Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6949213Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6949371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6949417Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6950759Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6950900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6950940Z return aot_autograd( 2025-09-07T07:33:27.6950975Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6951111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6951180Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6951227Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6951387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6951491Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6951538Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6951718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6951761Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6951946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6951986Z fx_g = _create_graph( 2025-09-07T07:33:27.6952022Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6952184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6952219Z fx_g = make_fx( 2025-09-07T07:33:27.6952251Z ^^^^^^^^ 2025-09-07T07:33:27.6952404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6952451Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6952490Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6952635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6954061Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6954099Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6954263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6954302Z t = dispatch_trace( 2025-09-07T07:33:27.6954336Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6954448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6954491Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6954555Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6954700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6954742Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6954778Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6954938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6955017Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6955059Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6955183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6955223Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6955257Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6955384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6955427Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6955482Z ^^^^^^^^^ 2025-09-07T07:33:27.6955614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6956976Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6957013Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6957162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6957212Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6957246Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6957402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6957465Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6957510Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6957709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6957749Z outs_pair = fn(*args) 2025-09-07T07:33:27.6957785Z ^^^^^^^^^ 2025-09-07T07:33:27.6957954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6958021Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6958065Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6958238Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6958277Z outs_pair = fn(*args) 2025-09-07T07:33:27.6958311Z ^^^^^^^^^ 2025-09-07T07:33:27.6958490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6958552Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6958595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6958789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6958860Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6960204Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6960379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6960418Z outs_pair = fn(*args) 2025-09-07T07:33:27.6960453Z ^^^^^^^^^ 2025-09-07T07:33:27.6960656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6960719Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6960756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6960927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6960973Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6961010Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6961135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6961177Z return handle_torch_function( 2025-09-07T07:33:27.6961213Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6961354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6961430Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6961491Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6961657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6961699Z return func(*args, **kwargs) 2025-09-07T07:33:27.6961735Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6961857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6961899Z result = _engine_run_backward( 2025-09-07T07:33:27.6963329Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6963479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6963599Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6963650Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6963804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6963845Z return user_fn(self, *args) 2025-09-07T07:33:27.6963882Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6964025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6964069Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6964106Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6964263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6964308Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6964344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6964468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6964509Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6964547Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6964711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6964763Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6964802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6964938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6964987Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6965026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6966500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6966550Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6966611Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6966823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6966883Z t = dispatch_trace( 2025-09-07T07:33:27.6966918Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6967031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6967073Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6967109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6967232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6967271Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6967306Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6967466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6967545Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6967610Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6967734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6967774Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6967808Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6967934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6967975Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6968010Z ^^^^^^^^^ 2025-09-07T07:33:27.6968157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6969520Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6969555Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6969598Z File "", line 1, in 2025-09-07T07:33:27.6969760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.6969840Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.6969886Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6970021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.6970068Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.6970107Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6970298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6970343Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6970378Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6970550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.6970596Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.6970633Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6970774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.6970816Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.6970853Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6970987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.6971076Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.6971123Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6972541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.6972621Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.6972683Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6972809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.6972848Z leaves = list(leaves) 2025-09-07T07:33:27.6972883Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.6973006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.6973041Z return func(x) 2025-09-07T07:33:27.6973158Z ^^^^^^^ 2025-09-07T07:33:27.6973295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.6973359Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.6973401Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6973568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6973635Z return func(*args, **kwargs) 2025-09-07T07:33:27.6973673Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6973856Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.6973941Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.6973943Z 2025-09-07T07:33:27.6974147Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.6974149Z 2025-09-07T07:33:27.6974151Z 2025-09-07T07:33:27.6974225Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.6974418Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.6974441Z 2025-09-07T07:33:27.6974530Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.6974604Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.6975963Z inline_call [] 2025-09-07T07:33:27.6976019Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.6976094Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.6976164Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.6976423Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.6976533Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.6976585Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.6976737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.6976826Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.6976957Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.6977076Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6977182Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.6977227Z Traceback (most recent call last): 2025-09-07T07:33:27.6977373Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.6977408Z self._run_test( 2025-09-07T07:33:27.6977543Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.6977601Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.6977661Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6977792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.6977838Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.6977878Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6979329Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.6979378Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.6979416Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6979551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.6979595Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.6979634Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6979799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.6979881Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.6979921Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6980071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.6980117Z raise BackendCompilerFailed( 2025-09-07T07:33:27.6980266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.6980320Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6980360Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6980502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.6980569Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.6980610Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6980724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.6980790Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.6980834Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6980960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.6981023Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.6982368Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6982511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.6982556Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.6982595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6982734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.6982773Z return aot_autograd( 2025-09-07T07:33:27.6982809Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.6982943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.6983013Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.6983058Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6983300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.6983382Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.6983428Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6983635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.6983695Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.6983879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.6983918Z fx_g = _create_graph( 2025-09-07T07:33:27.6983954Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6984117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.6984152Z fx_g = make_fx( 2025-09-07T07:33:27.6984185Z ^^^^^^^^ 2025-09-07T07:33:27.6985655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.6985703Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.6985745Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6985910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.6985956Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.6985992Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6986153Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6986191Z t = dispatch_trace( 2025-09-07T07:33:27.6986226Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6986338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6986380Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6986415Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6986540Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6986599Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6986636Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6986798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6986877Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6986918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6987043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6987081Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6987116Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6987242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.6988589Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.6988625Z ^^^^^^^^^ 2025-09-07T07:33:27.6988759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.6988803Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.6988839Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6988990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.6989040Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.6989075Z ^^^^^^^^^^^ 2025-09-07T07:33:27.6989230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.6989292Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.6989336Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6989511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6989570Z outs_pair = fn(*args) 2025-09-07T07:33:27.6989607Z ^^^^^^^^^ 2025-09-07T07:33:27.6989801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.6989868Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.6989912Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6990086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6990124Z outs_pair = fn(*args) 2025-09-07T07:33:27.6990158Z ^^^^^^^^^ 2025-09-07T07:33:27.6990333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.6991693Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.6991741Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6991952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.6992024Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.6992070Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6992241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.6992280Z outs_pair = fn(*args) 2025-09-07T07:33:27.6992314Z ^^^^^^^^^ 2025-09-07T07:33:27.6992504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.6992549Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.6992587Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6992768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.6992816Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.6992853Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6992977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.6993021Z return handle_torch_function( 2025-09-07T07:33:27.6993057Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6993283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.6993357Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.6993404Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6993571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.6993615Z return func(*args, **kwargs) 2025-09-07T07:33:27.6994965Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6995090Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.6995132Z result = _engine_run_backward( 2025-09-07T07:33:27.6995169Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6995313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.6995432Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.6995481Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6995607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.6995671Z return user_fn(self, *args) 2025-09-07T07:33:27.6995708Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6995871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.6995916Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.6995953Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6996114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.6996157Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.6996193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6996315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6996355Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6996390Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6996554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.6996624Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.6997982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6998119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.6998169Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.6998209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6998369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.6998417Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.6998455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6998613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.6998672Z t = dispatch_trace( 2025-09-07T07:33:27.6998708Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6998822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.6998865Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.6998901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6999025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6999063Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6999099Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6999259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.6999337Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.6999378Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.6999503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.6999543Z return fn(*args, **kwargs) 2025-09-07T07:33:27.6999579Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7001001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7001045Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7001080Z ^^^^^^^^^ 2025-09-07T07:33:27.7001228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7001278Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7001311Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7001354Z File "", line 1, in 2025-09-07T07:33:27.7001496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7001590Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7001638Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7001786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7001833Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7001873Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7002062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7002106Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7002142Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7002311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7002355Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7002393Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7002550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7002595Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7002631Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7004125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7004215Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7004263Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7004387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7004448Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7004492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7004619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7004686Z leaves = list(leaves) 2025-09-07T07:33:27.7004721Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7004843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7004878Z return func(x) 2025-09-07T07:33:27.7004911Z ^^^^^^^ 2025-09-07T07:33:27.7005047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7005112Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7005154Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7005320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7005361Z return func(*args, **kwargs) 2025-09-07T07:33:27.7005398Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7005579Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7005666Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7005668Z 2025-09-07T07:33:27.7005877Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7005879Z 2025-09-07T07:33:27.7005881Z 2025-09-07T07:33:27.7007309Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7007503Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7007507Z 2025-09-07T07:33:27.7007592Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7007687Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7007724Z inline_call [] 2025-09-07T07:33:27.7007795Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7007871Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7007942Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7008204Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7008315Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7008367Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7008517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7008603Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7008752Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7008873Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7008944Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7008979Z inline_call [] 2025-09-07T07:33:27.7009033Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7009106Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7009175Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7009429Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7009539Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7010913Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7011062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7011147Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7011276Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7011395Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7011445Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7011552Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7011595Z Traceback (most recent call last): 2025-09-07T07:33:27.7011743Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.7011780Z self._run_test( 2025-09-07T07:33:27.7011892Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7011947Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7011988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7012118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7012165Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7012204Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7012354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7012400Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7012439Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7012597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7012657Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7014052Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7014199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7014280Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7014319Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7014472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7014517Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7014666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7014720Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7014788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7014930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7014982Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7015021Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7015137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7015203Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7015247Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7015372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7015436Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7015479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7015637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7015682Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7015720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7015856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7017200Z return aot_autograd( 2025-09-07T07:33:27.7017237Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7017376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7017445Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7017492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7017654Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7017739Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7017785Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7017968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7018010Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7018196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7018235Z fx_g = _create_graph( 2025-09-07T07:33:27.7018271Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7018432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7018468Z fx_g = make_fx( 2025-09-07T07:33:27.7018521Z ^^^^^^^^ 2025-09-07T07:33:27.7018674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7018740Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7018778Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7018923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7018965Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7020299Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7020458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7020497Z t = dispatch_trace( 2025-09-07T07:33:27.7020531Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7020644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7020687Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7020725Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7020868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7020910Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7020946Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7021107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7021185Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7021227Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7021350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7021389Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7021423Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7021552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7021608Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7021643Z ^^^^^^^^^ 2025-09-07T07:33:27.7021774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7021815Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7021851Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7023658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7023713Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7023748Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7023904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7023967Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7024014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7024196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7024237Z outs_pair = fn(*args) 2025-09-07T07:33:27.7024272Z ^^^^^^^^^ 2025-09-07T07:33:27.7024441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7024507Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7024552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7024725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7024764Z outs_pair = fn(*args) 2025-09-07T07:33:27.7024798Z ^^^^^^^^^ 2025-09-07T07:33:27.7025004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7025082Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7025126Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7025320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7025390Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7025436Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7026949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7026990Z outs_pair = fn(*args) 2025-09-07T07:33:27.7027026Z ^^^^^^^^^ 2025-09-07T07:33:27.7027236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7027286Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7027323Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7027490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7027536Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7027574Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7027700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7027744Z return handle_torch_function( 2025-09-07T07:33:27.7027780Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7027925Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7028003Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7028074Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7028245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7028285Z return func(*args, **kwargs) 2025-09-07T07:33:27.7028322Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7028443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7028486Z result = _engine_run_backward( 2025-09-07T07:33:27.7028522Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7028667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7030092Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7030146Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7030274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7030317Z return user_fn(self, *args) 2025-09-07T07:33:27.7030353Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7030496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7030540Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7030578Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7030733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7030778Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7030814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7030958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7031000Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7031051Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7031216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7031268Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7031307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7031441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7031491Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7031530Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7031690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7033061Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7033161Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7033350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7033390Z t = dispatch_trace( 2025-09-07T07:33:27.7033424Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7033538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7033581Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7033618Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7033741Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7033781Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7033815Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7033975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7034080Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7034124Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7034246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7034286Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7034320Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7034449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7034491Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7034527Z ^^^^^^^^^ 2025-09-07T07:33:27.7034674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7034723Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7036072Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7036119Z File "", line 1, in 2025-09-07T07:33:27.7036266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7036346Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7036392Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7036526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7036574Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7036612Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7036801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7036844Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7036881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7037075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7037137Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7037174Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7037317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7037359Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7037396Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7037529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7037620Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7037667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7037794Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7037856Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7039250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7039380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7039419Z leaves = list(leaves) 2025-09-07T07:33:27.7039454Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7039577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7039612Z return func(x) 2025-09-07T07:33:27.7039646Z ^^^^^^^ 2025-09-07T07:33:27.7039785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7039850Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7039892Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7040059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7040114Z return func(*args, **kwargs) 2025-09-07T07:33:27.7040150Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7040331Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7040415Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7040417Z 2025-09-07T07:33:27.7040624Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7040626Z 2025-09-07T07:33:27.7040628Z 2025-09-07T07:33:27.7040702Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7040894Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7040898Z 2025-09-07T07:33:27.7040986Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7041062Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7041098Z inline_call [] 2025-09-07T07:33:27.7042463Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7042540Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7042612Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7042868Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7042979Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7043047Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7043284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7043393Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7043524Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7043643Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7043713Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7043748Z inline_call [] 2025-09-07T07:33:27.7043802Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7043874Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7043944Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7044215Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7044328Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7044378Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7044527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7044613Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7044745Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7044863Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7046255Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7046313Z inline_call [] 2025-09-07T07:33:27.7046369Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7046441Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7046511Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7046824Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7046933Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7046983Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7047130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7047214Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7047345Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7047463Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7047679Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-3a62d9bd5291dd97.xml - 2025-09-07T07:33:27.7047737Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7048097Z FAILED [0.2140s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7048180Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7048182Z 2025-09-07T07:33:27.7048410Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7048430Z 2025-09-07T07:33:27.7048432Z 2025-09-07T07:33:27.7048503Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7048695Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7048698Z 2025-09-07T07:33:27.7048781Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7048842Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7050238Z ============= 1 failed, 2 passed, 55 deselected, 2 rerun in 4.47s ============== 2025-09-07T07:33:27.7050276Z Got exit code 1 2025-09-07T07:33:27.7050314Z Retrying single test... 2025-09-07T07:33:27.7050758Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7050800Z import pkg_resources 2025-09-07T07:33:27.7050968Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-3fc27e6294aa8d25.xml 2025-09-07T07:33:27.7051025Z ============================= test session starts ============================== 2025-09-07T07:33:27.7051136Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7051174Z cachedir: .pytest_cache 2025-09-07T07:33:27.7051330Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7051376Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7051429Z configfile: pytest.ini 2025-09-07T07:33:27.7051590Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7051666Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.7051894Z stepcurrent: skipping 57 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7051937Z Running 1 items in this shard 2025-09-07T07:33:27.7051939Z 2025-09-07T07:33:27.7052134Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5366s] [100%] 2025-09-07T07:33:27.7052324Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2222s] [100%] 2025-09-07T07:33:27.7052492Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True FAILED [0.2157s] [100%] 2025-09-07T07:33:27.7052496Z 2025-09-07T07:33:27.7052545Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7052651Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7054054Z Traceback (most recent call last): 2025-09-07T07:33:27.7054206Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.7054242Z self._run_test( 2025-09-07T07:33:27.7054355Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7054410Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7054451Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7054611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7054676Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7054717Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7054866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7054913Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7054952Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7055088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7055132Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7055171Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7055314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7055397Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7055460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7060036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7060083Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7060233Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7060287Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7060329Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7060470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7060522Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7060561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7060679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7060775Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7060821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7060947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7061011Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7061052Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7061193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7061237Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7061276Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7061415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7061459Z return aot_autograd( 2025-09-07T07:33:27.7061494Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7061632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7061701Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7061747Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7061912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7061996Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7062044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7062226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7062271Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7062472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7062527Z fx_g = _create_graph( 2025-09-07T07:33:27.7062564Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7062728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7062765Z fx_g = make_fx( 2025-09-07T07:33:27.7062800Z ^^^^^^^^ 2025-09-07T07:33:27.7062953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7063004Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7063044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7063254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7063300Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7063359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7063518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7063557Z t = dispatch_trace( 2025-09-07T07:33:27.7063592Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7063707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7063749Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7063786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7063912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7063953Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7065505Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7065673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7065781Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7065824Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7065949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7065988Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7066024Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7066149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7066192Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7066227Z ^^^^^^^^^ 2025-09-07T07:33:27.7066359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7066399Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7066435Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7066586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7066636Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7066671Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7066827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7066889Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7066934Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7067108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7067147Z outs_pair = fn(*args) 2025-09-07T07:33:27.7067183Z ^^^^^^^^^ 2025-09-07T07:33:27.7068701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7068774Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7068835Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7069012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7069050Z outs_pair = fn(*args) 2025-09-07T07:33:27.7069085Z ^^^^^^^^^ 2025-09-07T07:33:27.7069261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7069323Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7069366Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7069559Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7069632Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7069692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7069864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7069904Z outs_pair = fn(*args) 2025-09-07T07:33:27.7069938Z ^^^^^^^^^ 2025-09-07T07:33:27.7070127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7070172Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7070209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7070376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7070424Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7070478Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7071911Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7071956Z return handle_torch_function( 2025-09-07T07:33:27.7071993Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7072134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7072210Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7072256Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7072423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7072464Z return func(*args, **kwargs) 2025-09-07T07:33:27.7072500Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7072624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7072669Z result = _engine_run_backward( 2025-09-07T07:33:27.7072707Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7072851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7072972Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7073021Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7073231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7073272Z return user_fn(self, *args) 2025-09-07T07:33:27.7073309Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7073476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7073522Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7073576Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7073733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7075098Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7075137Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7075260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7075301Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7075336Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7075500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7075551Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7075594Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7075753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7075805Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7075844Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7076008Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7076055Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7076094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7076253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7076291Z t = dispatch_trace( 2025-09-07T07:33:27.7076326Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7076438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7076501Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7076539Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7076664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7076703Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7078043Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7078203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7078283Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7078324Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7078449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7078487Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7078523Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7078649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7078695Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7078729Z ^^^^^^^^^ 2025-09-07T07:33:27.7078879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7078928Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7078962Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7079004Z File "", line 1, in 2025-09-07T07:33:27.7079146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7079225Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7079271Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7079423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7079473Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7079531Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7079721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7081068Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7081105Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7081276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7081320Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7081358Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7081500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7081544Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7081581Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7081749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7081837Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7081885Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7082009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7082072Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7082117Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7082243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7082282Z leaves = list(leaves) 2025-09-07T07:33:27.7082317Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7082439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7082492Z return func(x) 2025-09-07T07:33:27.7082524Z ^^^^^^^ 2025-09-07T07:33:27.7082662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7082726Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7084170Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7084339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7084381Z return func(*args, **kwargs) 2025-09-07T07:33:27.7084416Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7084597Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7084685Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7084688Z 2025-09-07T07:33:27.7084897Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7084901Z 2025-09-07T07:33:27.7084903Z 2025-09-07T07:33:27.7084975Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7085167Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7085170Z 2025-09-07T07:33:27.7085254Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7085329Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7085364Z inline_call [] 2025-09-07T07:33:27.7085418Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7085453Z inductor [] 2025-09-07T07:33:27.7085558Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7085651Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7085908Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7086021Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7086071Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7086221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7086307Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7087841Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7087990Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7088099Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7088144Z Traceback (most recent call last): 2025-09-07T07:33:27.7088289Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.7088325Z self._run_test( 2025-09-07T07:33:27.7088437Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7088492Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7088533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7088663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7088710Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7088768Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7088920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7088966Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7089008Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7089143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7089188Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7089226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7089368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7089448Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7089487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7089638Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7090996Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7091146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7091200Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7091240Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7091383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7091434Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7091473Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7091589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7091655Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7091715Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7091857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7091920Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7091962Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7092102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7092146Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7092184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7092322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7092362Z return aot_autograd( 2025-09-07T07:33:27.7092397Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7092533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7092617Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7094114Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7094277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7094361Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7094407Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7094591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7094633Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7094819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7094887Z fx_g = _create_graph( 2025-09-07T07:33:27.7094924Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7095086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7095122Z fx_g = make_fx( 2025-09-07T07:33:27.7095154Z ^^^^^^^^ 2025-09-07T07:33:27.7095306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7095352Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7095391Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7095537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7095580Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7095616Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7095777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7095817Z t = dispatch_trace( 2025-09-07T07:33:27.7095852Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7095964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7097320Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7097358Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7097482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7097522Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7097558Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7097719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7097797Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7097863Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7097990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7098046Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7098081Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7098209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7098253Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7098288Z ^^^^^^^^^ 2025-09-07T07:33:27.7098420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7098461Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7098497Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7098645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7098695Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7098731Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7098906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7100275Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7100321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7100500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7100539Z outs_pair = fn(*args) 2025-09-07T07:33:27.7100574Z ^^^^^^^^^ 2025-09-07T07:33:27.7100744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7100811Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7100857Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7101045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7101086Z outs_pair = fn(*args) 2025-09-07T07:33:27.7101120Z ^^^^^^^^^ 2025-09-07T07:33:27.7101296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7101356Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7101399Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7101591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7101661Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7101708Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7101880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7101919Z outs_pair = fn(*args) 2025-09-07T07:33:27.7101954Z ^^^^^^^^^ 2025-09-07T07:33:27.7102141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7102187Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7103612Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7103787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7103834Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7103871Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7104023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7104068Z return handle_torch_function( 2025-09-07T07:33:27.7104125Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7104266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7104342Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7104388Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7104553Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7104595Z return func(*args, **kwargs) 2025-09-07T07:33:27.7104631Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7104754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7104795Z result = _engine_run_backward( 2025-09-07T07:33:27.7104833Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7104997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7105118Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7105169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7105294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7105336Z return user_fn(self, *args) 2025-09-07T07:33:27.7106693Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7106840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7106883Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7106921Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7107099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7107145Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7107181Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7107305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7107344Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7107380Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7107542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7107595Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7107635Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7107769Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7107820Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7107861Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7108020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7108068Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7108107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7108264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7108302Z t = dispatch_trace( 2025-09-07T07:33:27.7108337Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7109751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7109796Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7109832Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7109976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7110033Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7110068Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7110229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7110309Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7110351Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7110474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7110514Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7110548Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7110675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7110716Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7110753Z ^^^^^^^^^ 2025-09-07T07:33:27.7110914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7110965Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7110999Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7111042Z File "", line 1, in 2025-09-07T07:33:27.7111183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7111262Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7111307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7112740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7112788Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7112828Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7113035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7113170Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7113206Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7113380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7113424Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7113461Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7113605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7113648Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7113684Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7113819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7113911Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7113958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7114085Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7114145Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7114189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7114315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7114354Z leaves = list(leaves) 2025-09-07T07:33:27.7114389Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7115828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7115866Z return func(x) 2025-09-07T07:33:27.7115900Z ^^^^^^^ 2025-09-07T07:33:27.7116065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7116150Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7116191Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7116357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7116397Z return func(*args, **kwargs) 2025-09-07T07:33:27.7116434Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7116615Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7116700Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7116702Z 2025-09-07T07:33:27.7116907Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7116931Z 2025-09-07T07:33:27.7116934Z 2025-09-07T07:33:27.7117008Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7117203Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7117205Z 2025-09-07T07:33:27.7117291Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7117365Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7117401Z inline_call [] 2025-09-07T07:33:27.7117456Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7117491Z inductor [] 2025-09-07T07:33:27.7117565Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7117638Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7117912Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7119337Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7119389Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7119541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7119626Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7119757Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7119875Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7119948Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7119983Z inline_call [] 2025-09-07T07:33:27.7120039Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7120111Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7120180Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7120435Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7120545Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7120595Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7120743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7120843Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7120975Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7121107Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7121156Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7121263Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7121307Z Traceback (most recent call last): 2025-09-07T07:33:27.7122758Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.7122796Z self._run_test( 2025-09-07T07:33:27.7122909Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7122963Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7123007Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7123227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7123276Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7123315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7123465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7123511Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7123551Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7123685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7123730Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7123769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7123912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7124020Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7124060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7124211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7124258Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7124407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7124461Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7124501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7125959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7126013Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7126056Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7126172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7126241Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7126285Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7126412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7126475Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7126518Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7126658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7126752Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7126791Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7126950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7127009Z return aot_autograd( 2025-09-07T07:33:27.7127044Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7127181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7127250Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7127296Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7127457Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7127539Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7127584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7129075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7129140Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7129328Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7129367Z fx_g = _create_graph( 2025-09-07T07:33:27.7129403Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7129565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7129600Z fx_g = make_fx( 2025-09-07T07:33:27.7129633Z ^^^^^^^^ 2025-09-07T07:33:27.7129785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7129832Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7129872Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7130020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7130080Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7130117Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7130276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7130314Z t = dispatch_trace( 2025-09-07T07:33:27.7130348Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7130461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7130502Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7130539Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7130662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7130703Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7132039Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7132205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7132284Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7132327Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7132451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7132491Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7132526Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7132652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7132693Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7132729Z ^^^^^^^^^ 2025-09-07T07:33:27.7132860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7132921Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7132959Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7133174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7133224Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7133259Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7133415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7133478Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7133522Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7133697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7133736Z outs_pair = fn(*args) 2025-09-07T07:33:27.7135084Z ^^^^^^^^^ 2025-09-07T07:33:27.7135687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7135757Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7135802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7135974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7136012Z outs_pair = fn(*args) 2025-09-07T07:33:27.7136046Z ^^^^^^^^^ 2025-09-07T07:33:27.7136221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7136280Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7136324Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7136516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7136607Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7136652Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7136823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7136861Z outs_pair = fn(*args) 2025-09-07T07:33:27.7136896Z ^^^^^^^^^ 2025-09-07T07:33:27.7137083Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7137129Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7137166Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7137333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7137382Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7137420Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7138861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7138906Z return handle_torch_function( 2025-09-07T07:33:27.7138942Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7139082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7139156Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7139203Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7139369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7139411Z return func(*args, **kwargs) 2025-09-07T07:33:27.7139472Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7139616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7139657Z result = _engine_run_backward( 2025-09-07T07:33:27.7139694Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7139838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7139958Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7140007Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7140133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7140175Z return user_fn(self, *args) 2025-09-07T07:33:27.7140211Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7140368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7140413Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7140451Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7140608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7141964Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7142001Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7142129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7142169Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7142205Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7142370Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7142423Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7142481Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7142619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7142668Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7142708Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7142868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7142916Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7142955Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7143241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7143280Z t = dispatch_trace( 2025-09-07T07:33:27.7143315Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7143430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7143474Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7143511Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7143634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7145008Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7145044Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7145205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7145283Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7145326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7145448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7145488Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7145550Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7145694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7145735Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7145771Z ^^^^^^^^^ 2025-09-07T07:33:27.7145919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7145969Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7146003Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7146045Z File "", line 1, in 2025-09-07T07:33:27.7146186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7146264Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7146310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7146474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7146523Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7146562Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7146752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7148107Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7148144Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7148314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7148358Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7148396Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7148539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7148607Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7148645Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7148779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7148869Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7148915Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7149040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7149100Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7149145Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7149270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7149310Z leaves = list(leaves) 2025-09-07T07:33:27.7149347Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7149471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7149506Z return func(x) 2025-09-07T07:33:27.7149539Z ^^^^^^^ 2025-09-07T07:33:27.7149675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7151039Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7151082Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7151249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7151289Z return func(*args, **kwargs) 2025-09-07T07:33:27.7151326Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7151523Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7151611Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7151626Z 2025-09-07T07:33:27.7151830Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7151833Z 2025-09-07T07:33:27.7151834Z 2025-09-07T07:33:27.7151908Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7152100Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7152102Z 2025-09-07T07:33:27.7152188Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7152261Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7152297Z inline_call [] 2025-09-07T07:33:27.7152353Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7152389Z inductor [] 2025-09-07T07:33:27.7152476Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7152549Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7152803Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7152915Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7152965Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7153176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7153261Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7154749Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7154871Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7154943Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7154977Z inline_call [] 2025-09-07T07:33:27.7155032Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7155104Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7155174Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7155426Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7155537Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7155589Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7155741Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7155825Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7155954Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7156071Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7156140Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7156175Z inline_call [] 2025-09-07T07:33:27.7156228Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7156300Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7156392Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7156646Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7156771Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7158131Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7158280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7158364Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7158492Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7158612Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7158851Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-3fc27e6294aa8d25.xml - 2025-09-07T07:33:27.7158913Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7159275Z FAILED [0.2157s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7159358Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7159360Z 2025-09-07T07:33:27.7159563Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7159566Z 2025-09-07T07:33:27.7159568Z 2025-09-07T07:33:27.7159640Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7159848Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7159851Z 2025-09-07T07:33:27.7159934Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7159995Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7160060Z ================== 1 failed, 220 deselected, 2 rerun in 1.14s ================== 2025-09-07T07:33:27.7160096Z Got exit code 1 2025-09-07T07:33:27.7160134Z Retrying single test... 2025-09-07T07:33:27.7160560Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7160601Z import pkg_resources 2025-09-07T07:33:27.7160772Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-90d4a8d4c7328812.xml 2025-09-07T07:33:27.7160829Z ============================= test session starts ============================== 2025-09-07T07:33:27.7162247Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7162287Z cachedir: .pytest_cache 2025-09-07T07:33:27.7162443Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7162488Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7162527Z configfile: pytest.ini 2025-09-07T07:33:27.7162690Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7162766Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.7163010Z stepcurrent: skipping 57 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7163125Z Running 1 items in this shard 2025-09-07T07:33:27.7163127Z 2025-09-07T07:33:27.7163322Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5352s] [100%] 2025-09-07T07:33:27.7163514Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2352s] [100%] 2025-09-07T07:33:27.7163680Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True FAILED [0.2195s] [100%] 2025-09-07T07:33:27.7163682Z 2025-09-07T07:33:27.7163732Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7163840Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7163906Z Traceback (most recent call last): 2025-09-07T07:33:27.7164056Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.7164093Z self._run_test( 2025-09-07T07:33:27.7164206Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7164262Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7164303Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7164437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7164483Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7165837Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7165991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7166063Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7166102Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7166237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7166282Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7166320Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7166463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7166544Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7166584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7166811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7166860Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7167011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7167066Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7167107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7167249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7167300Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7167340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7167458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7167525Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7167569Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7169040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7169108Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7169175Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7169315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7169361Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7169398Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7169538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7169577Z return aot_autograd( 2025-09-07T07:33:27.7169612Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7169746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7169816Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7169865Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7170039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7170123Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7170169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7170352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7170396Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7170581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7170620Z fx_g = _create_graph( 2025-09-07T07:33:27.7170656Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7170820Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7170870Z fx_g = make_fx( 2025-09-07T07:33:27.7172223Z ^^^^^^^^ 2025-09-07T07:33:27.7172377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7172424Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7172463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7172609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7172653Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7172689Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7172847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7172885Z t = dispatch_trace( 2025-09-07T07:33:27.7172922Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7173035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7173179Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7173215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7173341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7173382Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7173419Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7173579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7173659Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7173700Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7173849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7173890Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7175281Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7175410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7175452Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7175488Z ^^^^^^^^^ 2025-09-07T07:33:27.7175620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7175662Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7175697Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7175849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7175898Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7175932Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7176088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7176175Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7176219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7176393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7176433Z outs_pair = fn(*args) 2025-09-07T07:33:27.7176469Z ^^^^^^^^^ 2025-09-07T07:33:27.7176638Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7176705Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7176749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7176923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7176981Z outs_pair = fn(*args) 2025-09-07T07:33:27.7177017Z ^^^^^^^^^ 2025-09-07T07:33:27.7178510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7178572Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7178615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7178809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7178879Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7178925Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7179096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7179136Z outs_pair = fn(*args) 2025-09-07T07:33:27.7179173Z ^^^^^^^^^ 2025-09-07T07:33:27.7179360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7179406Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7179443Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7179610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7179656Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7179695Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7179818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7179862Z return handle_torch_function( 2025-09-07T07:33:27.7179915Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7180059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7180150Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7180197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7180365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7181721Z return func(*args, **kwargs) 2025-09-07T07:33:27.7181757Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7181882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7181924Z result = _engine_run_backward( 2025-09-07T07:33:27.7181961Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7182110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7182250Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7182302Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7182428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7182470Z return user_fn(self, *args) 2025-09-07T07:33:27.7182507Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7182650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7182695Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7182732Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7182889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7182949Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7182986Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7183191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7183231Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7183268Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7183430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7184814Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7184856Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7184993Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7185043Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7185083Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7185246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7185295Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7185334Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7185495Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7185534Z t = dispatch_trace( 2025-09-07T07:33:27.7185569Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7185682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7185726Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7185762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7185886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7185925Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7185994Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7186156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7186254Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7186295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7186420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7186458Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7187821Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7187950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7187993Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7188027Z ^^^^^^^^^ 2025-09-07T07:33:27.7188177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7188251Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7188287Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7188331Z File "", line 1, in 2025-09-07T07:33:27.7188476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7188555Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7188601Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7188736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7188785Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7188824Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7189016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7189081Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7189119Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7189289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7189334Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7189372Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7189517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7190885Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7190923Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7191059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7191147Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7191197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7191325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7191386Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7191430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7191555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7191593Z leaves = list(leaves) 2025-09-07T07:33:27.7191629Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7191750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7191785Z return func(x) 2025-09-07T07:33:27.7191819Z ^^^^^^^ 2025-09-07T07:33:27.7191956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7192047Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7192105Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7192275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7192315Z return func(*args, **kwargs) 2025-09-07T07:33:27.7192352Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7192533Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7192619Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7192621Z 2025-09-07T07:33:27.7194223Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7194226Z 2025-09-07T07:33:27.7194229Z 2025-09-07T07:33:27.7194306Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7194526Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7194529Z 2025-09-07T07:33:27.7194614Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7194689Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7194724Z inline_call [] 2025-09-07T07:33:27.7194779Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7194814Z inductor [] 2025-09-07T07:33:27.7194888Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7194960Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7195218Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7195352Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7195403Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7195554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7195641Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7195774Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7195892Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7196000Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7196044Z Traceback (most recent call last): 2025-09-07T07:33:27.7196192Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.7196228Z self._run_test( 2025-09-07T07:33:27.7197665Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7197722Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7197763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7197896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7197943Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7197982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7198133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7198179Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7198240Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7198378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7198440Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7198478Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7198620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7198701Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7198740Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7198892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7198937Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7199090Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7199145Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7199200Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7199342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7199395Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7200831Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7200953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7201019Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7201064Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7201191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7201254Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7201297Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7201454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7201500Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7201538Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7201674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7201714Z return aot_autograd( 2025-09-07T07:33:27.7201748Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7201883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7201952Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7201998Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7202160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7202245Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7202290Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7202474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7202517Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7204421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7204465Z fx_g = _create_graph( 2025-09-07T07:33:27.7204501Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7204665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7204700Z fx_g = make_fx( 2025-09-07T07:33:27.7204760Z ^^^^^^^^ 2025-09-07T07:33:27.7204914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7204978Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7205016Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7205162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7205204Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7205242Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7205398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7205436Z t = dispatch_trace( 2025-09-07T07:33:27.7205470Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7205582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7205627Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7205680Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7205807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7205848Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7205883Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7206047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7207593Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7207638Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7207765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7207806Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7207840Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7207971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7208042Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7208077Z ^^^^^^^^^ 2025-09-07T07:33:27.7208211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7208252Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7208288Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7208437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7208488Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7208522Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7208681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7208743Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7208790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7208967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7209008Z outs_pair = fn(*args) 2025-09-07T07:33:27.7209042Z ^^^^^^^^^ 2025-09-07T07:33:27.7209214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7209280Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7210658Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7213188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7213228Z outs_pair = fn(*args) 2025-09-07T07:33:27.7213263Z ^^^^^^^^^ 2025-09-07T07:33:27.7213470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7213546Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7213590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7213785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7213856Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7213901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7214076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7214115Z outs_pair = fn(*args) 2025-09-07T07:33:27.7214150Z ^^^^^^^^^ 2025-09-07T07:33:27.7214362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7214411Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7214448Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7214618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7214664Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7214702Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7214828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7214871Z return handle_torch_function( 2025-09-07T07:33:27.7216262Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7216409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7216511Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7216559Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7216736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7216779Z return func(*args, **kwargs) 2025-09-07T07:33:27.7216817Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7216943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7216987Z result = _engine_run_backward( 2025-09-07T07:33:27.7217024Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7217172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7217294Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7217347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7217477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7217520Z return user_fn(self, *args) 2025-09-07T07:33:27.7217557Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7217704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7217749Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7217787Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7217946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7217992Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7218028Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7219524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7219583Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7219621Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7219789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7219842Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7219884Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7220030Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7220080Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7220120Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7220284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7220333Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7220423Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7220586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7220626Z t = dispatch_trace( 2025-09-07T07:33:27.7220662Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7220778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7220821Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7220859Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7220986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7221026Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7221062Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7222574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7222676Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7222721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7222847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7222888Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7222923Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7223055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7223186Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7223222Z ^^^^^^^^^ 2025-09-07T07:33:27.7223375Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7223426Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7223460Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7223506Z File "", line 1, in 2025-09-07T07:33:27.7223657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7223738Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7223786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7223924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7223973Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7224011Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7224207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7224251Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7224288Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7225852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7225925Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7225963Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7226109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7226153Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7226190Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7226326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7226416Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7226463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7226593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7226671Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7226718Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7226849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7226890Z leaves = list(leaves) 2025-09-07T07:33:27.7226925Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7227052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7227087Z return func(x) 2025-09-07T07:33:27.7227121Z ^^^^^^^ 2025-09-07T07:33:27.7227261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7227326Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7227369Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7228931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7228975Z return func(*args, **kwargs) 2025-09-07T07:33:27.7229012Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7229199Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7229285Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7229288Z 2025-09-07T07:33:27.7229496Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7229499Z 2025-09-07T07:33:27.7229501Z 2025-09-07T07:33:27.7229577Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7229775Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7229779Z 2025-09-07T07:33:27.7229868Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7229942Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7229979Z inline_call [] 2025-09-07T07:33:27.7230034Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7230070Z inductor [] 2025-09-07T07:33:27.7230145Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7230220Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7230486Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7230618Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7230674Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7230841Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7230929Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7231063Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7231185Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7232603Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7232640Z inline_call [] 2025-09-07T07:33:27.7232695Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7232769Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7232842Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7233238Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7233350Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7233402Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7233554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7233640Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7233773Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7233894Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7233965Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7234078Z _ WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7234123Z Traceback (most recent call last): 2025-09-07T07:33:27.7234273Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1285, in test_while_loop_with_parameters 2025-09-07T07:33:27.7234309Z self._run_test( 2025-09-07T07:33:27.7234425Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7234481Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7234524Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7234657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7236064Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7236107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7236263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7236311Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7236352Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7236490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7236535Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7236574Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7236720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7236802Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7236842Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7237020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7237084Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7237236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7237290Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7237331Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7237473Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7237526Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7237565Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7237683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7237749Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7237796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7239275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7239345Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7239387Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7239529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7239575Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7239614Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7239754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7239794Z return aot_autograd( 2025-09-07T07:33:27.7239829Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7239966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7240053Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7240101Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7240263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7240348Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7240393Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7240581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7240624Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7240814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7240856Z fx_g = _create_graph( 2025-09-07T07:33:27.7240893Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7241060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7242429Z fx_g = make_fx( 2025-09-07T07:33:27.7242464Z ^^^^^^^^ 2025-09-07T07:33:27.7242618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7242664Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7242704Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7242852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7242895Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7242932Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7243204Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7243246Z t = dispatch_trace( 2025-09-07T07:33:27.7243298Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7243413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7243455Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7243491Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7243617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7243658Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7243694Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7243857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7243936Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7243978Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7244130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7244171Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7245557Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7245687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7245730Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7245765Z ^^^^^^^^^ 2025-09-07T07:33:27.7245898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7245939Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7245974Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7246123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7246172Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7246233Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7246393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7246456Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7246502Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7246810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7246851Z outs_pair = fn(*args) 2025-09-07T07:33:27.7246886Z ^^^^^^^^^ 2025-09-07T07:33:27.7247060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7247126Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7247171Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7247346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7247386Z outs_pair = fn(*args) 2025-09-07T07:33:27.7247421Z ^^^^^^^^^ 2025-09-07T07:33:27.7248931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7248992Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7249036Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7249230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7249301Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7249347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7249545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7249596Z outs_pair = fn(*args) 2025-09-07T07:33:27.7249632Z ^^^^^^^^^ 2025-09-07T07:33:27.7249824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7249871Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7249907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7250077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7250123Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7250160Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7250285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7250330Z return handle_torch_function( 2025-09-07T07:33:27.7250381Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7250524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7250600Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7250646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7252145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7252188Z return func(*args, **kwargs) 2025-09-07T07:33:27.7252224Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7252354Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7252395Z result = _engine_run_backward( 2025-09-07T07:33:27.7252431Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7252599Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7252720Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7252770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7252897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7252939Z return user_fn(self, *args) 2025-09-07T07:33:27.7252975Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7253206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7253250Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7253287Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7253445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7253492Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7253528Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7253653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7253693Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7253728Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7253892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7255274Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7255315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7255452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7255528Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7255569Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7255753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7255802Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7255841Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7255999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7256039Z t = dispatch_trace( 2025-09-07T07:33:27.7256074Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7256188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7256231Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7256268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7256394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7256453Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7256490Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7256650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7256728Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7256769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7256893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7258250Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7258286Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7258414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7258455Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7258491Z ^^^^^^^^^ 2025-09-07T07:33:27.7258665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7258716Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7258751Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7258794Z File "", line 1, in 2025-09-07T07:33:27.7258939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7259018Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7259065Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7259200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7259249Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7259286Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7259479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7259524Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7259561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7259730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7259775Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7259812Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7259954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7261302Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7261340Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7261475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7261582Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7261644Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7261771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7261832Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7261876Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7262001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7262041Z leaves = list(leaves) 2025-09-07T07:33:27.7262075Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7262200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7262235Z return func(x) 2025-09-07T07:33:27.7262268Z ^^^^^^^ 2025-09-07T07:33:27.7262423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7262490Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7262532Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7262699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7262741Z return func(*args, **kwargs) 2025-09-07T07:33:27.7262776Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7262960Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7263045Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7264477Z 2025-09-07T07:33:27.7264690Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7264721Z 2025-09-07T07:33:27.7264725Z 2025-09-07T07:33:27.7264799Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7264992Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7264994Z 2025-09-07T07:33:27.7265080Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7265152Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7265188Z inline_call [] 2025-09-07T07:33:27.7265241Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7265276Z inductor [] 2025-09-07T07:33:27.7265350Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7265420Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7265681Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7265794Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7265846Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7265997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7266084Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7266215Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7266335Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7266424Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7266461Z inline_call [] 2025-09-07T07:33:27.7266535Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7266609Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7268006Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7268270Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7268380Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7268432Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7268581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7268668Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7268822Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7268942Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7269013Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7269049Z inline_call [] 2025-09-07T07:33:27.7269102Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-09-07T07:33:27.7269175Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7269243Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7269497Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7269606Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 823, in forward 2025-09-07T07:33:27.7269679Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7269828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7269912Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7270041Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7270159Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7270376Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-90d4a8d4c7328812.xml - 2025-09-07T07:33:27.7271752Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7272115Z FAILED [0.2195s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7272201Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7272203Z 2025-09-07T07:33:27.7272410Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7272413Z 2025-09-07T07:33:27.7272415Z 2025-09-07T07:33:27.7272486Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7272683Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7272685Z 2025-09-07T07:33:27.7272769Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7272849Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7272933Z ================== 1 failed, 220 deselected, 2 rerun in 1.16s ================== 2025-09-07T07:33:27.7272969Z Got exit code 1 2025-09-07T07:33:27.7273174Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.7273602Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7273641Z import pkg_resources 2025-09-07T07:33:27.7273812Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-24c4fa8bb0212921.xml 2025-09-07T07:33:27.7273868Z ============================= test session starts ============================== 2025-09-07T07:33:27.7274005Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7274046Z cachedir: .pytest_cache 2025-09-07T07:33:27.7274202Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7274248Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7274286Z configfile: pytest.ini 2025-09-07T07:33:27.7274448Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7274523Z collecting ... collected 467 items / 58 deselected / 409 selected 2025-09-07T07:33:27.7275919Z stepcurrent: skipping 58 already run items. 2025-09-07T07:33:27.7275962Z Running 163 items in this shard 2025-09-07T07:33:27.7275964Z 2025-09-07T07:33:27.7276139Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_True_autograd_False PASSED [2.9108s] [ 0%] 2025-09-07T07:33:27.7276339Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_False PASSED [0.7348s] [ 1%] 2025-09-07T07:33:27.7276536Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.3057s] [ 1%] 2025-09-07T07:33:27.7276730Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2751s] [ 1%] 2025-09-07T07:33:27.7276896Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True FAILED [0.2787s] [ 1%] 2025-09-07T07:33:27.7276899Z 2025-09-07T07:33:27.7276948Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7277060Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7277108Z Traceback (most recent call last): 2025-09-07T07:33:27.7277259Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7277294Z self._run_test( 2025-09-07T07:33:27.7277407Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7277462Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7277504Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7277637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7277684Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7277724Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7277892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7277941Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7277999Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7279452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7279499Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7279537Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7279683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7279764Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7279804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7279954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7280002Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7280172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7280227Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7280268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7280410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7280461Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7280500Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7280617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7280683Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7280726Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7280854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7280933Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7280975Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7281116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7282481Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7282520Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7282658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7282697Z return aot_autograd( 2025-09-07T07:33:27.7282732Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7282871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7282939Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7282987Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7283234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7283318Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7283363Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7283546Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7283590Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7283775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7283814Z fx_g = _create_graph( 2025-09-07T07:33:27.7283850Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7284040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7284094Z fx_g = make_fx( 2025-09-07T07:33:27.7284127Z ^^^^^^^^ 2025-09-07T07:33:27.7284279Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7284325Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7284364Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7285840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7285886Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7285922Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7286081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7286118Z t = dispatch_trace( 2025-09-07T07:33:27.7286155Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7286289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7286333Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7286368Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7286494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7286535Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7286571Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7286848Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7286928Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7286970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7287093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7287155Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7287191Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7287319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7287360Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7287396Z ^^^^^^^^^ 2025-09-07T07:33:27.7287528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7288895Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7288931Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7289081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7289131Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7289165Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7289323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7289389Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7289433Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7289609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7289649Z outs_pair = fn(*args) 2025-09-07T07:33:27.7289684Z ^^^^^^^^^ 2025-09-07T07:33:27.7289855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7289922Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7289967Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7290155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7290196Z outs_pair = fn(*args) 2025-09-07T07:33:27.7290244Z ^^^^^^^^^ 2025-09-07T07:33:27.7290421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7290481Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7290524Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7290716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7292096Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7292143Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7292317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7292356Z outs_pair = fn(*args) 2025-09-07T07:33:27.7292417Z ^^^^^^^^^ 2025-09-07T07:33:27.7292606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7292652Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7292689Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7292856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7292902Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7292940Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7293166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7293211Z return handle_torch_function( 2025-09-07T07:33:27.7293247Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7293411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7293487Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7293533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7293699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7293741Z return func(*args, **kwargs) 2025-09-07T07:33:27.7293776Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7293899Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7293941Z result = _engine_run_backward( 2025-09-07T07:33:27.7295307Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7295455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7295581Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7295632Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7295759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7295800Z return user_fn(self, *args) 2025-09-07T07:33:27.7295836Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7295979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7296022Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7296061Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7296218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7296287Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7296325Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7296471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7296511Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7296547Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7296710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7296762Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7296802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7296938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7296987Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7298338Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7298525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7298576Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7298615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7298772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7298810Z t = dispatch_trace( 2025-09-07T07:33:27.7298845Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7298958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7299001Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7299037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7299161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7299200Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7299236Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7299413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7299491Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7299533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7299656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7299696Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7299730Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7299859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7299900Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7299935Z ^^^^^^^^^ 2025-09-07T07:33:27.7301390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7301444Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7301481Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7301523Z File "", line 1, in 2025-09-07T07:33:27.7301665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7301743Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7301788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7301923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7301970Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7302009Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7302199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7302264Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7302316Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7302486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7302530Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7302567Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7302708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7302750Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7302786Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7302920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7303008Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7303126Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7304625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7304687Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7304731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7304857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7304896Z leaves = list(leaves) 2025-09-07T07:33:27.7304930Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7305054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7305088Z return func(x) 2025-09-07T07:33:27.7305121Z ^^^^^^^ 2025-09-07T07:33:27.7305258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7305343Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7305387Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7305554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7305595Z return func(*args, **kwargs) 2025-09-07T07:33:27.7305631Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7305812Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7305898Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7305900Z 2025-09-07T07:33:27.7306105Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7306108Z 2025-09-07T07:33:27.7306109Z 2025-09-07T07:33:27.7306184Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7306382Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7306384Z 2025-09-07T07:33:27.7306470Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7307859Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7307896Z inline_call [] 2025-09-07T07:33:27.7307953Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7308027Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7308101Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7308386Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7308499Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7308567Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7308717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7308803Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7308933Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7309051Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7309161Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7309206Z Traceback (most recent call last): 2025-09-07T07:33:27.7309356Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7309408Z self._run_test( 2025-09-07T07:33:27.7309522Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7309577Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7309617Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7309748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7309793Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7311146Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7311301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7311348Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7311386Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7311527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7311587Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7311625Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7311767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7311848Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7311887Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7312038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7312084Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7312231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7312285Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7312327Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7312469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7312520Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7312560Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7312675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7312741Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7312784Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7312911Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7314368Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7314412Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7314585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7314653Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7314690Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7314829Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7314868Z return aot_autograd( 2025-09-07T07:33:27.7314904Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7315038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7315107Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7315152Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7315315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7315443Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7315490Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7315673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7315716Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7315901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7315940Z fx_g = _create_graph( 2025-09-07T07:33:27.7315977Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7316139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7316174Z fx_g = make_fx( 2025-09-07T07:33:27.7316206Z ^^^^^^^^ 2025-09-07T07:33:27.7317701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7317749Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7317788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7317936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7317980Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7318016Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7318176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7318213Z t = dispatch_trace( 2025-09-07T07:33:27.7318248Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7318359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7318401Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7318439Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7318565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7318605Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7318640Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7318802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7318882Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7318922Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7319046Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7319085Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7319120Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7320576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7320621Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7320674Z ^^^^^^^^^ 2025-09-07T07:33:27.7320806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7320848Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7320883Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7321031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7321081Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7321115Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7321273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7321334Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7321378Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7321570Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7321611Z outs_pair = fn(*args) 2025-09-07T07:33:27.7321646Z ^^^^^^^^^ 2025-09-07T07:33:27.7321817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7321883Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7321927Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7322100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7322138Z outs_pair = fn(*args) 2025-09-07T07:33:27.7322173Z ^^^^^^^^^ 2025-09-07T07:33:27.7322350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7323822Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7323869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7324065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7324134Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7324181Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7324352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7324391Z outs_pair = fn(*args) 2025-09-07T07:33:27.7324425Z ^^^^^^^^^ 2025-09-07T07:33:27.7324614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7324662Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7324698Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7324867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7324913Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7324951Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7325075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7325118Z return handle_torch_function( 2025-09-07T07:33:27.7325154Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7325294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7325393Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7325442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7325628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7327134Z return func(*args, **kwargs) 2025-09-07T07:33:27.7327171Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7327296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7327338Z result = _engine_run_backward( 2025-09-07T07:33:27.7327375Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7327520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7327642Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7327693Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7327844Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7327886Z return user_fn(self, *args) 2025-09-07T07:33:27.7327923Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7328066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7328110Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7328148Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7328306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7328350Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7328386Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7328510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7328566Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7328605Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7328768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7328819Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7330179Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7330317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7330366Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7330406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7330566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7330613Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7330655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7330814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7330852Z t = dispatch_trace( 2025-09-07T07:33:27.7330888Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7331003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7331045Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7331081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7331205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7331244Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7331279Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7331440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7331539Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7331593Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7331719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7331757Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7333224Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7333353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7333395Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7333430Z ^^^^^^^^^ 2025-09-07T07:33:27.7333579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7333633Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7333666Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7333709Z File "", line 1, in 2025-09-07T07:33:27.7333879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7333960Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7334005Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7334141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7334189Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7334227Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7334418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7334462Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7334497Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7334668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7334730Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7334767Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7334911Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7334954Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7336319Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7336458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7336545Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7336592Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7336718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7336781Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7336826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7336952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7336991Z leaves = list(leaves) 2025-09-07T07:33:27.7337026Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7337148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7337183Z return func(x) 2025-09-07T07:33:27.7337216Z ^^^^^^^ 2025-09-07T07:33:27.7337353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7337418Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7337459Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7337659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7337717Z return func(*args, **kwargs) 2025-09-07T07:33:27.7337754Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7337934Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7338019Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7338021Z 2025-09-07T07:33:27.7338228Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7339567Z 2025-09-07T07:33:27.7339570Z 2025-09-07T07:33:27.7339645Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7339843Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7339846Z 2025-09-07T07:33:27.7339955Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7340030Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7340065Z inline_call [] 2025-09-07T07:33:27.7340121Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7340196Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7340267Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7340525Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7340636Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7340689Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7340853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7340940Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7341071Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7341192Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7341262Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7341297Z inline_call [] 2025-09-07T07:33:27.7341353Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7341426Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7341495Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7341754Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7343283Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7343338Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7343488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7343574Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7343704Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7343823Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7343873Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7344013Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7344082Z Traceback (most recent call last): 2025-09-07T07:33:27.7344231Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7344266Z self._run_test( 2025-09-07T07:33:27.7344379Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7344433Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7344475Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7344607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7344654Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7344694Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7344845Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7344913Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7344953Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7345091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7346465Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7346504Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7346649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7346731Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7346770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7346922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7346991Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7347142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7347197Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7347239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7347380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7347432Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7347471Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7347588Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7347654Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7347700Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7347827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7347893Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7347935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7348075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7348119Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7348157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7349615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7349656Z return aot_autograd( 2025-09-07T07:33:27.7349692Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7349833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7349922Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7349972Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7350148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7350232Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7350278Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7350460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7350503Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7350690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7350730Z fx_g = _create_graph( 2025-09-07T07:33:27.7350765Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7350945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7350981Z fx_g = make_fx( 2025-09-07T07:33:27.7351015Z ^^^^^^^^ 2025-09-07T07:33:27.7351165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7351213Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7351251Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7351399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7351442Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7352811Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7352970Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7353011Z t = dispatch_trace( 2025-09-07T07:33:27.7353152Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7353270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7353313Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7353350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7353475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7353515Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7353552Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7353714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7353792Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7353834Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7353960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7354000Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7354038Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7354164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7354207Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7354241Z ^^^^^^^^^ 2025-09-07T07:33:27.7354374Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7354415Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7355780Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7355930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7355980Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7356015Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7356216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7356296Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7356341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7356519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7356559Z outs_pair = fn(*args) 2025-09-07T07:33:27.7356594Z ^^^^^^^^^ 2025-09-07T07:33:27.7356765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7356831Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7356876Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7357052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7357110Z outs_pair = fn(*args) 2025-09-07T07:33:27.7357145Z ^^^^^^^^^ 2025-09-07T07:33:27.7357322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7357382Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7357426Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7357618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7357689Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7357734Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7359227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7359300Z outs_pair = fn(*args) 2025-09-07T07:33:27.7359336Z ^^^^^^^^^ 2025-09-07T07:33:27.7359525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7359571Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7359607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7359776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7359823Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7359861Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7359988Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7360031Z return handle_torch_function( 2025-09-07T07:33:27.7360071Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7360212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7360289Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7360336Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7360504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7360545Z return func(*args, **kwargs) 2025-09-07T07:33:27.7360582Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7360705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7360748Z result = _engine_run_backward( 2025-09-07T07:33:27.7360784Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7362261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7362398Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7362450Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7362576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7362619Z return user_fn(self, *args) 2025-09-07T07:33:27.7362655Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7362799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7362843Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7362881Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7363038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7363166Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7363222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7363349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7363389Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7363426Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7363593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7363645Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7363686Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7363821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7363871Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7363910Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7364090Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7365467Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7365509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7365666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7365706Z t = dispatch_trace( 2025-09-07T07:33:27.7365741Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7365855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7365898Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7365936Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7366059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7366100Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7366137Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7366300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7366378Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7366420Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7366544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7366584Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7366619Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7366883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7366926Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7366961Z ^^^^^^^^^ 2025-09-07T07:33:27.7367132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7368530Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7368565Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7368608Z File "", line 1, in 2025-09-07T07:33:27.7368753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7368831Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7368881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7369016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7369064Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7369102Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7369294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7369358Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7369397Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7369567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7369612Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7369649Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7369793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7369835Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7369872Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7370008Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7370097Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7370162Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7370290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7371663Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7371710Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7371836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7371876Z leaves = list(leaves) 2025-09-07T07:33:27.7371910Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7372033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7372068Z return func(x) 2025-09-07T07:33:27.7372102Z ^^^^^^^ 2025-09-07T07:33:27.7372240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7372308Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7372352Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7372519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7372561Z return func(*args, **kwargs) 2025-09-07T07:33:27.7372596Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7372779Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7372863Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7372866Z 2025-09-07T07:33:27.7373190Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7373193Z 2025-09-07T07:33:27.7373224Z 2025-09-07T07:33:27.7373299Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7373518Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7373521Z 2025-09-07T07:33:27.7373608Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7373682Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7375050Z inline_call [] 2025-09-07T07:33:27.7375110Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7375185Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7375257Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7375514Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7375651Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7375704Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7375855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7375941Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7376072Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7376192Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7376264Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7376299Z inline_call [] 2025-09-07T07:33:27.7376357Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7376450Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7376522Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7376775Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7376886Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7376935Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7377089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7377173Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7377305Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7378738Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7378813Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7378848Z inline_call [] 2025-09-07T07:33:27.7378904Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7378975Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7379045Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7379296Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7379405Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7379454Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7379621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7379721Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7379851Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7379968Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7380184Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-24c4fa8bb0212921.xml - 2025-09-07T07:33:27.7380242Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7380610Z FAILED [0.2787s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7380717Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7380719Z 2025-09-07T07:33:27.7380925Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7380927Z 2025-09-07T07:33:27.7380929Z 2025-09-07T07:33:27.7381001Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7381197Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7381200Z 2025-09-07T07:33:27.7381283Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7382658Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7382752Z ============= 1 failed, 2 passed, 58 deselected, 2 rerun in 4.69s ============== 2025-09-07T07:33:27.7382789Z Got exit code 1 2025-09-07T07:33:27.7382827Z Retrying single test... 2025-09-07T07:33:27.7383345Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7383385Z import pkg_resources 2025-09-07T07:33:27.7383555Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-d665a846a50caae1.xml 2025-09-07T07:33:27.7383612Z ============================= test session starts ============================== 2025-09-07T07:33:27.7383724Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7383766Z cachedir: .pytest_cache 2025-09-07T07:33:27.7383923Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7383969Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7384009Z configfile: pytest.ini 2025-09-07T07:33:27.7384170Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7384247Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.7384475Z stepcurrent: skipping 60 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7384519Z Running 1 items in this shard 2025-09-07T07:33:27.7384521Z 2025-09-07T07:33:27.7384740Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.4574s] [100%] 2025-09-07T07:33:27.7384936Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2978s] [100%] 2025-09-07T07:33:27.7385119Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True FAILED [0.2770s] [100%] 2025-09-07T07:33:27.7385122Z 2025-09-07T07:33:27.7385171Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7386616Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7386663Z Traceback (most recent call last): 2025-09-07T07:33:27.7386817Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7386853Z self._run_test( 2025-09-07T07:33:27.7386969Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7387045Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7387089Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7387227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7387273Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7387314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7387466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7387514Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7387553Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7387690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7387735Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7387793Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7387938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7388021Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7388060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7388218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7388264Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7388415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7389785Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7389828Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7389971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7390026Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7390066Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7390184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7390250Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7390295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7390422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7390486Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7390527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7390670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7390735Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7390774Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7390931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7390971Z return aot_autograd( 2025-09-07T07:33:27.7391007Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7391143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7391213Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7391259Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7391420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7391503Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7392869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7393192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7393239Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7393428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7393469Z fx_g = _create_graph( 2025-09-07T07:33:27.7393504Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7393668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7393702Z fx_g = make_fx( 2025-09-07T07:33:27.7393736Z ^^^^^^^^ 2025-09-07T07:33:27.7393886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7393935Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7393990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7394140Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7394183Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7394221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7394380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7394419Z t = dispatch_trace( 2025-09-07T07:33:27.7394453Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7394566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7394609Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7394645Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7396100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7396146Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7396185Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7396347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7396427Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7396469Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7396595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7396633Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7396670Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7396795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7396838Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7396873Z ^^^^^^^^^ 2025-09-07T07:33:27.7397029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7397087Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7397124Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7397273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7397323Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7397357Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7397514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7397577Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7397622Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7397797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7399159Z outs_pair = fn(*args) 2025-09-07T07:33:27.7399216Z ^^^^^^^^^ 2025-09-07T07:33:27.7399393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7399461Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7399506Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7399678Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7399718Z outs_pair = fn(*args) 2025-09-07T07:33:27.7399752Z ^^^^^^^^^ 2025-09-07T07:33:27.7399929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7399991Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7400048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7400244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7400316Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7400363Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7400534Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7400574Z outs_pair = fn(*args) 2025-09-07T07:33:27.7400608Z ^^^^^^^^^ 2025-09-07T07:33:27.7400798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7400843Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7400882Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7401056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7402414Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7402453Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7402579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7402622Z return handle_torch_function( 2025-09-07T07:33:27.7402660Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7402800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7402876Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7402922Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7403206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7403271Z return func(*args, **kwargs) 2025-09-07T07:33:27.7403308Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7403431Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7403474Z result = _engine_run_backward( 2025-09-07T07:33:27.7404313Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7404463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7404584Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7404634Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7404762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7404805Z return user_fn(self, *args) 2025-09-07T07:33:27.7404861Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7405006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7406553Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7406591Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7406892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7406940Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7406976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7407101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7407142Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7407179Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7407344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7407423Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7407464Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7407601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7407651Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7407691Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7407852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7407901Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7407940Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7408098Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7408141Z t = dispatch_trace( 2025-09-07T07:33:27.7408177Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7408291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7409714Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7409751Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7409876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7409917Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7409953Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7410115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7410196Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7410238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7410382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7410424Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7410460Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7410586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7410629Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7410663Z ^^^^^^^^^ 2025-09-07T07:33:27.7410854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7410903Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7410938Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7410981Z File "", line 1, in 2025-09-07T07:33:27.7411124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7411203Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7411264Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7412748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7412799Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7412838Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7413032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7413162Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7413199Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7413370Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7413414Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7413478Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7413625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7413669Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7413705Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7413839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7413928Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7413976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7414100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7414162Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7414205Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7414333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7414374Z leaves = list(leaves) 2025-09-07T07:33:27.7414410Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7414532Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7415921Z return func(x) 2025-09-07T07:33:27.7415956Z ^^^^^^^ 2025-09-07T07:33:27.7416097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7416161Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7416204Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7416373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7416415Z return func(*args, **kwargs) 2025-09-07T07:33:27.7416476Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7416661Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7416747Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7416750Z 2025-09-07T07:33:27.7416956Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7416986Z 2025-09-07T07:33:27.7416988Z 2025-09-07T07:33:27.7417062Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7417260Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7417262Z 2025-09-07T07:33:27.7417348Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7417427Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7417483Z inline_call [] 2025-09-07T07:33:27.7417541Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7417576Z inductor [] 2025-09-07T07:33:27.7417652Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7417725Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7417987Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7419435Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7419490Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7419641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7419748Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7419880Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7420001Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7420113Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7420159Z Traceback (most recent call last): 2025-09-07T07:33:27.7420308Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7420343Z self._run_test( 2025-09-07T07:33:27.7420456Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7420511Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7420554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7420691Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7420738Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7420777Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7420928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7420975Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7421015Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7421151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7421196Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7421234Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7422722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7422809Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7422848Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7423001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7423047Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7423311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7423366Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7423406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7423550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7423601Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7423642Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7423784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7423852Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7423900Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7424029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7424094Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7424136Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7424278Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7424322Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7424361Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7424500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7425915Z return aot_autograd( 2025-09-07T07:33:27.7425953Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7426091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7426160Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7426207Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7426369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7426453Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7426499Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7426682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7426726Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7426914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7426954Z fx_g = _create_graph( 2025-09-07T07:33:27.7426990Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7427154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7427190Z fx_g = make_fx( 2025-09-07T07:33:27.7427223Z ^^^^^^^^ 2025-09-07T07:33:27.7427377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7427424Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7427463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7427630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7427676Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7427713Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7429196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7429236Z t = dispatch_trace( 2025-09-07T07:33:27.7429272Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7429407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7429450Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7429487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7429612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7429653Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7429689Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7429867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7429947Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7429990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7430114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7430154Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7430189Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7430318Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7430360Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7430396Z ^^^^^^^^^ 2025-09-07T07:33:27.7430528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7430569Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7430621Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7432102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7432153Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7432189Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7432346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7432411Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7432456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7432631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7432671Z outs_pair = fn(*args) 2025-09-07T07:33:27.7432706Z ^^^^^^^^^ 2025-09-07T07:33:27.7432879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7432947Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7432993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7433256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7433297Z outs_pair = fn(*args) 2025-09-07T07:33:27.7433332Z ^^^^^^^^^ 2025-09-07T07:33:27.7433508Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7433569Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7433613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7433831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7433905Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7433952Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7434126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7435525Z outs_pair = fn(*args) 2025-09-07T07:33:27.7435563Z ^^^^^^^^^ 2025-09-07T07:33:27.7435752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7435799Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7435836Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7436006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7436054Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7436111Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7436237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7436281Z return handle_torch_function( 2025-09-07T07:33:27.7436318Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7436461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7436535Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7436582Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7436749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7436790Z return func(*args, **kwargs) 2025-09-07T07:33:27.7436849Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7436973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7437016Z result = _engine_run_backward( 2025-09-07T07:33:27.7437052Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7437198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7437320Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7438728Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7438859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7438902Z return user_fn(self, *args) 2025-09-07T07:33:27.7438938Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7439085Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7439129Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7439168Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7439326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7439371Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7439409Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7439534Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7439573Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7439609Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7439773Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7439849Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7439892Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7440030Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7440079Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7440119Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7440280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7440346Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7441705Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7441866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7441904Z t = dispatch_trace( 2025-09-07T07:33:27.7441940Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7442056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7442119Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7442157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7442282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7442322Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7442357Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7442519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7442597Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7442638Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7442762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7442801Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7442850Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7442978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7443020Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7443134Z ^^^^^^^^^ 2025-09-07T07:33:27.7443284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7443335Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7443369Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7444756Z File "", line 1, in 2025-09-07T07:33:27.7444900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7444981Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7445027Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7445166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7445214Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7445254Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7445447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7445492Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7445528Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7445699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7445743Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7445780Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7445954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7445998Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7446037Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7446170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7446259Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7446306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7446449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7446509Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7448085Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7448215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7448255Z leaves = list(leaves) 2025-09-07T07:33:27.7448293Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7448451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7448487Z return func(x) 2025-09-07T07:33:27.7448520Z ^^^^^^^ 2025-09-07T07:33:27.7448661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7448729Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7448770Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7448939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7448981Z return func(*args, **kwargs) 2025-09-07T07:33:27.7449017Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7449201Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7449308Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7449311Z 2025-09-07T07:33:27.7449516Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7449518Z 2025-09-07T07:33:27.7449520Z 2025-09-07T07:33:27.7449594Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7449792Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7449794Z 2025-09-07T07:33:27.7449880Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7449953Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7449990Z inline_call [] 2025-09-07T07:33:27.7450047Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7451421Z inductor [] 2025-09-07T07:33:27.7451499Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7451573Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7451829Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7451943Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7451995Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7452146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7452232Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7452382Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7452505Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7452577Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7452611Z inline_call [] 2025-09-07T07:33:27.7452668Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7452759Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7452828Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7453164Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7453275Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7453329Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7453498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7453584Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7453713Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7455183Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7455238Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7455348Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7455392Z Traceback (most recent call last): 2025-09-07T07:33:27.7455543Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7455602Z self._run_test( 2025-09-07T07:33:27.7455716Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7455771Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7455815Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7455948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7455997Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7456036Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7456188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7456235Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7456274Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7456410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7456458Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7456496Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7456639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7456720Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7456761Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7456913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7458284Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7458435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7458490Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7458555Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7458701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7458753Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7458794Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7458910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7459000Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7459045Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7459171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7461482Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7461523Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7461667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7461726Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7461765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7461903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7461944Z return aot_autograd( 2025-09-07T07:33:27.7461979Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7462118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7462186Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7463650Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7463814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7463899Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7463989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7464173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7464216Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7464402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7464443Z fx_g = _create_graph( 2025-09-07T07:33:27.7464479Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7464643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7464678Z fx_g = make_fx( 2025-09-07T07:33:27.7464711Z ^^^^^^^^ 2025-09-07T07:33:27.7464864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7464913Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7464952Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7465100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7465143Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7465181Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7465339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7465378Z t = dispatch_trace( 2025-09-07T07:33:27.7465413Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7465528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7466907Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7466947Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7467100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7467142Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7467179Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7467342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7467441Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7467484Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7467610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7467649Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7467685Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7467814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7467858Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7467894Z ^^^^^^^^^ 2025-09-07T07:33:27.7468045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7468087Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7468123Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7468273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7468324Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7468358Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7468519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7469910Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7469958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7470138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7470194Z outs_pair = fn(*args) 2025-09-07T07:33:27.7470229Z ^^^^^^^^^ 2025-09-07T07:33:27.7470405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7470473Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7470519Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7470694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7470734Z outs_pair = fn(*args) 2025-09-07T07:33:27.7470768Z ^^^^^^^^^ 2025-09-07T07:33:27.7470949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7471011Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7471056Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7471252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7471323Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7471371Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7471544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7471583Z outs_pair = fn(*args) 2025-09-07T07:33:27.7471618Z ^^^^^^^^^ 2025-09-07T07:33:27.7471826Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7471875Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7473356Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7473531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7473579Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7473617Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7473776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7473820Z return handle_torch_function( 2025-09-07T07:33:27.7473858Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7474000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7474075Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7474123Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7474311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7474354Z return func(*args, **kwargs) 2025-09-07T07:33:27.7474389Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7474515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7474559Z result = _engine_run_backward( 2025-09-07T07:33:27.7474595Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7474742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7474862Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7474915Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7475061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7475105Z return user_fn(self, *args) 2025-09-07T07:33:27.7475142Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7476645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7476691Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7476730Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7476889Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7476935Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7476971Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7477097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7477138Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7477175Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7477342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7477395Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7477435Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7477573Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7477624Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7477664Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7477825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7477874Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7477914Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7478096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7478136Z t = dispatch_trace( 2025-09-07T07:33:27.7478171Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7479619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7479665Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7479720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7479847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7479888Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7479923Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7480087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7480166Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7480211Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7480350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7480391Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7480426Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7480555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7480599Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7480635Z ^^^^^^^^^ 2025-09-07T07:33:27.7480784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7480835Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7480870Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7480913Z File "", line 1, in 2025-09-07T07:33:27.7481058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7481153Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7481199Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7482676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7482727Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7482767Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7482960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7483005Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7483041Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7483291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7483338Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7483377Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7483522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7483564Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7483602Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7483738Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7483828Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7483874Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7484001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7484061Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7484132Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7484260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7484301Z leaves = list(leaves) 2025-09-07T07:33:27.7484336Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7485810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7485870Z return func(x) 2025-09-07T07:33:27.7485904Z ^^^^^^^ 2025-09-07T07:33:27.7486043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7486110Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7486152Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7486323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7486366Z return func(*args, **kwargs) 2025-09-07T07:33:27.7486423Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7486608Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7486798Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7486803Z 2025-09-07T07:33:27.7487010Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7487013Z 2025-09-07T07:33:27.7487015Z 2025-09-07T07:33:27.7487089Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7487286Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7487308Z 2025-09-07T07:33:27.7487397Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7487472Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7487508Z inline_call [] 2025-09-07T07:33:27.7487565Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7487600Z inductor [] 2025-09-07T07:33:27.7487674Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7487748Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7488006Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7489466Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7489520Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7489676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7489768Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7489902Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7490022Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7490095Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7490130Z inline_call [] 2025-09-07T07:33:27.7490188Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7490261Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7490331Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7490603Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7490717Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7490768Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7490917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7491020Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7491151Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7491270Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7491342Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7491381Z inline_call [] 2025-09-07T07:33:27.7491437Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7492855Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7492927Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7493247Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7493359Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7493410Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7493558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7493643Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7493773Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7493916Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7494136Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-d665a846a50caae1.xml - 2025-09-07T07:33:27.7494196Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7494565Z FAILED [0.2770s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7494650Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7494652Z 2025-09-07T07:33:27.7494861Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7494864Z 2025-09-07T07:33:27.7494866Z 2025-09-07T07:33:27.7494938Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7495135Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7495139Z 2025-09-07T07:33:27.7495223Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7495284Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7495350Z ================== 1 failed, 220 deselected, 2 rerun in 1.21s ================== 2025-09-07T07:33:27.7495387Z Got exit code 1 2025-09-07T07:33:27.7495426Z Retrying single test... 2025-09-07T07:33:27.7497227Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7497271Z import pkg_resources 2025-09-07T07:33:27.7497444Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-9a2013b8ef6fd0a7.xml 2025-09-07T07:33:27.7497519Z ============================= test session starts ============================== 2025-09-07T07:33:27.7497634Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7497673Z cachedir: .pytest_cache 2025-09-07T07:33:27.7497831Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7497876Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7497917Z configfile: pytest.ini 2025-09-07T07:33:27.7498097Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7498175Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.7498407Z stepcurrent: skipping 60 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7498452Z Running 1 items in this shard 2025-09-07T07:33:27.7498454Z 2025-09-07T07:33:27.7498652Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.4510s] [100%] 2025-09-07T07:33:27.7498846Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2799s] [100%] 2025-09-07T07:33:27.7499015Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True FAILED [0.2744s] [100%] 2025-09-07T07:33:27.7499034Z 2025-09-07T07:33:27.7499086Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7499199Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7499244Z Traceback (most recent call last): 2025-09-07T07:33:27.7499398Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7499434Z self._run_test( 2025-09-07T07:33:27.7499548Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7500937Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7500981Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7501119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7501168Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7501209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7501360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7501408Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7501448Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7501584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7501629Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7501667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7501814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7501912Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7501954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7502109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7502156Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7502306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7502376Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7502418Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7502562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7502614Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7504060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7504186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7504279Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7504324Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7504453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7504517Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7504561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7504705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7504751Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7504790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7504930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7504969Z return aot_autograd( 2025-09-07T07:33:27.7505025Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7505163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7505233Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7505280Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7505441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7505526Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7505571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7505757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7505801Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7505991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7507376Z fx_g = _create_graph( 2025-09-07T07:33:27.7507414Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7507583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7507620Z fx_g = make_fx( 2025-09-07T07:33:27.7507653Z ^^^^^^^^ 2025-09-07T07:33:27.7507806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7507853Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7507893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7508040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7508107Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7508146Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7508308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7508348Z t = dispatch_trace( 2025-09-07T07:33:27.7508383Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7508497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7508560Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7508596Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7508723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7508764Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7508800Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7508970Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7510399Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7510446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7510574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7510613Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7510649Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7510778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7510821Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7510857Z ^^^^^^^^^ 2025-09-07T07:33:27.7510991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7511033Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7511068Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7511220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7511287Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7511322Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7511479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7511543Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7511590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7511772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7511812Z outs_pair = fn(*args) 2025-09-07T07:33:27.7511849Z ^^^^^^^^^ 2025-09-07T07:33:27.7512020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7512091Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7513556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7513737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7513776Z outs_pair = fn(*args) 2025-09-07T07:33:27.7513811Z ^^^^^^^^^ 2025-09-07T07:33:27.7513992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7514053Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7514097Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7514294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7514389Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7514438Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7514616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7514656Z outs_pair = fn(*args) 2025-09-07T07:33:27.7514691Z ^^^^^^^^^ 2025-09-07T07:33:27.7515045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7515092Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7515129Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7515300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7515347Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7515388Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7515533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7515578Z return handle_torch_function( 2025-09-07T07:33:27.7515615Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7517110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7517188Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7517236Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7517404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7517448Z return func(*args, **kwargs) 2025-09-07T07:33:27.7517484Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7517613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7517687Z result = _engine_run_backward( 2025-09-07T07:33:27.7517725Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7517872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7517995Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7518046Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7518173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7518216Z return user_fn(self, *args) 2025-09-07T07:33:27.7518253Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7518397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7518444Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7518483Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7518643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7518687Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7518724Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7520186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7520229Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7520265Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7520432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7520485Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7520526Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7520684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7520735Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7520775Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7520937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7521001Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7521041Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7521200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7521238Z t = dispatch_trace( 2025-09-07T07:33:27.7521274Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7521388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7521433Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7521471Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7521610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7521650Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7521686Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7521849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7523340Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7523383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7523509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7523548Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7523584Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7523713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7523783Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7523819Z ^^^^^^^^^ 2025-09-07T07:33:27.7523970Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7524021Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7524055Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7524100Z File "", line 1, in 2025-09-07T07:33:27.7524242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7524322Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7524368Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7524507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7524558Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7524598Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7524790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7524835Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7524871Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7526381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7526428Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7526466Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7526610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7526655Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7526816Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7526954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7527043Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7527091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7527217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7527300Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7527346Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7527473Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7527512Z leaves = list(leaves) 2025-09-07T07:33:27.7527547Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7527671Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7527728Z return func(x) 2025-09-07T07:33:27.7527763Z ^^^^^^^ 2025-09-07T07:33:27.7527900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7527967Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7528008Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7528178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7529561Z return func(*args, **kwargs) 2025-09-07T07:33:27.7529600Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7529782Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7529869Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7529889Z 2025-09-07T07:33:27.7530098Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7530100Z 2025-09-07T07:33:27.7530102Z 2025-09-07T07:33:27.7530177Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7530377Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7530381Z 2025-09-07T07:33:27.7530467Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7530541Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7530577Z inline_call [] 2025-09-07T07:33:27.7530634Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7530669Z inductor [] 2025-09-07T07:33:27.7530745Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7530820Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7531080Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7531193Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7531246Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7531398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7531484Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7531616Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7531754Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7533286Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7533334Z Traceback (most recent call last): 2025-09-07T07:33:27.7533486Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7533548Z self._run_test( 2025-09-07T07:33:27.7533662Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7533719Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7533763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7533898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7533945Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7533986Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7534163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7534210Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7534250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7534386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7534433Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7534471Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7534616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7534699Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7534737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7534891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7534957Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7535108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7536508Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7536553Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7536700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7536752Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7536793Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7536910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7536976Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7537022Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7537150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7537214Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7537256Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7537397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7537442Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7537480Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7537618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7537658Z return aot_autograd( 2025-09-07T07:33:27.7537693Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7537853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7537927Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7537975Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7538137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7539546Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7539612Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7539796Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7539839Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7540025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7540067Z fx_g = _create_graph( 2025-09-07T07:33:27.7540103Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7540287Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7540324Z fx_g = make_fx( 2025-09-07T07:33:27.7540357Z ^^^^^^^^ 2025-09-07T07:33:27.7540508Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7540557Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7540595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7540742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7540787Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7540825Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7540985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7541043Z t = dispatch_trace( 2025-09-07T07:33:27.7541078Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7541193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7541235Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7541274Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7542724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7542768Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7542804Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7542967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7543047Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7543182Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7543311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7543351Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7543386Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7543513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7543555Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7543593Z ^^^^^^^^^ 2025-09-07T07:33:27.7543727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7543768Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7543805Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7543954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7544004Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7544061Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7544221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7544283Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7544328Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7544503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7545902Z outs_pair = fn(*args) 2025-09-07T07:33:27.7545938Z ^^^^^^^^^ 2025-09-07T07:33:27.7546112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7546179Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7546225Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7546425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7546466Z outs_pair = fn(*args) 2025-09-07T07:33:27.7546501Z ^^^^^^^^^ 2025-09-07T07:33:27.7546681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7546743Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7546788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7546982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7547053Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7547099Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7547292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7547331Z outs_pair = fn(*args) 2025-09-07T07:33:27.7547367Z ^^^^^^^^^ 2025-09-07T07:33:27.7547556Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7547604Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7547642Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7547811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7549196Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7549237Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7549366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7549413Z return handle_torch_function( 2025-09-07T07:33:27.7549451Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7549592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7549669Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7549715Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7549885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7549926Z return func(*args, **kwargs) 2025-09-07T07:33:27.7549964Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7550088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7550132Z result = _engine_run_backward( 2025-09-07T07:33:27.7550184Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7550334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7550454Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7550505Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7550647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7550691Z return user_fn(self, *args) 2025-09-07T07:33:27.7550727Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7550871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7550914Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7552280Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7552458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7552505Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7552542Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7552667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7552706Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7552744Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7552908Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7552961Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7553002Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7553224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7553275Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7553337Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7553500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7553549Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7553590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7553748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7553789Z t = dispatch_trace( 2025-09-07T07:33:27.7553824Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7553938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7553981Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7555356Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7555485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7555528Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7555563Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7555724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7555804Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7555848Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7555973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7556013Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7556048Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7556177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7556219Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7556255Z ^^^^^^^^^ 2025-09-07T07:33:27.7556428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7556479Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7556514Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7556556Z File "", line 1, in 2025-09-07T07:33:27.7556701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7556797Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7556844Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7556981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7557030Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7558397Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7558616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7558662Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7558700Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7558872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7558919Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7558956Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7559101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7559144Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7559182Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7559317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7559423Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7559470Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7559598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7559659Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7559705Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7559832Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7559872Z leaves = list(leaves) 2025-09-07T07:33:27.7559907Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7560031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7560066Z return func(x) 2025-09-07T07:33:27.7561429Z ^^^^^^^ 2025-09-07T07:33:27.7561574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7561640Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7561683Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7561852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7561894Z return func(*args, **kwargs) 2025-09-07T07:33:27.7561932Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7562115Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7562201Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7562203Z 2025-09-07T07:33:27.7562428Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7562432Z 2025-09-07T07:33:27.7562435Z 2025-09-07T07:33:27.7562510Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7562710Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7562712Z 2025-09-07T07:33:27.7562820Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7562894Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7562931Z inline_call [] 2025-09-07T07:33:27.7562988Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7563023Z inductor [] 2025-09-07T07:33:27.7563167Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7563241Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7563527Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7563641Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7563694Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7565194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7565283Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7565418Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7565539Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7565612Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7565671Z inline_call [] 2025-09-07T07:33:27.7565729Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7565803Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7565874Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7566131Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7566244Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7566297Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7566448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7566534Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7566667Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7566877Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7566928Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7567039Z _ WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7567085Z Traceback (most recent call last): 2025-09-07T07:33:27.7567236Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1319, in test_while_loop_with_pytree_inputs 2025-09-07T07:33:27.7567271Z self._run_test( 2025-09-07T07:33:27.7568730Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7568788Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7568854Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7568990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7569037Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7569077Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7569230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7569314Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7569354Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7569490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7569536Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7569574Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7569720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7569822Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7569863Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7570015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7570061Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7570214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7570268Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7570310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7570454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7570507Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7571879Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7572019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7572086Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7572134Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7572262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7572329Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7572370Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7572511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7572556Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7572595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7572735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7572777Z return aot_autograd( 2025-09-07T07:33:27.7572813Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7572951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7573021Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7573167Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7573331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7573415Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7573460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7573666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7573711Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7575259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7575303Z fx_g = _create_graph( 2025-09-07T07:33:27.7575340Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7575505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7575561Z fx_g = make_fx( 2025-09-07T07:33:27.7575594Z ^^^^^^^^ 2025-09-07T07:33:27.7575747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7575794Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7575833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7575982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7576045Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7576084Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7576244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7576284Z t = dispatch_trace( 2025-09-07T07:33:27.7576320Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7576435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7576477Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7576515Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7576640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7576681Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7576718Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7576901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7578316Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7578360Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7578486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7578528Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7578563Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7578690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7578733Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7578769Z ^^^^^^^^^ 2025-09-07T07:33:27.7578901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7578944Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7578981Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7579133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7579183Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7579218Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7579377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7579440Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7579485Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7579660Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7579701Z outs_pair = fn(*args) 2025-09-07T07:33:27.7579735Z ^^^^^^^^^ 2025-09-07T07:33:27.7579924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7579993Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7581370Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7581545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7581601Z outs_pair = fn(*args) 2025-09-07T07:33:27.7581636Z ^^^^^^^^^ 2025-09-07T07:33:27.7581816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7581877Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7581921Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7582117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7582208Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7582255Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7582428Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7582468Z outs_pair = fn(*args) 2025-09-07T07:33:27.7582504Z ^^^^^^^^^ 2025-09-07T07:33:27.7582694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7582741Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7582778Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7582949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7583015Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7583053Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7583269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7583312Z return handle_torch_function( 2025-09-07T07:33:27.7584698Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7584846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7584924Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7584970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7585140Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7585181Z return func(*args, **kwargs) 2025-09-07T07:33:27.7585220Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7585344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7585389Z result = _engine_run_backward( 2025-09-07T07:33:27.7585425Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7585572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7585693Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7585744Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7585871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7585914Z return user_fn(self, *args) 2025-09-07T07:33:27.7585950Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7586135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7586180Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7586219Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7586378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7586443Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7586479Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7587942Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7587984Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7588021Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7588187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7588241Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7588304Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7588443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7588492Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7588533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7588695Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7588744Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7588784Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7588947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7588986Z t = dispatch_trace( 2025-09-07T07:33:27.7589022Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7589137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7589200Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7589238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7589363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7589402Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7589439Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7590932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7591013Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7591056Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7591180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7591220Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7591258Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7591386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7591429Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7591464Z ^^^^^^^^^ 2025-09-07T07:33:27.7591614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7591665Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7591699Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7591742Z File "", line 1, in 2025-09-07T07:33:27.7591886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7591965Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7592011Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7592167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7592217Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7592255Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7592449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7592507Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7592545Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7594139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7594187Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7594224Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7594371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7594414Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7594476Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7594614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7594704Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7594750Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7594879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7594941Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7594986Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7595112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7595152Z leaves = list(leaves) 2025-09-07T07:33:27.7595209Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7595334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7595369Z return func(x) 2025-09-07T07:33:27.7595403Z ^^^^^^^ 2025-09-07T07:33:27.7595541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7595608Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7595651Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7597175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7597220Z return func(*args, **kwargs) 2025-09-07T07:33:27.7597256Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7597441Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7597529Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7597532Z 2025-09-07T07:33:27.7597740Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7597742Z 2025-09-07T07:33:27.7597744Z 2025-09-07T07:33:27.7597820Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7598017Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7598019Z 2025-09-07T07:33:27.7598106Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7598179Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7598216Z inline_call [] 2025-09-07T07:33:27.7598296Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7598332Z inductor [] 2025-09-07T07:33:27.7598408Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7598481Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7598741Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7598874Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7598927Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7599079Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7599165Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7599298Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7599435Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7600839Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7600876Z inline_call [] 2025-09-07T07:33:27.7600934Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7601010Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7601080Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7601335Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7601446Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7601517Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7601671Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7601757Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7601887Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7602008Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7602078Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7602114Z inline_call [] 2025-09-07T07:33:27.7602170Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-09-07T07:33:27.7602243Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7602313Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7602570Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7602679Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 873, in forward 2025-09-07T07:33:27.7602731Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7602880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7604389Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7604522Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7604642Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7604885Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-9a2013b8ef6fd0a7.xml - 2025-09-07T07:33:27.7604946Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7605312Z FAILED [0.2744s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7605418Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7605420Z 2025-09-07T07:33:27.7605626Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7605629Z 2025-09-07T07:33:27.7605631Z 2025-09-07T07:33:27.7605703Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7605926Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True 2025-09-07T07:33:27.7605929Z 2025-09-07T07:33:27.7606013Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7606075Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7606143Z ================== 1 failed, 220 deselected, 2 rerun in 1.25s ================== 2025-09-07T07:33:27.7606179Z Got exit code 1 2025-09-07T07:33:27.7606305Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.7606821Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7606887Z import pkg_resources 2025-09-07T07:33:27.7607057Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-d8e30f51d85567cd.xml 2025-09-07T07:33:27.7607112Z ============================= test session starts ============================== 2025-09-07T07:33:27.7607224Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7607266Z cachedir: .pytest_cache 2025-09-07T07:33:27.7608772Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7608819Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7608859Z configfile: pytest.ini 2025-09-07T07:33:27.7609022Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7609099Z collecting ... collected 467 items / 61 deselected / 406 selected 2025-09-07T07:33:27.7609152Z stepcurrent: skipping 61 already run items. 2025-09-07T07:33:27.7609195Z Running 160 items in this shard 2025-09-07T07:33:27.7609197Z 2025-09-07T07:33:27.7609372Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_True_autograd_False PASSED [2.4620s] [ 0%] 2025-09-07T07:33:27.7609549Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cuda_dynamic_True_autograd_False PASSED [1.9236s] [ 1%] 2025-09-07T07:33:27.7609743Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.3047s] [ 1%] 2025-09-07T07:33:27.7609935Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2359s] [ 1%] 2025-09-07T07:33:27.7610302Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True FAILED [0.2348s] [ 1%] 2025-09-07T07:33:27.7610306Z 2025-09-07T07:33:27.7610357Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7610468Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7610513Z Traceback (most recent call last): 2025-09-07T07:33:27.7610682Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7610718Z self._run_test( 2025-09-07T07:33:27.7610833Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7610888Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7610931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7611067Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7611132Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7612505Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7612665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7612712Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7612752Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7612890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7612936Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7612974Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7613197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7613280Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7613344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7613500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7613547Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7613700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7613756Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7613797Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7613941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7613992Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7614032Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7614149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7614218Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7614263Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7615733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7615799Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7615844Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7615985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7616030Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7616068Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7616210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7616249Z return aot_autograd( 2025-09-07T07:33:27.7616309Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7616449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7616519Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7616566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7616728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7616833Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7616879Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7617064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7617108Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7617323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7617365Z fx_g = _create_graph( 2025-09-07T07:33:27.7617401Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7617566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7617603Z fx_g = make_fx( 2025-09-07T07:33:27.7618970Z ^^^^^^^^ 2025-09-07T07:33:27.7619126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7619173Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7619212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7619360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7619406Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7619464Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7619626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7619665Z t = dispatch_trace( 2025-09-07T07:33:27.7619700Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7619814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7619858Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7619894Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7620019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7620060Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7620096Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7620258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7620340Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7620383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7620508Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7620547Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7620582Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7622047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7622091Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7622127Z ^^^^^^^^^ 2025-09-07T07:33:27.7622261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7622304Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7622340Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7622510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7622562Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7622597Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7622755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7622818Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7622879Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7623132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7623172Z outs_pair = fn(*args) 2025-09-07T07:33:27.7623208Z ^^^^^^^^^ 2025-09-07T07:33:27.7623379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7623449Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7623529Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7623704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7623744Z outs_pair = fn(*args) 2025-09-07T07:33:27.7623779Z ^^^^^^^^^ 2025-09-07T07:33:27.7625309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7625372Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7625416Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7625611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7625710Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7625757Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7625931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7625970Z outs_pair = fn(*args) 2025-09-07T07:33:27.7626006Z ^^^^^^^^^ 2025-09-07T07:33:27.7626198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7626245Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7626282Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7626452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7626498Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7626539Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7626667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7626712Z return handle_torch_function( 2025-09-07T07:33:27.7626749Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7626891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7626967Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7627014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7627182Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7628557Z return func(*args, **kwargs) 2025-09-07T07:33:27.7628595Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7628747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7628792Z result = _engine_run_backward( 2025-09-07T07:33:27.7628830Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7628977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7629098Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7629165Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7629293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7629335Z return user_fn(self, *args) 2025-09-07T07:33:27.7629372Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7629518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7629564Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7629623Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7629783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7629828Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7629864Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7629994Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7630035Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7630073Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7630237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7631624Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7631667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7631825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7631875Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7631915Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7632079Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7632129Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7632169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7632331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7632370Z t = dispatch_trace( 2025-09-07T07:33:27.7632406Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7632520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7632564Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7632602Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7632728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7632768Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7632803Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7632965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7633045Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7633168Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7633293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7633333Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7634718Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7634876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7634921Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7634957Z ^^^^^^^^^ 2025-09-07T07:33:27.7635109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7635160Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7635212Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7635255Z File "", line 1, in 2025-09-07T07:33:27.7635399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7635480Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7635527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7635665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7635714Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7635774Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7635968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7636013Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7636049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7636222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7636267Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7636305Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7636449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7637831Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7637892Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7638032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7638121Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7638170Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7638298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7638360Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7638405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7638531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7638571Z leaves = list(leaves) 2025-09-07T07:33:27.7638606Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7638732Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7638769Z return func(x) 2025-09-07T07:33:27.7638803Z ^^^^^^^ 2025-09-07T07:33:27.7638941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7639006Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7639048Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7639219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7639260Z return func(*args, **kwargs) 2025-09-07T07:33:27.7639298Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7639482Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7639568Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7639584Z 2025-09-07T07:33:27.7641120Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7641122Z 2025-09-07T07:33:27.7641124Z 2025-09-07T07:33:27.7641202Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7641400Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7641421Z 2025-09-07T07:33:27.7641508Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7641583Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7641619Z inline_call [] 2025-09-07T07:33:27.7641677Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7641753Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7641840Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7642104Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7642219Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7642272Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7642424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7642511Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7642643Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7642765Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7642888Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7642934Z Traceback (most recent call last): 2025-09-07T07:33:27.7643164Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7643200Z self._run_test( 2025-09-07T07:33:27.7643314Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7644710Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7644755Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7644890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7644936Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7644979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7645137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7645184Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7645223Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7645363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7645410Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7645448Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7645592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7645674Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7645714Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7645891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7645939Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7646091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7646146Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7646187Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7646330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7646403Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7646444Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7648006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7648076Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7648121Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7648273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7648338Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7648381Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7648522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7648569Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7648607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7648746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7648785Z return aot_autograd( 2025-09-07T07:33:27.7648821Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7648958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7649048Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7649096Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7649259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7649342Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7649390Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7649573Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7649617Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7649804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7651190Z fx_g = _create_graph( 2025-09-07T07:33:27.7651229Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7651399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7651434Z fx_g = make_fx( 2025-09-07T07:33:27.7651467Z ^^^^^^^^ 2025-09-07T07:33:27.7651620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7651668Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7651708Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7651854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7651899Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7651936Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7652112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7652152Z t = dispatch_trace( 2025-09-07T07:33:27.7652189Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7652303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7652346Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7652383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7652509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7652571Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7652608Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7652769Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7652849Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7654313Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7654468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7654508Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7654544Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7654670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7654714Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7654750Z ^^^^^^^^^ 2025-09-07T07:33:27.7654884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7654926Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7654964Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7655115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7655165Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7655220Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7655380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7655443Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7655488Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7655665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7655706Z outs_pair = fn(*args) 2025-09-07T07:33:27.7655742Z ^^^^^^^^^ 2025-09-07T07:33:27.7655914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7655981Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7656026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7657543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7657583Z outs_pair = fn(*args) 2025-09-07T07:33:27.7657619Z ^^^^^^^^^ 2025-09-07T07:33:27.7657799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7657861Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7657905Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7658101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7658171Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7658218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7658414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7658455Z outs_pair = fn(*args) 2025-09-07T07:33:27.7658489Z ^^^^^^^^^ 2025-09-07T07:33:27.7658681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7658745Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7658783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7658951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7658998Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7659035Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7659160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7659206Z return handle_torch_function( 2025-09-07T07:33:27.7659257Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7660726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7660804Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7660851Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7661019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7661061Z return func(*args, **kwargs) 2025-09-07T07:33:27.7661097Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7661221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7661263Z result = _engine_run_backward( 2025-09-07T07:33:27.7661300Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7661465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7661586Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7661636Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7661763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7661805Z return user_fn(self, *args) 2025-09-07T07:33:27.7661842Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7661988Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7662033Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7662071Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7662230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7662276Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7662314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7662437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7663896Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7663934Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7664101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7664153Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7664195Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7664332Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7664381Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7664446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7664608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7664657Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7664697Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7664859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7664918Z t = dispatch_trace( 2025-09-07T07:33:27.7664954Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7665066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7665110Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7665147Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7665273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7665314Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7665370Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7665531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7666948Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7666993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7667121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7667160Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7667196Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7667322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7667365Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7667400Z ^^^^^^^^^ 2025-09-07T07:33:27.7667577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7667627Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7667661Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7667705Z File "", line 1, in 2025-09-07T07:33:27.7667848Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7667930Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7667976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7668113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7668160Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7668199Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7668392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7668439Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7668475Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7668645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7670015Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7670056Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7670201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7670245Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7670281Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7670419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7670525Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7670576Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7670703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7670764Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7670808Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7670951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7670990Z leaves = list(leaves) 2025-09-07T07:33:27.7671027Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7671150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7671186Z return func(x) 2025-09-07T07:33:27.7671219Z ^^^^^^^ 2025-09-07T07:33:27.7671358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7671441Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7671483Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7671652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7671695Z return func(*args, **kwargs) 2025-09-07T07:33:27.7673139Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7673325Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7673411Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7673414Z 2025-09-07T07:33:27.7673623Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7673650Z 2025-09-07T07:33:27.7673652Z 2025-09-07T07:33:27.7673726Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7673923Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7673926Z 2025-09-07T07:33:27.7674012Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7674088Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7674124Z inline_call [] 2025-09-07T07:33:27.7674182Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7674256Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7674328Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7674589Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7674706Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7674758Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7674910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7674998Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7675129Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7675251Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7675322Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7675358Z inline_call [] 2025-09-07T07:33:27.7676789Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7676868Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7676938Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7677195Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7677328Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7677380Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7677530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7677617Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7677749Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7677892Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7677943Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7678054Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7678100Z Traceback (most recent call last): 2025-09-07T07:33:27.7678250Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7678285Z self._run_test( 2025-09-07T07:33:27.7678398Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7678453Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7678495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7678645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7678693Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7678732Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7680223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7680274Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7680315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7680454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7680500Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7680538Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7680682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7680765Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7680807Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7680959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7681007Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7681158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7681213Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7681255Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7681398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7681451Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7681490Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7681625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7681694Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7681742Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7681870Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7681949Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7683419Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7683563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7683608Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7683647Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7683788Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7683830Z return aot_autograd( 2025-09-07T07:33:27.7683901Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7684040Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7684109Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7684156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7684320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7684404Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7684450Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7684636Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7684699Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7684888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7684929Z fx_g = _create_graph( 2025-09-07T07:33:27.7684965Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7685129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7685166Z fx_g = make_fx( 2025-09-07T07:33:27.7685199Z ^^^^^^^^ 2025-09-07T07:33:27.7686817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7686869Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7686909Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7687058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7687105Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7687143Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7687303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7687342Z t = dispatch_trace( 2025-09-07T07:33:27.7687377Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7687492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7687535Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7687572Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7687698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7687739Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7687775Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7687963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7688045Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7688088Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7688213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7688252Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7688304Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7688432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7689828Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7689866Z ^^^^^^^^^ 2025-09-07T07:33:27.7690001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7690044Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7690080Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7690250Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7690302Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7690337Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7690497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7690561Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7690607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7690783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7690824Z outs_pair = fn(*args) 2025-09-07T07:33:27.7690859Z ^^^^^^^^^ 2025-09-07T07:33:27.7691032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7691132Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7691178Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7691352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7691392Z outs_pair = fn(*args) 2025-09-07T07:33:27.7691428Z ^^^^^^^^^ 2025-09-07T07:33:27.7691607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7691668Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7693045Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7693331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7693405Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7693451Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7693626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7693664Z outs_pair = fn(*args) 2025-09-07T07:33:27.7693701Z ^^^^^^^^^ 2025-09-07T07:33:27.7693892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7693939Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7693976Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7694145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7694232Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7694272Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7694399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7694442Z return handle_torch_function( 2025-09-07T07:33:27.7694479Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7694621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7694717Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7694763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7694934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7694976Z return func(*args, **kwargs) 2025-09-07T07:33:27.7696352Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7696502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7696545Z result = _engine_run_backward( 2025-09-07T07:33:27.7696582Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7696729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7696850Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7696902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7697029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7697072Z return user_fn(self, *args) 2025-09-07T07:33:27.7697109Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7697256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7697333Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7697372Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7697530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7697576Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7697614Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7697739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7697779Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7697816Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7697980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7698033Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7698074Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7699548Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7699600Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7699640Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7699805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7699854Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7699894Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7700052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7700092Z t = dispatch_trace( 2025-09-07T07:33:27.7700127Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7700262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7700307Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7700347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7700471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7700512Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7700547Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7700707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7700801Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7700843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7700968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7701008Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7701043Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7702525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7702570Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7702606Z ^^^^^^^^^ 2025-09-07T07:33:27.7702756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7702806Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7702842Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7702885Z File "", line 1, in 2025-09-07T07:33:27.7703029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7703191Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7703240Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7703379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7703464Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7703502Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7703695Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7703739Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7703778Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7703949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7703994Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7704031Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7704175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7704219Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7704257Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7705739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7705831Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7705881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7706014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7706076Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7706121Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7706248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7706288Z leaves = list(leaves) 2025-09-07T07:33:27.7706323Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7706486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7706522Z return func(x) 2025-09-07T07:33:27.7706556Z ^^^^^^^ 2025-09-07T07:33:27.7706696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7706763Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7706824Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7706993Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7707036Z return func(*args, **kwargs) 2025-09-07T07:33:27.7707072Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7707257Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7707346Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7707349Z 2025-09-07T07:33:27.7707580Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7707583Z 2025-09-07T07:33:27.7707584Z 2025-09-07T07:33:27.7709011Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7709211Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7709213Z 2025-09-07T07:33:27.7709302Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7709377Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7709414Z inline_call [] 2025-09-07T07:33:27.7709471Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7709565Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7709641Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7709904Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7710021Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7710073Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7710226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7712922Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7713055Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7713260Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7713332Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7713368Z inline_call [] 2025-09-07T07:33:27.7713425Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7713499Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7713572Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7713831Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7713946Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7715359Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7715545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7715634Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7715768Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7715889Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7715982Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7716017Z inline_call [] 2025-09-07T07:33:27.7716074Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7716149Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7716223Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7716504Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7716621Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7716671Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7716823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7716910Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7717041Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7717160Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7717383Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-d8e30f51d85567cd.xml - 2025-09-07T07:33:27.7717462Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7717836Z FAILED [0.2348s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7717923Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7717925Z 2025-09-07T07:33:27.7719488Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7719490Z 2025-09-07T07:33:27.7719492Z 2025-09-07T07:33:27.7719569Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7719766Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7719770Z 2025-09-07T07:33:27.7719856Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7719917Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7719990Z ============= 1 failed, 2 passed, 61 deselected, 2 rerun in 5.41s ============== 2025-09-07T07:33:27.7720026Z Got exit code 1 2025-09-07T07:33:27.7720067Z Retrying single test... 2025-09-07T07:33:27.7720500Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7720542Z import pkg_resources 2025-09-07T07:33:27.7720735Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-143931dc94446f4f.xml 2025-09-07T07:33:27.7720796Z ============================= test session starts ============================== 2025-09-07T07:33:27.7720910Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7720952Z cachedir: .pytest_cache 2025-09-07T07:33:27.7721111Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7721172Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7721212Z configfile: pytest.ini 2025-09-07T07:33:27.7721374Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7721452Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.7721714Z stepcurrent: skipping 63 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7721761Z Running 1 items in this shard 2025-09-07T07:33:27.7721763Z 2025-09-07T07:33:27.7723424Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.6160s] [100%] 2025-09-07T07:33:27.7723624Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2381s] [100%] 2025-09-07T07:33:27.7723801Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True FAILED [0.2276s] [100%] 2025-09-07T07:33:27.7723803Z 2025-09-07T07:33:27.7723853Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7723966Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7724049Z Traceback (most recent call last): 2025-09-07T07:33:27.7724206Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7724241Z self._run_test( 2025-09-07T07:33:27.7724357Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7724414Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7724458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7724596Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7724644Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7724685Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7724840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7724891Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7724931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7725071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7725116Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7725158Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7725305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7725390Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7726950Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7727108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7727156Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7727341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7727399Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7727441Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7727586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7727639Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7727697Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7727816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7727885Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7727931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7728062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7728129Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7728193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7728339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7728384Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7728423Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7728564Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7728605Z return aot_autograd( 2025-09-07T07:33:27.7728641Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7728781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7730233Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7730280Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7730469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7730554Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7730602Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7730793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7730840Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7731030Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7731071Z fx_g = _create_graph( 2025-09-07T07:33:27.7731107Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7731275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7731311Z fx_g = make_fx( 2025-09-07T07:33:27.7731347Z ^^^^^^^^ 2025-09-07T07:33:27.7731501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7731549Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7731588Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7731738Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7731782Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7731820Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7731980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7732020Z t = dispatch_trace( 2025-09-07T07:33:27.7733509Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7733655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7733700Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7733738Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7733865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7733906Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7733981Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7734151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7734233Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7734275Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7734402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7734441Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7734481Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7734628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7734673Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7734708Z ^^^^^^^^^ 2025-09-07T07:33:27.7734844Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7734887Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7734925Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7735075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7735127Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7735161Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7736685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7736777Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7736828Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7737007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7737048Z outs_pair = fn(*args) 2025-09-07T07:33:27.7737084Z ^^^^^^^^^ 2025-09-07T07:33:27.7737259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7737327Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7737373Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7737547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7737589Z outs_pair = fn(*args) 2025-09-07T07:33:27.7737625Z ^^^^^^^^^ 2025-09-07T07:33:27.7737804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7737867Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7737911Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7738109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7738180Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7738230Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7738408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7738448Z outs_pair = fn(*args) 2025-09-07T07:33:27.7738500Z ^^^^^^^^^ 2025-09-07T07:33:27.7740034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7740083Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7740122Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7740294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7740361Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7740399Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7740529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7740572Z return handle_torch_function( 2025-09-07T07:33:27.7740610Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7740753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7740846Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7740893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7741064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7741107Z return func(*args, **kwargs) 2025-09-07T07:33:27.7741145Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7741273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7741320Z result = _engine_run_backward( 2025-09-07T07:33:27.7741358Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7741509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7741633Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7741699Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7741830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7743311Z return user_fn(self, *args) 2025-09-07T07:33:27.7743351Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7743498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7743542Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7743581Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7743740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7743784Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7743824Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7743954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7743996Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7744032Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7744199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7744253Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7744295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7744433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7744483Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7744523Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7744726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7744777Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7744818Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7744978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7746375Z t = dispatch_trace( 2025-09-07T07:33:27.7746412Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7746560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7746604Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7746641Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7746770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7746810Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7746845Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7747029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7747109Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7747151Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7747278Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7747318Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7747354Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7747482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7747525Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7747561Z ^^^^^^^^^ 2025-09-07T07:33:27.7747712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7747763Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7747823Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7747867Z File "", line 1, in 2025-09-07T07:33:27.7748013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7749435Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7749487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7749627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7749679Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7749718Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7749913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7749958Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7749997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7750171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7750217Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7750254Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7750399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7750444Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7750481Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7750617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7750706Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7750754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7750902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7750965Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7751011Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7751140Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7751193Z leaves = list(leaves) 2025-09-07T07:33:27.7752585Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7752710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7752747Z return func(x) 2025-09-07T07:33:27.7752780Z ^^^^^^^ 2025-09-07T07:33:27.7752920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7752986Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7753032Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7753326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7753370Z return func(*args, **kwargs) 2025-09-07T07:33:27.7753406Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7753591Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7753679Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7753682Z 2025-09-07T07:33:27.7753890Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7753893Z 2025-09-07T07:33:27.7753895Z 2025-09-07T07:33:27.7753971Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7754189Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7754191Z 2025-09-07T07:33:27.7754278Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7754354Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7754391Z inline_call [] 2025-09-07T07:33:27.7754449Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7754484Z inductor [] 2025-09-07T07:33:27.7754560Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7755995Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7756260Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7756380Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7756433Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7756586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7756674Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7756809Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7756931Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7757043Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7757088Z Traceback (most recent call last): 2025-09-07T07:33:27.7757264Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7757302Z self._run_test( 2025-09-07T07:33:27.7757417Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7757475Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7757516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7757651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7757716Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7757757Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7757910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7757957Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7757997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7759487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7759551Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7759591Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7759739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7759822Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7759864Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7760020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7760068Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7760220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7760276Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7760333Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7760479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7760532Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7760572Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7760691Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7760760Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7760805Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7760934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7760998Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7761042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7761190Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7761236Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7762620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7762762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7762803Z return aot_autograd( 2025-09-07T07:33:27.7762841Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7762978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7763051Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7763205Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7763371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7763491Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7763540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7763726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7763770Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7763980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7764022Z fx_g = _create_graph( 2025-09-07T07:33:27.7764058Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7764224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7764260Z fx_g = make_fx( 2025-09-07T07:33:27.7764293Z ^^^^^^^^ 2025-09-07T07:33:27.7764469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7764517Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7764557Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7764705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7766114Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7766154Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7766316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7766355Z t = dispatch_trace( 2025-09-07T07:33:27.7766391Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7766506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7766549Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7766611Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7766866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7766907Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7766944Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7767108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7767189Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7767231Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7767357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7767396Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7767432Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7767561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7767604Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7767641Z ^^^^^^^^^ 2025-09-07T07:33:27.7767774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7769163Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7769200Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7769352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7769403Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7769439Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7769598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7769663Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7769707Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7769915Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7769956Z outs_pair = fn(*args) 2025-09-07T07:33:27.7769992Z ^^^^^^^^^ 2025-09-07T07:33:27.7770164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7770249Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7770295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7770472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7770511Z outs_pair = fn(*args) 2025-09-07T07:33:27.7770546Z ^^^^^^^^^ 2025-09-07T07:33:27.7770725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7770801Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7770845Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7771043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7771115Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7772499Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7772677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7772717Z outs_pair = fn(*args) 2025-09-07T07:33:27.7772752Z ^^^^^^^^^ 2025-09-07T07:33:27.7772947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7773010Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7773049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7773314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7773362Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7773401Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7773528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7773571Z return handle_torch_function( 2025-09-07T07:33:27.7773607Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7773750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7773825Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7773875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7774045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7774088Z return func(*args, **kwargs) 2025-09-07T07:33:27.7774124Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7774250Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7774294Z result = _engine_run_backward( 2025-09-07T07:33:27.7775677Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7775827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7775950Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7776029Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7776160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7776203Z return user_fn(self, *args) 2025-09-07T07:33:27.7776241Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7776386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7776449Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7776487Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7776648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7776693Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7776730Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7776856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7776899Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7776955Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7777123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7777177Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7777221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7777360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7777411Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7777451Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7778954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7779006Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7779047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7779231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7779270Z t = dispatch_trace( 2025-09-07T07:33:27.7779309Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7779423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7779469Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7779506Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7779632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7779674Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7779710Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7779872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7779954Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7779998Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7780123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7780161Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7780198Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7780325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7780369Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7780405Z ^^^^^^^^^ 2025-09-07T07:33:27.7781908Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7781961Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7781996Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7782041Z File "", line 1, in 2025-09-07T07:33:27.7782212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7782294Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7782341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7782483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7782548Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7782588Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7782781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7782826Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7782862Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7783035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7783184Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7783223Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7783367Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7783411Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7783449Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7783585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7783673Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7783722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7785205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7785296Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7785344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7785476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7785519Z leaves = list(leaves) 2025-09-07T07:33:27.7785555Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7785680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7785717Z return func(x) 2025-09-07T07:33:27.7785751Z ^^^^^^^ 2025-09-07T07:33:27.7785891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7785958Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7786001Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7786172Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7786216Z return func(*args, **kwargs) 2025-09-07T07:33:27.7786253Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7786437Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7786525Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7786528Z 2025-09-07T07:33:27.7786738Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7786741Z 2025-09-07T07:33:27.7786743Z 2025-09-07T07:33:27.7786819Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7787037Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7787042Z 2025-09-07T07:33:27.7787130Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7788565Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7788603Z inline_call [] 2025-09-07T07:33:27.7788662Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7788697Z inductor [] 2025-09-07T07:33:27.7788796Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7788870Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7789130Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7789247Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7789299Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7789467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7789556Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7789690Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7789817Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7789891Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7789926Z inline_call [] 2025-09-07T07:33:27.7789984Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7790058Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7790130Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7790409Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7790525Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7790576Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7790728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7792163Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7792297Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7792417Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7792470Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7792583Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7792629Z Traceback (most recent call last): 2025-09-07T07:33:27.7792780Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7792817Z self._run_test( 2025-09-07T07:33:27.7792930Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7792989Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7793030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7793273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7793320Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7793361Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7793538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7793588Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7793627Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7793765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7793812Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7793867Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7794012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7794095Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7795519Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7795674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7795725Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7795898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7795955Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7795997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7796141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7796195Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7796235Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7796353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7796421Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7796466Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7796597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7796680Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7796723Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7796867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7796915Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7796954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7797093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7797133Z return aot_autograd( 2025-09-07T07:33:27.7797169Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7798654Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7798730Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7798780Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7798944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7799028Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7799076Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7799262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7799307Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7799495Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7799536Z fx_g = _create_graph( 2025-09-07T07:33:27.7799587Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7799757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7799793Z fx_g = make_fx( 2025-09-07T07:33:27.7799826Z ^^^^^^^^ 2025-09-07T07:33:27.7799980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7800050Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7800090Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7800240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7800284Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7800321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7800483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7800524Z t = dispatch_trace( 2025-09-07T07:33:27.7801904Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7802420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7802465Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7802501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7802629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7802671Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7802708Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7802871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7802952Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7802995Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7803214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7803277Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7803312Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7803442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7803485Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7803522Z ^^^^^^^^^ 2025-09-07T07:33:27.7803658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7803701Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7803737Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7803888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7803938Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7805345Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7805512Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7805576Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7805622Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7805800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7805842Z outs_pair = fn(*args) 2025-09-07T07:33:27.7805879Z ^^^^^^^^^ 2025-09-07T07:33:27.7806052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7806120Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7806165Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7806364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7806407Z outs_pair = fn(*args) 2025-09-07T07:33:27.7806444Z ^^^^^^^^^ 2025-09-07T07:33:27.7806624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7806820Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7806881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7807079Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7807150Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7807197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7807373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7807430Z outs_pair = fn(*args) 2025-09-07T07:33:27.7807467Z ^^^^^^^^^ 2025-09-07T07:33:27.7809020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7809068Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7809107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7809280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7809328Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7809366Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7809493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7809537Z return handle_torch_function( 2025-09-07T07:33:27.7809594Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7809739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7809816Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7809864Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7810036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7810080Z return func(*args, **kwargs) 2025-09-07T07:33:27.7810117Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7810242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7810285Z result = _engine_run_backward( 2025-09-07T07:33:27.7810322Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7810470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7810594Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7810645Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7812115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7812161Z return user_fn(self, *args) 2025-09-07T07:33:27.7812198Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7812347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7812392Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7812430Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7812609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7812656Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7812695Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7812823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7812864Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7812900Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7813181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7813236Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7813277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7813415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7813466Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7813508Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7813700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7813751Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7813790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7813952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7815356Z t = dispatch_trace( 2025-09-07T07:33:27.7815394Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7815510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7815555Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7815592Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7815719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7815784Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7815822Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7815989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7816070Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7816112Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7816241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7816280Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7816317Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7816444Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7816488Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7816524Z ^^^^^^^^^ 2025-09-07T07:33:27.7816676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7816729Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7816763Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7816807Z File "", line 1, in 2025-09-07T07:33:27.7816952Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7818375Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7818422Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7818561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7818610Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7818650Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7818869Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7818918Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7818954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7819130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7819175Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7819233Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7819378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7819422Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7819458Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7819595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7819685Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7819750Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7819879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7819941Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7819985Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7820115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7821493Z leaves = list(leaves) 2025-09-07T07:33:27.7821531Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7821656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7821692Z return func(x) 2025-09-07T07:33:27.7821726Z ^^^^^^^ 2025-09-07T07:33:27.7821865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7821952Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7821995Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7822165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7822207Z return func(*args, **kwargs) 2025-09-07T07:33:27.7822246Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7822430Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7822517Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7822519Z 2025-09-07T07:33:27.7822731Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7822736Z 2025-09-07T07:33:27.7822739Z 2025-09-07T07:33:27.7822815Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7823012Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7823015Z 2025-09-07T07:33:27.7823194Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7823270Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7823307Z inline_call [] 2025-09-07T07:33:27.7823365Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7823400Z inductor [] 2025-09-07T07:33:27.7823475Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7824906Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7825192Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7825311Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7825363Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7825516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7825619Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7825753Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7825874Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7825947Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7825982Z inline_call [] 2025-09-07T07:33:27.7826042Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7826139Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7826212Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7826472Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7826587Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7826637Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7826789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7826875Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7827008Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7827147Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7827219Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7828605Z inline_call [] 2025-09-07T07:33:27.7828664Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7828739Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7828810Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7829069Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7829183Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7829236Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7829387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7829473Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7829605Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7829729Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7829948Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-143931dc94446f4f.xml - 2025-09-07T07:33:27.7830007Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7830398Z FAILED [0.2276s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7830485Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7830487Z 2025-09-07T07:33:27.7830696Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7830714Z 2025-09-07T07:33:27.7830716Z 2025-09-07T07:33:27.7830789Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7830986Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7830989Z 2025-09-07T07:33:27.7831074Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7831137Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7831221Z ================== 1 failed, 220 deselected, 2 rerun in 1.40s ================== 2025-09-07T07:33:27.7832603Z Got exit code 1 2025-09-07T07:33:27.7832644Z Retrying single test... 2025-09-07T07:33:27.7833173Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7833214Z import pkg_resources 2025-09-07T07:33:27.7833389Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-785b1b04eda532f7.xml 2025-09-07T07:33:27.7833447Z ============================= test session starts ============================== 2025-09-07T07:33:27.7833564Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7833633Z cachedir: .pytest_cache 2025-09-07T07:33:27.7833794Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7833840Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7833880Z configfile: pytest.ini 2025-09-07T07:33:27.7834046Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7834126Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.7834362Z stepcurrent: skipping 63 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7834407Z Running 1 items in this shard 2025-09-07T07:33:27.7834409Z 2025-09-07T07:33:27.7834608Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.6235s] [100%] 2025-09-07T07:33:27.7834805Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2423s] [100%] 2025-09-07T07:33:27.7834976Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True FAILED [0.2375s] [100%] 2025-09-07T07:33:27.7834980Z 2025-09-07T07:33:27.7835031Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7835143Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7835189Z Traceback (most recent call last): 2025-09-07T07:33:27.7835345Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7836738Z self._run_test( 2025-09-07T07:33:27.7836880Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7836940Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7836982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7837120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7837197Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7837238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7837395Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7837443Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7837483Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7837623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7837670Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7837732Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7837878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7837963Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7838002Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7838159Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7838207Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7838360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7838415Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7838456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7839954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7840030Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7840070Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7840191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7840259Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7840306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7840437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7840501Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7840545Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7840688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7840736Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7840776Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7840917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7840957Z return aot_autograd( 2025-09-07T07:33:27.7840994Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7841132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7841205Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7841252Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7841416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7841500Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7841564Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7841752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7843234Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7843426Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7843498Z fx_g = _create_graph( 2025-09-07T07:33:27.7843534Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7843701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7843736Z fx_g = make_fx( 2025-09-07T07:33:27.7843770Z ^^^^^^^^ 2025-09-07T07:33:27.7843928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7843978Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7844035Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7844186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7844230Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7844268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7844431Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7844470Z t = dispatch_trace( 2025-09-07T07:33:27.7844506Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7844619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7844663Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7844700Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7844828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7844890Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7846284Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7846450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7846531Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7846575Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7846819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7846859Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7846896Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7847025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7847069Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7847107Z ^^^^^^^^^ 2025-09-07T07:33:27.7847244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7847285Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7847322Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7847475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7847527Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7847562Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7847721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7847785Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7847831Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7848034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7848077Z outs_pair = fn(*args) 2025-09-07T07:33:27.7848114Z ^^^^^^^^^ 2025-09-07T07:33:27.7849634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7849705Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7849769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7849946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7849985Z outs_pair = fn(*args) 2025-09-07T07:33:27.7850021Z ^^^^^^^^^ 2025-09-07T07:33:27.7850200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7850264Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7850325Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7850524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7850596Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7850645Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7850823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7850863Z outs_pair = fn(*args) 2025-09-07T07:33:27.7850898Z ^^^^^^^^^ 2025-09-07T07:33:27.7851093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7851153Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7851193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7851364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7851413Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7851451Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7852925Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7852971Z return handle_torch_function( 2025-09-07T07:33:27.7853010Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7853251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7853329Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7853375Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7853549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7853591Z return func(*args, **kwargs) 2025-09-07T07:33:27.7853628Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7853753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7853798Z result = _engine_run_backward( 2025-09-07T07:33:27.7853837Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7853985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7854107Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7854158Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7854315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7854360Z return user_fn(self, *args) 2025-09-07T07:33:27.7854398Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7854544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7854589Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7854645Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7854807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7856208Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7856248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7856374Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7856415Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7856453Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7856643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7856697Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7856740Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7856877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7856930Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7856969Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7857134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7857182Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7857222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7857383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7857441Z t = dispatch_trace( 2025-09-07T07:33:27.7857476Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7857593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7857638Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7857675Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7857802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7857842Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7859218Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7859380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7859460Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7859502Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7859630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7859669Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7859706Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7859833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7859877Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7859912Z ^^^^^^^^^ 2025-09-07T07:33:27.7860063Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7860112Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7860147Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7860190Z File "", line 1, in 2025-09-07T07:33:27.7860357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7860438Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7860486Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7860623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7860671Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7860724Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7860919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7862302Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7862340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7862516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7862562Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7862616Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7862763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7862807Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7862843Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7862981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7863151Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7863200Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7863327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7863390Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7863435Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7863585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7863624Z leaves = list(leaves) 2025-09-07T07:33:27.7863661Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7863785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7863822Z return func(x) 2025-09-07T07:33:27.7863856Z ^^^^^^^ 2025-09-07T07:33:27.7863999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7864064Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7865457Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7865629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7865674Z return func(*args, **kwargs) 2025-09-07T07:33:27.7865711Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7865903Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7865990Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7865992Z 2025-09-07T07:33:27.7866201Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7866204Z 2025-09-07T07:33:27.7866206Z 2025-09-07T07:33:27.7866280Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7866479Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7866481Z 2025-09-07T07:33:27.7866588Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7866667Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7866703Z inline_call [] 2025-09-07T07:33:27.7866761Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7866796Z inductor [] 2025-09-07T07:33:27.7866872Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7866964Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7867224Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7867340Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7867392Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7867546Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7867652Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7869133Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7869257Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7869372Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7869418Z Traceback (most recent call last): 2025-09-07T07:33:27.7869570Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7869607Z self._run_test( 2025-09-07T07:33:27.7869721Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7869778Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7869838Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7869972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7870019Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7870058Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7870211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7870258Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7870298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7870435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7870481Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7870519Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7870664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7870748Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7870788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7870941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7872334Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7872489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7872544Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7872585Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7872735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7872805Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7872847Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7872966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7873037Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7873177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7873307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7873390Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7873433Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7873576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7873622Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7873660Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7873823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7873864Z return aot_autograd( 2025-09-07T07:33:27.7873900Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7874039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7874109Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7875513Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7875679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7875764Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7875810Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7875997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7876066Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7876260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7876301Z fx_g = _create_graph( 2025-09-07T07:33:27.7876338Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7876505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7876541Z fx_g = make_fx( 2025-09-07T07:33:27.7876574Z ^^^^^^^^ 2025-09-07T07:33:27.7876729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7876776Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7876815Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7876967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7877012Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7877049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7877210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7877249Z t = dispatch_trace( 2025-09-07T07:33:27.7877284Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7877400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7878787Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7878825Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7878954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7878995Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7879060Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7879225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7879305Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7879348Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7879474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7879531Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7879567Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7879702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7879744Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7879782Z ^^^^^^^^^ 2025-09-07T07:33:27.7879917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7879960Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7880011Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7880163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7880213Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7880249Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7880409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7881813Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7881860Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7882038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7882078Z outs_pair = fn(*args) 2025-09-07T07:33:27.7882116Z ^^^^^^^^^ 2025-09-07T07:33:27.7882317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7882384Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7882430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7882610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7882650Z outs_pair = fn(*args) 2025-09-07T07:33:27.7882685Z ^^^^^^^^^ 2025-09-07T07:33:27.7882864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7882925Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7882970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7883261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7883334Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7883381Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7883556Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7883596Z outs_pair = fn(*args) 2025-09-07T07:33:27.7883632Z ^^^^^^^^^ 2025-09-07T07:33:27.7883824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7883872Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7885266Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7885471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7885521Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7885560Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7885687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7885731Z return handle_torch_function( 2025-09-07T07:33:27.7885787Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7885931Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7886008Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7886055Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7886225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7886271Z return func(*args, **kwargs) 2025-09-07T07:33:27.7886325Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7886453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7886496Z result = _engine_run_backward( 2025-09-07T07:33:27.7886533Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7886796Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7886920Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7886971Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7887100Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7887141Z return user_fn(self, *args) 2025-09-07T07:33:27.7888561Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7888714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7888760Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7888797Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7888957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7889004Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7889042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7889171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7889211Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7889248Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7889416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7889470Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7889512Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7889651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7889701Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7889741Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7889905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7889954Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7889996Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7890161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7890200Z t = dispatch_trace( 2025-09-07T07:33:27.7890253Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7891715Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7891762Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7891800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7891929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7891987Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7892024Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7892188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7892268Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7892310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7892436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7892479Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7892529Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7892658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7892701Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7892737Z ^^^^^^^^^ 2025-09-07T07:33:27.7892888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7892940Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7892975Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7893019Z File "", line 1, in 2025-09-07T07:33:27.7893305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7893386Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7893434Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7894977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7895028Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7895069Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7895264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7895311Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7895347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7895520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7895566Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7895605Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7895751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7895797Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7895834Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7895969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7896061Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7896109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7896237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7896299Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7896344Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7896472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7896553Z leaves = list(leaves) 2025-09-07T07:33:27.7896590Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7898065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7898103Z return func(x) 2025-09-07T07:33:27.7898138Z ^^^^^^^ 2025-09-07T07:33:27.7898280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7898368Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7898411Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7898583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7898625Z return func(*args, **kwargs) 2025-09-07T07:33:27.7898662Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7898848Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7898976Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7898979Z 2025-09-07T07:33:27.7899188Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7899191Z 2025-09-07T07:33:27.7899193Z 2025-09-07T07:33:27.7899268Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7899466Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7899468Z 2025-09-07T07:33:27.7899556Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7899631Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7899683Z inline_call [] 2025-09-07T07:33:27.7899742Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7899778Z inductor [] 2025-09-07T07:33:27.7899853Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7899927Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7900190Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7901663Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7901717Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7901872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7901964Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7902101Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7902223Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7902299Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7902334Z inline_call [] 2025-09-07T07:33:27.7902394Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7902468Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7902540Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7902799Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7902931Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7902985Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7903223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7903310Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7903444Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7903585Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7903637Z =================================== FAILURES =================================== 2025-09-07T07:33:27.7903747Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.7903793Z Traceback (most recent call last): 2025-09-07T07:33:27.7905305Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7905377Z self._run_test( 2025-09-07T07:33:27.7905496Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7905553Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7905594Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7905731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7905778Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7905818Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7905972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7906018Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7906060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7906219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7906265Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7906304Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7906449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7906532Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7906573Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7906729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7906777Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7906928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7906984Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7907026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7908524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7908579Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7908620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7908738Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7908808Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7908853Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7908982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7909046Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7909089Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7909256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7909303Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7909341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7909479Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7909534Z return aot_autograd( 2025-09-07T07:33:27.7909570Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7909710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7909779Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7909827Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7909991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7910092Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7910139Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7911669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7911716Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7911908Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7911949Z fx_g = _create_graph( 2025-09-07T07:33:27.7911985Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7912151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7912188Z fx_g = make_fx( 2025-09-07T07:33:27.7912221Z ^^^^^^^^ 2025-09-07T07:33:27.7912394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7912441Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7912482Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7912630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7912677Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7912714Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7912876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7912915Z t = dispatch_trace( 2025-09-07T07:33:27.7912951Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7913149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7913194Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7913232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7913360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7913402Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7914797Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7914963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7915045Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7915088Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7915216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7915257Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7915293Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7915447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7915492Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7915529Z ^^^^^^^^^ 2025-09-07T07:33:27.7915663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7915706Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7915742Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7915913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7915963Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7915998Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7916157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7916221Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7916266Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7916466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7916506Z outs_pair = fn(*args) 2025-09-07T07:33:27.7917894Z ^^^^^^^^^ 2025-09-07T07:33:27.7918074Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7918144Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7918190Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7918366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7918405Z outs_pair = fn(*args) 2025-09-07T07:33:27.7918441Z ^^^^^^^^^ 2025-09-07T07:33:27.7918622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7918705Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7918749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7918945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7919019Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7919066Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7919247Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7919286Z outs_pair = fn(*args) 2025-09-07T07:33:27.7919322Z ^^^^^^^^^ 2025-09-07T07:33:27.7919516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7919564Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7919601Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7919772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7919821Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7919860Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7921329Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7921376Z return handle_torch_function( 2025-09-07T07:33:27.7921413Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7921561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7921655Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7921706Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7921879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7921921Z return func(*args, **kwargs) 2025-09-07T07:33:27.7921958Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7922103Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7922146Z result = _engine_run_backward( 2025-09-07T07:33:27.7922184Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7922332Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7922455Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7922512Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7922656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7922699Z return user_fn(self, *args) 2025-09-07T07:33:27.7922737Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7922884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7922930Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7922969Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7923230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7924652Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7924689Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7924818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7924881Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7924920Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7925090Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7925143Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7925186Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7925326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7925377Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7925417Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7925580Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7925629Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7925671Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7925834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7925874Z t = dispatch_trace( 2025-09-07T07:33:27.7925910Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7926026Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7926071Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7926107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7926235Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7927742Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7927781Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7927946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7928051Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7928095Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7928221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7928262Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7928297Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7928452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7928495Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7928531Z ^^^^^^^^^ 2025-09-07T07:33:27.7928681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7928732Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7928766Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7928810Z File "", line 1, in 2025-09-07T07:33:27.7928997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7929078Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7929125Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7929263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7929313Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7929353Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7929552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7930950Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7930989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7931164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7931227Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7931266Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7931410Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7931454Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7931491Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7931628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7931719Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7931766Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7931894Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7931958Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7932004Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7932132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7932172Z leaves = list(leaves) 2025-09-07T07:33:27.7932208Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7932335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7932370Z return func(x) 2025-09-07T07:33:27.7932404Z ^^^^^^^ 2025-09-07T07:33:27.7932544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7934054Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7934099Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7934301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7934345Z return func(*args, **kwargs) 2025-09-07T07:33:27.7934382Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7934567Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7934654Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7934676Z 2025-09-07T07:33:27.7934884Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7934887Z 2025-09-07T07:33:27.7934888Z 2025-09-07T07:33:27.7934964Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7935164Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7935167Z 2025-09-07T07:33:27.7935274Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7935349Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7935386Z inline_call [] 2025-09-07T07:33:27.7935444Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7935481Z inductor [] 2025-09-07T07:33:27.7935557Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7935631Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7935891Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7936007Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7936079Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7936234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7936321Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7937818Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7937944Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7938018Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7938053Z inline_call [] 2025-09-07T07:33:27.7938111Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7938185Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7938259Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7938519Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7938634Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7938685Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7938838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7938924Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7939057Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7939177Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7939267Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7939303Z inline_call [] 2025-09-07T07:33:27.7939360Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.7939434Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7939504Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7939763Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7939894Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7941298Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7941456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7941544Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7941693Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7941813Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7942034Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-785b1b04eda532f7.xml - 2025-09-07T07:33:27.7942094Z =========================== short test summary info ============================ 2025-09-07T07:33:27.7942462Z FAILED [0.2375s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7942548Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7942566Z 2025-09-07T07:33:27.7942777Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7942779Z 2025-09-07T07:33:27.7942781Z 2025-09-07T07:33:27.7942854Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7943051Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.7943113Z 2025-09-07T07:33:27.7943199Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7943262Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.7943329Z ================== 1 failed, 220 deselected, 2 rerun in 1.38s ================== 2025-09-07T07:33:27.7943365Z Got exit code 1 2025-09-07T07:33:27.7943492Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.7943933Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.7943974Z import pkg_resources 2025-09-07T07:33:27.7944148Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-700b5f2eff00d266.xml 2025-09-07T07:33:27.7944205Z ============================= test session starts ============================== 2025-09-07T07:33:27.7945682Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.7945724Z cachedir: .pytest_cache 2025-09-07T07:33:27.7945913Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.7945962Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.7946002Z configfile: pytest.ini 2025-09-07T07:33:27.7946166Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.7946243Z collecting ... collected 467 items / 64 deselected / 403 selected 2025-09-07T07:33:27.7946314Z stepcurrent: skipping 64 already run items. 2025-09-07T07:33:27.7946357Z Running 157 items in this shard 2025-09-07T07:33:27.7946360Z 2025-09-07T07:33:27.7946560Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.1439s] [ 0%] 2025-09-07T07:33:27.7946756Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.7184s] [ 0%] 2025-09-07T07:33:27.7946947Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True FAILED [0.7048s] [ 0%] 2025-09-07T07:33:27.7946949Z 2025-09-07T07:33:27.7947001Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.7947110Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.7947157Z Traceback (most recent call last): 2025-09-07T07:33:27.7947312Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7947349Z self._run_test( 2025-09-07T07:33:27.7947464Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7947522Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7947564Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7947702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7947774Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7949163Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7949320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7949368Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7949408Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7949548Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7949594Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7949632Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7949778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7949862Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7949904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7950059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7950107Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7950259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7950315Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7950356Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7950501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7950558Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7950599Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7950742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7950814Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7950859Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7952337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7952404Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7952466Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7952612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7952658Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7952696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7952837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7952880Z return aot_autograd( 2025-09-07T07:33:27.7952917Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7953149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7953220Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7953267Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7953432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7953517Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7953565Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7953750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7953795Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7954005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7954046Z fx_g = _create_graph( 2025-09-07T07:33:27.7954084Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7954252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7954290Z fx_g = make_fx( 2025-09-07T07:33:27.7955683Z ^^^^^^^^ 2025-09-07T07:33:27.7955840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7955887Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7955928Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7956076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7956124Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7956162Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7956325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7956364Z t = dispatch_trace( 2025-09-07T07:33:27.7956399Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7956514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7956558Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7956594Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7956722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7956763Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7956799Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7956986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7957070Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7957112Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7957239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7957279Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7958652Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7958806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7958851Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7958886Z ^^^^^^^^^ 2025-09-07T07:33:27.7959021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7959063Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7959099Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7959268Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7959320Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7959355Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7959514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7959580Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7959625Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7959803Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7959844Z outs_pair = fn(*args) 2025-09-07T07:33:27.7959880Z ^^^^^^^^^ 2025-09-07T07:33:27.7960055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7960140Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7960185Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7960361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7960400Z outs_pair = fn(*args) 2025-09-07T07:33:27.7960437Z ^^^^^^^^^ 2025-09-07T07:33:27.7961959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7962023Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7962067Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7962266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7962339Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7962389Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7962562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7962602Z outs_pair = fn(*args) 2025-09-07T07:33:27.7962638Z ^^^^^^^^^ 2025-09-07T07:33:27.7962830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7962877Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7962915Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7963201Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7963272Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7963313Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7963441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7963485Z return handle_torch_function( 2025-09-07T07:33:27.7963522Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7963665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.7963758Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.7963806Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7963976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7965384Z return func(*args, **kwargs) 2025-09-07T07:33:27.7965422Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7965550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.7965619Z result = _engine_run_backward( 2025-09-07T07:33:27.7965658Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7965806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.7965933Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7965985Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7966114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.7966156Z return user_fn(self, *args) 2025-09-07T07:33:27.7966194Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7966340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.7966405Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.7966445Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7966606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.7966650Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.7966829Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7966956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7966997Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7967033Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7967199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.7968613Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.7968657Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7968799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.7968849Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.7968892Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7969054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.7969105Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.7969145Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7969313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7969352Z t = dispatch_trace( 2025-09-07T07:33:27.7969388Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7969502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7969566Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7969605Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7969733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7969772Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7969809Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7969971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7970066Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7970108Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7970234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7970273Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7971651Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7971782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7971844Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7971880Z ^^^^^^^^^ 2025-09-07T07:33:27.7972033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7972084Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7972119Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7972163Z File "", line 1, in 2025-09-07T07:33:27.7972308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.7972388Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.7972435Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7972577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.7972648Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.7972688Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7972884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7972929Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7972966Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7973218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.7973263Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.7973302Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7973445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.7974840Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.7974881Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7975020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.7975109Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.7975157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7975284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.7975347Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.7975392Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7975519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.7975559Z leaves = list(leaves) 2025-09-07T07:33:27.7975595Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.7975745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.7975784Z return func(x) 2025-09-07T07:33:27.7975818Z ^^^^^^^ 2025-09-07T07:33:27.7975957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.7976023Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.7976082Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7976254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.7976295Z return func(*args, **kwargs) 2025-09-07T07:33:27.7976333Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7976516Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.7976605Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.7976608Z 2025-09-07T07:33:27.7978181Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.7978185Z 2025-09-07T07:33:27.7978187Z 2025-09-07T07:33:27.7978265Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.7978463Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.7978466Z 2025-09-07T07:33:27.7978552Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.7978628Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.7978663Z inline_call [] 2025-09-07T07:33:27.7978721Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.7978756Z inductor [] 2025-09-07T07:33:27.7978851Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.7978926Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.7979187Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.7979306Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.7979357Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.7979511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.7979601Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.7979738Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.7979861Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.7979971Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.7980016Z Traceback (most recent call last): 2025-09-07T07:33:27.7980168Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.7980205Z self._run_test( 2025-09-07T07:33:27.7983955Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.7984013Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.7984055Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7984188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.7984236Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.7984304Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7984462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.7984509Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.7984549Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7984686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.7984752Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.7984790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7984934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.7985017Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.7985057Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7985214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.7985285Z raise BackendCompilerFailed( 2025-09-07T07:33:27.7985438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.7985492Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7985535Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7985680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.7985734Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.7987149Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7987270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.7987338Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.7987409Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7987539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.7987604Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.7987646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7987789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.7987836Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.7987875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7988016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.7988057Z return aot_autograd( 2025-09-07T07:33:27.7988093Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.7988232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.7988305Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.7988353Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7988516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.7988603Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.7988653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7988840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.7988884Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.7990451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.7990496Z fx_g = _create_graph( 2025-09-07T07:33:27.7990535Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7990702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.7990739Z fx_g = make_fx( 2025-09-07T07:33:27.7990773Z ^^^^^^^^ 2025-09-07T07:33:27.7990928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.7990991Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.7991031Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7991180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.7991224Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.7991262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7991423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.7991476Z t = dispatch_trace( 2025-09-07T07:33:27.7991512Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7991628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.7991670Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.7991708Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7991836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7991877Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7991914Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7992081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.7993592Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.7993639Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7993795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.7993835Z return fn(*args, **kwargs) 2025-09-07T07:33:27.7993871Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7994002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.7994046Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.7994082Z ^^^^^^^^^ 2025-09-07T07:33:27.7994217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.7994259Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.7994295Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7994447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.7994498Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.7994534Z ^^^^^^^^^^^ 2025-09-07T07:33:27.7994694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.7994758Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.7994804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7994983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7995024Z outs_pair = fn(*args) 2025-09-07T07:33:27.7995060Z ^^^^^^^^^ 2025-09-07T07:33:27.7995235Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.7995302Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.7996747Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7996929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7996969Z outs_pair = fn(*args) 2025-09-07T07:33:27.7997004Z ^^^^^^^^^ 2025-09-07T07:33:27.7997186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.7997263Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.7997307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7997500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.7997571Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.7997617Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7997814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.7997853Z outs_pair = fn(*args) 2025-09-07T07:33:27.7997888Z ^^^^^^^^^ 2025-09-07T07:33:27.7998076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.7998123Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.7998160Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7998328Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.7998374Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.7998412Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.7998537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.7998596Z return handle_torch_function( 2025-09-07T07:33:27.7999954Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8000097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8000171Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8000220Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8000391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8000432Z return func(*args, **kwargs) 2025-09-07T07:33:27.8000468Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8000589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8000633Z result = _engine_run_backward( 2025-09-07T07:33:27.8000670Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8000817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8000936Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8000986Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8001113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8001155Z return user_fn(self, *args) 2025-09-07T07:33:27.8001192Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8001335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8001378Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8001416Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8001591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8001637Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8001673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8003189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8003260Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8003296Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8003461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8003514Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8003554Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8003689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8003741Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8003803Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8003963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8004011Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8004049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8004208Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8004247Z t = dispatch_trace( 2025-09-07T07:33:27.8004280Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8004393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8004436Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8004473Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8004597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8004657Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8004693Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8006182Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8006263Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8006307Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8006430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8006469Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8006506Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8006632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8006673Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8006779Z ^^^^^^^^^ 2025-09-07T07:33:27.8006928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8006978Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8007011Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8007054Z File "", line 1, in 2025-09-07T07:33:27.8007200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8007282Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8007328Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8007462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8007510Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8007548Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8007766Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8007810Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8007847Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8009337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8009401Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8009438Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8009581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8009624Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8009662Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8009797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8009901Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8009948Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8010073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8010133Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8010178Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8010302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8010344Z leaves = list(leaves) 2025-09-07T07:33:27.8010378Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8010503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8010537Z return func(x) 2025-09-07T07:33:27.8010571Z ^^^^^^^ 2025-09-07T07:33:27.8010725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8010790Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8010831Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8012308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8012353Z return func(*args, **kwargs) 2025-09-07T07:33:27.8012390Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8012570Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8012655Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8012657Z 2025-09-07T07:33:27.8012862Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8012866Z 2025-09-07T07:33:27.8012868Z 2025-09-07T07:33:27.8012942Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8013223Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8013226Z 2025-09-07T07:33:27.8013312Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8013385Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8013420Z inline_call [] 2025-09-07T07:33:27.8013478Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8013512Z inductor [] 2025-09-07T07:33:27.8013586Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8013681Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8013938Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8014054Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8014106Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8014276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8014362Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8014492Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8014612Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8016021Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8016077Z inline_call [] 2025-09-07T07:33:27.8016134Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8016208Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8016277Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8016531Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8016644Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8016695Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8016843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8016929Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8017077Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8017195Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8017245Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8017357Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8017400Z Traceback (most recent call last): 2025-09-07T07:33:27.8017549Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.8017584Z self._run_test( 2025-09-07T07:33:27.8017697Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8017751Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8017795Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8017926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8019288Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8019329Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8019481Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8019528Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8019567Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8019702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8019746Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8019784Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8019943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8020027Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8020066Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8020218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8020264Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8020433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8020488Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8020528Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8020671Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8020723Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8020765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8020897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8020963Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8021008Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8022454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8022521Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8022563Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8022703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8022747Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8022786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8022923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8022982Z return aot_autograd( 2025-09-07T07:33:27.8023017Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8023224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8023292Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8023340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8023499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8023583Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8023628Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8023810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8023855Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8024042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8024082Z fx_g = _create_graph( 2025-09-07T07:33:27.8024118Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8024281Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8025638Z fx_g = make_fx( 2025-09-07T07:33:27.8025672Z ^^^^^^^^ 2025-09-07T07:33:27.8025824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8025871Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8025909Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8026085Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8026130Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8026167Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8026324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8026363Z t = dispatch_trace( 2025-09-07T07:33:27.8026415Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8026530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8026571Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8026608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8026731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8026772Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8026808Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8026986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8027065Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8027107Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8027230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8027271Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8028621Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8028751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8028793Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8028829Z ^^^^^^^^^ 2025-09-07T07:33:27.8028960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8029027Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8029064Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8029211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8029261Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8029295Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8029451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8029514Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8029558Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8029732Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8029772Z outs_pair = fn(*args) 2025-09-07T07:33:27.8029807Z ^^^^^^^^^ 2025-09-07T07:33:27.8029980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8030046Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8030091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8030261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8030302Z outs_pair = fn(*args) 2025-09-07T07:33:27.8030336Z ^^^^^^^^^ 2025-09-07T07:33:27.8031825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8031885Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8031929Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8032141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8032213Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8032259Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8032433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8032484Z outs_pair = fn(*args) 2025-09-07T07:33:27.8032519Z ^^^^^^^^^ 2025-09-07T07:33:27.8032708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8032754Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8032790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8032959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8033018Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8033147Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8033272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8033315Z return handle_torch_function( 2025-09-07T07:33:27.8033353Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8033494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8033568Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8033614Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8035103Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8035148Z return func(*args, **kwargs) 2025-09-07T07:33:27.8035216Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8035341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8035383Z result = _engine_run_backward( 2025-09-07T07:33:27.8035419Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8035565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8035686Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8035737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8035863Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8035905Z return user_fn(self, *args) 2025-09-07T07:33:27.8035941Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8036087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8036130Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8036168Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8036323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8036369Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8036404Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8036528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8036567Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8036603Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8036765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8038157Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8038200Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8038336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8038385Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8038425Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8038602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8038650Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8038688Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8038846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8038884Z t = dispatch_trace( 2025-09-07T07:33:27.8038919Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8039050Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8039093Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8039131Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8039254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8039294Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8039330Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8039488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8039565Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8039606Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8039728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8041082Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8041135Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8041263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8041304Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8041340Z ^^^^^^^^^ 2025-09-07T07:33:27.8041487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8041539Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8041572Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8041615Z File "", line 1, in 2025-09-07T07:33:27.8041756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8041834Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8041881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8042021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8042068Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8042106Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8042296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8042340Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8042377Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8042545Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8042590Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8042626Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8042788Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8044254Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8044294Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8044429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8044517Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8044590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8044716Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8044777Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8044821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8044946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8044988Z leaves = list(leaves) 2025-09-07T07:33:27.8045023Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8045162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8045198Z return func(x) 2025-09-07T07:33:27.8045231Z ^^^^^^^ 2025-09-07T07:33:27.8045370Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8045438Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8045480Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8045648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8045689Z return func(*args, **kwargs) 2025-09-07T07:33:27.8045725Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8045909Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8047397Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8047400Z 2025-09-07T07:33:27.8047607Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8047609Z 2025-09-07T07:33:27.8047612Z 2025-09-07T07:33:27.8047686Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8047879Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8047881Z 2025-09-07T07:33:27.8047967Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8048039Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8048075Z inline_call [] 2025-09-07T07:33:27.8048134Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8048170Z inductor [] 2025-09-07T07:33:27.8048243Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8048315Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8048569Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8048685Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8048735Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8048885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8048971Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8049126Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8049245Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8049317Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8049351Z inline_call [] 2025-09-07T07:33:27.8049420Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8049494Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8050886Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8051140Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8051254Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8051305Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8051467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8051553Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8051683Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8051808Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8051877Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8051913Z inline_call [] 2025-09-07T07:33:27.8051968Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8052041Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8052110Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8052379Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8052490Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8052541Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8052688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8052773Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8052900Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8053017Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8053291Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-700b5f2eff00d266.xml - 2025-09-07T07:33:27.8054682Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8055042Z FAILED [0.7048s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8055128Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8055131Z 2025-09-07T07:33:27.8055337Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8055339Z 2025-09-07T07:33:27.8055341Z 2025-09-07T07:33:27.8055438Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8055632Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8055634Z 2025-09-07T07:33:27.8055717Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8055778Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8055864Z ================== 1 failed, 64 deselected, 2 rerun in 2.84s =================== 2025-09-07T07:33:27.8055900Z Got exit code 1 2025-09-07T07:33:27.8055939Z Retrying single test... 2025-09-07T07:33:27.8056360Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8056400Z import pkg_resources 2025-09-07T07:33:27.8056586Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-616953c76b974522.xml 2025-09-07T07:33:27.8056642Z ============================= test session starts ============================== 2025-09-07T07:33:27.8056755Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8056794Z cachedir: .pytest_cache 2025-09-07T07:33:27.8056951Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8056996Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8057035Z configfile: pytest.ini 2025-09-07T07:33:27.8057195Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8058597Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.8058848Z stepcurrent: skipping 64 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8058891Z Running 1 items in this shard 2025-09-07T07:33:27.8058894Z 2025-09-07T07:33:27.8059085Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.1738s] [100%] 2025-09-07T07:33:27.8059275Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.9243s] [100%] 2025-09-07T07:33:27.8059442Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True FAILED [0.7162s] [100%] 2025-09-07T07:33:27.8059444Z 2025-09-07T07:33:27.8059495Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8059605Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8059650Z Traceback (most recent call last): 2025-09-07T07:33:27.8059802Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.8059838Z self._run_test( 2025-09-07T07:33:27.8059951Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8060008Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8060049Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8060184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8060231Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8060270Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8060434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8060483Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8060523Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8060658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8060703Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8062072Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8062217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8062298Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8062339Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8062490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8062539Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8062704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8062760Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8062801Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8062945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8062998Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8063038Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8063214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8063282Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8063326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8063453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8063545Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8063588Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8063727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8063773Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8063810Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8065272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8065314Z return aot_autograd( 2025-09-07T07:33:27.8065350Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8065486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8065556Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8065603Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8065766Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8065849Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8065894Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8066082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8066126Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8066312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8066352Z fx_g = _create_graph( 2025-09-07T07:33:27.8066424Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8066589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8066624Z fx_g = make_fx( 2025-09-07T07:33:27.8066657Z ^^^^^^^^ 2025-09-07T07:33:27.8066808Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8066880Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8066919Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8067064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8067108Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8068453Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8068616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8068657Z t = dispatch_trace( 2025-09-07T07:33:27.8068692Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8068838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8068882Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8068917Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8069043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8069084Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8069120Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8069281Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8069359Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8069403Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8069530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8069586Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8069622Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8069748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8069790Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8069825Z ^^^^^^^^^ 2025-09-07T07:33:27.8069959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8070000Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8070035Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8071494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8071546Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8071581Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8071739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8071801Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8071846Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8072019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8072060Z outs_pair = fn(*args) 2025-09-07T07:33:27.8072095Z ^^^^^^^^^ 2025-09-07T07:33:27.8072265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8072332Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8072377Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8072571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8072613Z outs_pair = fn(*args) 2025-09-07T07:33:27.8072648Z ^^^^^^^^^ 2025-09-07T07:33:27.8072826Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8072885Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8072948Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8073186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8073259Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8073305Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8074811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8074894Z outs_pair = fn(*args) 2025-09-07T07:33:27.8074929Z ^^^^^^^^^ 2025-09-07T07:33:27.8075117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8075163Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8075201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8075369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8075415Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8075454Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8075578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8075621Z return handle_torch_function( 2025-09-07T07:33:27.8075675Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8075817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8075891Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8075938Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8076104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8076146Z return func(*args, **kwargs) 2025-09-07T07:33:27.8076182Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8076306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8076347Z result = _engine_run_backward( 2025-09-07T07:33:27.8076384Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8076529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8077975Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8078027Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8078153Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8078195Z return user_fn(self, *args) 2025-09-07T07:33:27.8078232Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8078375Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8078419Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8078456Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8078637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8078683Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8078721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8078846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8078886Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8078923Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8079107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8079160Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8079200Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8079335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8079384Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8079424Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8079602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8080977Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8081018Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8081178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8081217Z t = dispatch_trace( 2025-09-07T07:33:27.8081252Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8081365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8081408Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8081445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8081568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8081627Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8081663Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8081823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8081902Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8081943Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8082068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8082107Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8082141Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8082267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8082308Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8082344Z ^^^^^^^^^ 2025-09-07T07:33:27.8082492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8082544Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8083976Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8084023Z File "", line 1, in 2025-09-07T07:33:27.8084167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8084248Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8084294Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8084430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8084477Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8084516Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8084729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8084776Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8084811Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8084981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8085024Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8085078Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8085220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8085263Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8085299Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8085431Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8085520Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8085596Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8085722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8087233Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8087279Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8087408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8087446Z leaves = list(leaves) 2025-09-07T07:33:27.8087481Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8087604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8087638Z return func(x) 2025-09-07T07:33:27.8087672Z ^^^^^^^ 2025-09-07T07:33:27.8087812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8087911Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8087953Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8088119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8088159Z return func(*args, **kwargs) 2025-09-07T07:33:27.8088197Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8088377Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8088461Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8088463Z 2025-09-07T07:33:27.8088667Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8088671Z 2025-09-07T07:33:27.8088673Z 2025-09-07T07:33:27.8088748Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8088941Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8088943Z 2025-09-07T07:33:27.8089029Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8089102Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8089138Z inline_call [] 2025-09-07T07:33:27.8090513Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8090550Z inductor [] 2025-09-07T07:33:27.8090623Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8090696Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8090971Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8091087Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8091138Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8091289Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8091388Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8091521Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8091640Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8091748Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8091794Z Traceback (most recent call last): 2025-09-07T07:33:27.8091955Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.8091991Z self._run_test( 2025-09-07T07:33:27.8092103Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8092158Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8092200Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8092331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8092378Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8092416Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8094081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8094133Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8094201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8094338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8094385Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8094423Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8094567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8094649Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8094688Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8094841Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8094886Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8095036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8095092Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8095133Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8095272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8095325Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8095365Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8095481Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8095546Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8095590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8095715Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8095795Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8097184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8097326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8097370Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8097408Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8097546Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8097607Z return aot_autograd( 2025-09-07T07:33:27.8097642Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8097777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8097845Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8097892Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8098072Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8098157Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8098203Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8098384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8098428Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8098613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8098653Z fx_g = _create_graph( 2025-09-07T07:33:27.8098688Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8098850Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8098900Z fx_g = make_fx( 2025-09-07T07:33:27.8098934Z ^^^^^^^^ 2025-09-07T07:33:27.8099086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8100466Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8100505Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8100653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8100697Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8100735Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8100891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8100929Z t = dispatch_trace( 2025-09-07T07:33:27.8100963Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8101077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8101120Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8101157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8101282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8101323Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8101359Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8101521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8101598Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8101640Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8101763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8101803Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8101854Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8101982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8103426Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8103464Z ^^^^^^^^^ 2025-09-07T07:33:27.8103598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8103665Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8103701Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8103848Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8103897Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8103931Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8104087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8104149Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8104214Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8104388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8104428Z outs_pair = fn(*args) 2025-09-07T07:33:27.8104462Z ^^^^^^^^^ 2025-09-07T07:33:27.8104634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8104701Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8104748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8104922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8104961Z outs_pair = fn(*args) 2025-09-07T07:33:27.8105016Z ^^^^^^^^^ 2025-09-07T07:33:27.8105193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8105252Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8106632Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8106828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8106899Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8106945Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8107116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8107154Z outs_pair = fn(*args) 2025-09-07T07:33:27.8107190Z ^^^^^^^^^ 2025-09-07T07:33:27.8107380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8107426Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8107463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8107630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8107676Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8107713Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8107838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8107881Z return handle_torch_function( 2025-09-07T07:33:27.8107917Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8108088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8108167Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8108213Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8108380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8108420Z return func(*args, **kwargs) 2025-09-07T07:33:27.8109794Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8109919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8109962Z result = _engine_run_backward( 2025-09-07T07:33:27.8109998Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8110143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8110263Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8110333Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8110459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8110501Z return user_fn(self, *args) 2025-09-07T07:33:27.8110537Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8110681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8110724Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8110761Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8110917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8110962Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8110997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8111157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8111196Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8111232Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8111399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8111451Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8111493Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8112939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8112991Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8113030Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8113245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8113293Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8113335Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8113492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8113531Z t = dispatch_trace( 2025-09-07T07:33:27.8113565Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8113679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8113722Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8113758Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8113881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8113920Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8113955Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8114144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8114225Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8114266Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8114389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8114428Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8114481Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8115934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8115978Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8116014Z ^^^^^^^^^ 2025-09-07T07:33:27.8116166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8116216Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8116252Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8116294Z File "", line 1, in 2025-09-07T07:33:27.8116459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8116538Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8116584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8116720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8116767Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8116806Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8116996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8117039Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8117095Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8117265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8117310Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8117347Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8117490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8117533Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8117570Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8119045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8119135Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8119181Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8119312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8119373Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8119418Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8119542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8119582Z leaves = list(leaves) 2025-09-07T07:33:27.8119617Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8119740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8119775Z return func(x) 2025-09-07T07:33:27.8119807Z ^^^^^^^ 2025-09-07T07:33:27.8119944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8120009Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8120070Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8120237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8120280Z return func(*args, **kwargs) 2025-09-07T07:33:27.8120315Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8120495Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8120596Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8120599Z 2025-09-07T07:33:27.8120804Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8120807Z 2025-09-07T07:33:27.8120808Z 2025-09-07T07:33:27.8122198Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8122413Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8122417Z 2025-09-07T07:33:27.8122503Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8122576Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8122612Z inline_call [] 2025-09-07T07:33:27.8122670Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8122704Z inductor [] 2025-09-07T07:33:27.8122779Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8122850Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8123180Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8123319Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8123372Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8123521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8123608Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8123739Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8123858Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8123928Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8123964Z inline_call [] 2025-09-07T07:33:27.8124019Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8124092Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8124164Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8124415Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8125858Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8125912Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8126060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8126146Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8126275Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8126417Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8126470Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8126578Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8126622Z Traceback (most recent call last): 2025-09-07T07:33:27.8126868Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.8126919Z self._run_test( 2025-09-07T07:33:27.8127032Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8127086Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8127128Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8127259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8127307Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8127348Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8127515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8127562Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8127601Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8127736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8129117Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8129157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8129299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8129380Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8129419Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8129590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8129635Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8129785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8129839Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8129881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8130022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8130073Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8130111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8130227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8130293Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8130340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8130466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8130530Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8130571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8130710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8130755Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8130793Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8132244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8132286Z return aot_autograd( 2025-09-07T07:33:27.8132321Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8132480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8132554Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8132600Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8132759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8132856Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8132901Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8133139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8133183Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8133369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8133409Z fx_g = _create_graph( 2025-09-07T07:33:27.8133467Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8133629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8133663Z fx_g = make_fx( 2025-09-07T07:33:27.8133697Z ^^^^^^^^ 2025-09-07T07:33:27.8133846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8133894Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8133932Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8134078Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8134121Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8135482Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8135641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8135707Z t = dispatch_trace( 2025-09-07T07:33:27.8135741Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8135854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8135895Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8135933Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8136059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8136100Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8136135Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8136295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8136372Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8136416Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8136541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8136581Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8136615Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8136740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8136784Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8136818Z ^^^^^^^^^ 2025-09-07T07:33:27.8136950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8136991Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8138334Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8138484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8138559Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8138594Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8138751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8138812Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8138857Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8139046Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8139086Z outs_pair = fn(*args) 2025-09-07T07:33:27.8139120Z ^^^^^^^^^ 2025-09-07T07:33:27.8139290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8139355Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8139402Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8139586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8139626Z outs_pair = fn(*args) 2025-09-07T07:33:27.8139660Z ^^^^^^^^^ 2025-09-07T07:33:27.8139838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8139899Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8139942Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8140136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8140206Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8140253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8141753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8141793Z outs_pair = fn(*args) 2025-09-07T07:33:27.8141828Z ^^^^^^^^^ 2025-09-07T07:33:27.8142015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8142063Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8142100Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8142268Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8142313Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8142352Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8142478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8142522Z return handle_torch_function( 2025-09-07T07:33:27.8142559Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8142699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8142774Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8142821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8142989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8143029Z return func(*args, **kwargs) 2025-09-07T07:33:27.8143122Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8143247Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8143290Z result = _engine_run_backward( 2025-09-07T07:33:27.8143357Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8144821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8144943Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8144993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8145141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8145183Z return user_fn(self, *args) 2025-09-07T07:33:27.8145219Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8145364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8145407Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8145444Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8145621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8145667Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8145703Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8145825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8145866Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8145902Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8146065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8146116Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8146156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8146293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8146360Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8146400Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8146561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8147922Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8147962Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8148121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8148161Z t = dispatch_trace( 2025-09-07T07:33:27.8148195Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8148308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8148351Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8148388Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8148513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8148554Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8148589Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8148749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8148826Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8148868Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8148991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8149030Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8149065Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8149190Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8149232Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8149284Z ^^^^^^^^^ 2025-09-07T07:33:27.8149434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8150782Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8150818Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8150862Z File "", line 1, in 2025-09-07T07:33:27.8151006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8151101Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8151148Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8151284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8151332Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8151371Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8151582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8151625Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8151662Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8151830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8151875Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8151912Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8152055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8152097Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8152133Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8152266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8152382Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8152428Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8152552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8153989Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8154037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8154162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8154201Z leaves = list(leaves) 2025-09-07T07:33:27.8154236Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8154360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8154395Z return func(x) 2025-09-07T07:33:27.8154431Z ^^^^^^^ 2025-09-07T07:33:27.8154567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8154631Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8154674Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8154840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8154882Z return func(*args, **kwargs) 2025-09-07T07:33:27.8154917Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8155097Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8155181Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8155182Z 2025-09-07T07:33:27.8155407Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8155410Z 2025-09-07T07:33:27.8155412Z 2025-09-07T07:33:27.8155486Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8155679Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8155696Z 2025-09-07T07:33:27.8155782Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8155856Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8157205Z inline_call [] 2025-09-07T07:33:27.8157264Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8157299Z inductor [] 2025-09-07T07:33:27.8157372Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8157445Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8157722Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8157837Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8157889Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8158039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8158126Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8158257Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8158376Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8158461Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8158498Z inline_call [] 2025-09-07T07:33:27.8158553Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8158626Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8158695Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8158947Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8159059Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8159109Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8159256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8159343Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8160778Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8160899Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8160970Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8161006Z inline_call [] 2025-09-07T07:33:27.8161063Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8161135Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8161204Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8161456Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8161585Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8161635Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8161782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8161867Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8162014Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8162132Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8162346Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-616953c76b974522.xml - 2025-09-07T07:33:27.8162404Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8162772Z FAILED [0.7162s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8162857Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8162859Z 2025-09-07T07:33:27.8163116Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8163119Z 2025-09-07T07:33:27.8163120Z 2025-09-07T07:33:27.8163194Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8163389Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8163391Z 2025-09-07T07:33:27.8164836Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8164901Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8164967Z ================== 1 failed, 220 deselected, 2 rerun in 3.10s ================== 2025-09-07T07:33:27.8165002Z Got exit code 1 2025-09-07T07:33:27.8165042Z Retrying single test... 2025-09-07T07:33:27.8165465Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8165506Z import pkg_resources 2025-09-07T07:33:27.8165675Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-fca2d0fd5b20202c.xml 2025-09-07T07:33:27.8165731Z ============================= test session starts ============================== 2025-09-07T07:33:27.8165845Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8165885Z cachedir: .pytest_cache 2025-09-07T07:33:27.8166042Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8166087Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8166127Z configfile: pytest.ini 2025-09-07T07:33:27.8166288Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8166362Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.8166592Z stepcurrent: skipping 64 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8166662Z Running 1 items in this shard 2025-09-07T07:33:27.8166665Z 2025-09-07T07:33:27.8166928Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.2917s] [100%] 2025-09-07T07:33:27.8167117Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.8710s] [100%] 2025-09-07T07:33:27.8167298Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True FAILED [0.8051s] [100%] 2025-09-07T07:33:27.8167300Z 2025-09-07T07:33:27.8168677Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8168790Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8168834Z Traceback (most recent call last): 2025-09-07T07:33:27.8168987Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.8169042Z self._run_test( 2025-09-07T07:33:27.8169157Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8169212Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8169254Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8169388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8169436Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8169476Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8169626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8169672Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8169712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8169849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8169909Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8169946Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8170089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8170170Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8170211Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8170363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8170410Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8171898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8171954Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8171997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8172141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8172192Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8172232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8172348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8172417Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8172462Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8172587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8172651Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8172692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8172855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8172901Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8172939Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8173151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8173213Z return aot_autograd( 2025-09-07T07:33:27.8173248Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8173383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8173453Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8173502Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8173663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8175104Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8175152Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8175336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8175379Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8175566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8175606Z fx_g = _create_graph( 2025-09-07T07:33:27.8175642Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8175804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8175839Z fx_g = make_fx( 2025-09-07T07:33:27.8175872Z ^^^^^^^^ 2025-09-07T07:33:27.8176042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8176089Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8176129Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8176275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8176320Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8176356Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8176515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8176553Z t = dispatch_trace( 2025-09-07T07:33:27.8176587Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8176701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8176742Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8178093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8178224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8178266Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8178302Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8178464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8178544Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8178587Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8178710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8178750Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8178785Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8178934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8178979Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8179014Z ^^^^^^^^^ 2025-09-07T07:33:27.8179147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8179188Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8179223Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8179386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8179436Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8179471Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8179627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8179689Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8179735Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8181394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8181436Z outs_pair = fn(*args) 2025-09-07T07:33:27.8181471Z ^^^^^^^^^ 2025-09-07T07:33:27.8181642Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8181710Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8181754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8181929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8181968Z outs_pair = fn(*args) 2025-09-07T07:33:27.8182002Z ^^^^^^^^^ 2025-09-07T07:33:27.8182178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8182253Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8182298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8182489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8182562Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8182607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8182781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8182819Z outs_pair = fn(*args) 2025-09-07T07:33:27.8182854Z ^^^^^^^^^ 2025-09-07T07:33:27.8183043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8183152Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8183189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8184679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8184728Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8184768Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8184893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8184936Z return handle_torch_function( 2025-09-07T07:33:27.8184972Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8185114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8185221Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8185271Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8185440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8185481Z return func(*args, **kwargs) 2025-09-07T07:33:27.8185517Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8185639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8185705Z result = _engine_run_backward( 2025-09-07T07:33:27.8185741Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8185886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8186008Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8186059Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8186203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8186247Z return user_fn(self, *args) 2025-09-07T07:33:27.8186283Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8186426Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8187773Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8187812Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8187969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8188014Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8188050Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8188175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8188236Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8188273Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8188439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8188491Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8188531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8188669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8188718Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8188758Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8188917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8188966Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8189006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8189165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8189203Z t = dispatch_trace( 2025-09-07T07:33:27.8189239Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8189351Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8190713Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8190752Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8190877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8190916Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8190951Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8191112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8191209Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8191253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8191376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8191416Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8191451Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8191577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8191634Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8191669Z ^^^^^^^^^ 2025-09-07T07:33:27.8191817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8191867Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8191900Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8191943Z File "", line 1, in 2025-09-07T07:33:27.8192099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8192179Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8192224Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8192359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8193787Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8193828Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8194020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8194064Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8194100Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8194272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8194344Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8194382Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8194523Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8194566Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8194604Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8194736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8194824Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8194871Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8194996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8195058Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8195104Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8195229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8195268Z leaves = list(leaves) 2025-09-07T07:33:27.8195302Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8195424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8195460Z return func(x) 2025-09-07T07:33:27.8196802Z ^^^^^^^ 2025-09-07T07:33:27.8196940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8197005Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8197046Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8197236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8197280Z return func(*args, **kwargs) 2025-09-07T07:33:27.8197317Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8197497Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8197582Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8197608Z 2025-09-07T07:33:27.8197813Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8197815Z 2025-09-07T07:33:27.8197817Z 2025-09-07T07:33:27.8197891Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8198085Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8198088Z 2025-09-07T07:33:27.8198192Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8198266Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8198302Z inline_call [] 2025-09-07T07:33:27.8198358Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8198393Z inductor [] 2025-09-07T07:33:27.8198467Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8198540Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8198795Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8198910Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8200286Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8200440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8200529Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8200660Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8200779Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8200888Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8200932Z Traceback (most recent call last): 2025-09-07T07:33:27.8201081Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.8201116Z self._run_test( 2025-09-07T07:33:27.8201229Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8201284Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8201326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8201457Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8201503Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8201544Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8201692Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8201739Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8201777Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8201914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8201958Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8202013Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8202156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8203786Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8203826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8203979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8204044Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8204194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8204248Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8204288Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8204430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8204500Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8204539Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8204656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8204722Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8204768Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8204893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8204957Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8204999Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8205138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8205199Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8205238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8205376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8205416Z return aot_autograd( 2025-09-07T07:33:27.8206924Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8207064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8207134Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8207182Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8207341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8207424Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8207471Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8207654Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8207697Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8207881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8207923Z fx_g = _create_graph( 2025-09-07T07:33:27.8207958Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8208120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8208154Z fx_g = make_fx( 2025-09-07T07:33:27.8208188Z ^^^^^^^^ 2025-09-07T07:33:27.8208338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8208406Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8208446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8208593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8208636Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8208673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8208831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8210202Z t = dispatch_trace( 2025-09-07T07:33:27.8210238Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8210353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8210395Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8210432Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8210557Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8210598Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8210651Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8210812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8210891Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8210934Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8211060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8211098Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8211134Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8211259Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8211302Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8211336Z ^^^^^^^^^ 2025-09-07T07:33:27.8211484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8211525Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8211561Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8211708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8213144Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8213181Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8213340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8213401Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8213446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8213623Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8213664Z outs_pair = fn(*args) 2025-09-07T07:33:27.8213699Z ^^^^^^^^^ 2025-09-07T07:33:27.8213871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8213937Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8213982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8214154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8214193Z outs_pair = fn(*args) 2025-09-07T07:33:27.8214227Z ^^^^^^^^^ 2025-09-07T07:33:27.8214403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8214490Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8214535Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8214729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8214799Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8214846Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8215036Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8215075Z outs_pair = fn(*args) 2025-09-07T07:33:27.8216439Z ^^^^^^^^^ 2025-09-07T07:33:27.8216630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8216676Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8216715Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8216908Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8216957Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8216995Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8217121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8217165Z return handle_torch_function( 2025-09-07T07:33:27.8217202Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8217342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8217417Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8217462Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8217630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8217692Z return func(*args, **kwargs) 2025-09-07T07:33:27.8217729Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8217850Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8217893Z result = _engine_run_backward( 2025-09-07T07:33:27.8217930Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8218075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8218194Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8219556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8219685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8219729Z return user_fn(self, *args) 2025-09-07T07:33:27.8219767Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8219911Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8219954Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8219992Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8220149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8220196Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8220232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8220356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8220396Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8220431Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8220615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8220668Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8220709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8220843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8220908Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8220946Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8221107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8221154Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8221193Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8222661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8222703Z t = dispatch_trace( 2025-09-07T07:33:27.8222756Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8222873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8222916Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8222954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8223138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8223179Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8223214Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8223374Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8223453Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8223495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8223654Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8223693Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8223729Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8223854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8223897Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8223932Z ^^^^^^^^^ 2025-09-07T07:33:27.8224081Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8224130Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8224165Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8224207Z File "", line 1, in 2025-09-07T07:33:27.8225675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8225757Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8225806Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8225940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8225988Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8226026Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8226218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8226261Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8226298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8226467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8226512Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8226573Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8226717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8226759Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8226795Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8226928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8227033Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8227079Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8227206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8227266Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8227310Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8228768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8228811Z leaves = list(leaves) 2025-09-07T07:33:27.8228845Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8228968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8229003Z return func(x) 2025-09-07T07:33:27.8229037Z ^^^^^^^ 2025-09-07T07:33:27.8229176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8229240Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8229283Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8229448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8229490Z return func(*args, **kwargs) 2025-09-07T07:33:27.8229540Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8229722Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8229806Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8229809Z 2025-09-07T07:33:27.8230015Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8230018Z 2025-09-07T07:33:27.8230020Z 2025-09-07T07:33:27.8230092Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8230286Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8230288Z 2025-09-07T07:33:27.8230372Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8230448Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8230483Z inline_call [] 2025-09-07T07:33:27.8230540Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8230574Z inductor [] 2025-09-07T07:33:27.8231974Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8232047Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8232304Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8232416Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8232468Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8232634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8232723Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8232854Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8232973Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8233044Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8233145Z inline_call [] 2025-09-07T07:33:27.8233200Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8233273Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8233343Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8233595Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8233729Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8233780Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8233928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8234013Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8234143Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8234262Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8235638Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8235749Z _ WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8235814Z Traceback (most recent call last): 2025-09-07T07:33:27.8235965Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1489, in test_while_loop_with_sym_expr_cond 2025-09-07T07:33:27.8236000Z self._run_test( 2025-09-07T07:33:27.8236113Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8236168Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8236211Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8236343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8236390Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8236429Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8236579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8236627Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8236667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8236804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8236848Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8236887Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8237030Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8237114Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8237152Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8237303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8237348Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8238837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8238895Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8238937Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8239079Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8239132Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8239189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8239305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8239370Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8239415Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8239540Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8239605Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8239662Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8239802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8239847Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8239885Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8240024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8240064Z return aot_autograd( 2025-09-07T07:33:27.8240099Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8240234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8240304Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8240351Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8241846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8241932Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8241978Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8242160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8242204Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8242391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8242431Z fx_g = _create_graph( 2025-09-07T07:33:27.8242466Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8242631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8242666Z fx_g = make_fx( 2025-09-07T07:33:27.8242701Z ^^^^^^^^ 2025-09-07T07:33:27.8242851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8242898Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8242936Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8243138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8243181Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8243218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8243376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8243415Z t = dispatch_trace( 2025-09-07T07:33:27.8243449Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8243587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8243632Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8245008Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8245135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8245175Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8245211Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8245395Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8245473Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8245515Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8245638Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8245677Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8245715Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8245878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8245922Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8245956Z ^^^^^^^^^ 2025-09-07T07:33:27.8246089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8246130Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8246166Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8246312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8246362Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8246396Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8246552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8246632Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8248080Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8248257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8248297Z outs_pair = fn(*args) 2025-09-07T07:33:27.8248332Z ^^^^^^^^^ 2025-09-07T07:33:27.8248506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8248572Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8248618Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8248790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8248829Z outs_pair = fn(*args) 2025-09-07T07:33:27.8248865Z ^^^^^^^^^ 2025-09-07T07:33:27.8249044Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8249104Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8249147Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8249338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8249409Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8249455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8249626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8249664Z outs_pair = fn(*args) 2025-09-07T07:33:27.8249719Z ^^^^^^^^^ 2025-09-07T07:33:27.8249911Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8249956Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8249994Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8251467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8251534Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8251571Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8251696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8251738Z return handle_torch_function( 2025-09-07T07:33:27.8251776Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8251919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8252009Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8252055Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8252224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8252266Z return func(*args, **kwargs) 2025-09-07T07:33:27.8252302Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8252423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8252466Z result = _engine_run_backward( 2025-09-07T07:33:27.8252502Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8252646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8252766Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8252832Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8252956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8252998Z return user_fn(self, *args) 2025-09-07T07:33:27.8253034Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8254708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8254753Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8254791Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8254947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8254991Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8255028Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8255153Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8255193Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8255229Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8255396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8255448Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8255490Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8255625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8255675Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8255713Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8255900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8255950Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8255990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8256147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8256185Z t = dispatch_trace( 2025-09-07T07:33:27.8256219Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8256353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8257735Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8257774Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8257898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8257938Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8257973Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8258155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8258235Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8258277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8258398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8258439Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8258473Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8258598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8258641Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8258676Z ^^^^^^^^^ 2025-09-07T07:33:27.8258824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8258873Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8258929Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8258972Z File "", line 1, in 2025-09-07T07:33:27.8259114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8259192Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8259238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8259377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8260731Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8260770Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8260962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8261005Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8261043Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8261213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8261258Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8261294Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8261438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8261482Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8261518Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8261653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8261742Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8261789Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8261935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8261996Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8262039Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8262165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8262222Z leaves = list(leaves) 2025-09-07T07:33:27.8262257Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8262379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8263827Z return func(x) 2025-09-07T07:33:27.8263862Z ^^^^^^^ 2025-09-07T07:33:27.8264001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8264066Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8264112Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8264311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8264354Z return func(*args, **kwargs) 2025-09-07T07:33:27.8264390Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8264569Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8264655Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8264657Z 2025-09-07T07:33:27.8264863Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8264865Z 2025-09-07T07:33:27.8264867Z 2025-09-07T07:33:27.8264940Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8265155Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8265157Z 2025-09-07T07:33:27.8265242Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8265315Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8265351Z inline_call [] 2025-09-07T07:33:27.8265408Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8265442Z inductor [] 2025-09-07T07:33:27.8265516Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8265587Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8265843Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8265959Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8267338Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8267488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8267575Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8267707Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8267828Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8267898Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8267934Z inline_call [] 2025-09-07T07:33:27.8267990Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8268084Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8268156Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8268408Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8268519Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8268597Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8268745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8268830Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8268960Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8269079Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8269160Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8269196Z inline_call [] 2025-09-07T07:33:27.8269251Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8269323Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8270701Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8270956Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8271067Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1037, in forward 2025-09-07T07:33:27.8271117Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8271265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8271367Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8271495Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8271612Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8271829Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-fca2d0fd5b20202c.xml - 2025-09-07T07:33:27.8271888Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8272244Z FAILED [0.8051s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8272332Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8272334Z 2025-09-07T07:33:27.8272539Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8272541Z 2025-09-07T07:33:27.8272543Z 2025-09-07T07:33:27.8272616Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8272809Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8272811Z 2025-09-07T07:33:27.8272895Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8272955Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8273036Z ================== 1 failed, 220 deselected, 2 rerun in 3.19s ================== 2025-09-07T07:33:27.8273162Z Got exit code 1 2025-09-07T07:33:27.8273287Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.8273708Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8275283Z import pkg_resources 2025-09-07T07:33:27.8275453Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-62b287dd2cdd2240.xml 2025-09-07T07:33:27.8275510Z ============================= test session starts ============================== 2025-09-07T07:33:27.8275622Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8275664Z cachedir: .pytest_cache 2025-09-07T07:33:27.8275842Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8275888Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8275927Z configfile: pytest.ini 2025-09-07T07:33:27.8276087Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8276162Z collecting ... collected 467 items / 65 deselected / 402 selected 2025-09-07T07:33:27.8276214Z stepcurrent: skipping 65 already run items. 2025-09-07T07:33:27.8276255Z Running 156 items in this shard 2025-09-07T07:33:27.8276258Z 2025-09-07T07:33:27.8276444Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cpu_dynamic_True_autograd_False PASSED [2.7592s] [ 0%] 2025-09-07T07:33:27.8276628Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_False PASSED [0.9575s] [ 1%] 2025-09-07T07:33:27.8276856Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2651s] [ 1%] 2025-09-07T07:33:27.8277061Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2345s] [ 1%] 2025-09-07T07:33:27.8277244Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True FAILED [0.2330s] [ 1%] 2025-09-07T07:33:27.8277246Z 2025-09-07T07:33:27.8277295Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8277419Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8277463Z Traceback (most recent call last): 2025-09-07T07:33:27.8277628Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8277663Z self._run_test( 2025-09-07T07:33:27.8279090Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8279147Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8279189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8279325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8279372Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8279411Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8279563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8279608Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8279669Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8279807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8279853Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8279890Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8280033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8280129Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8280169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8280320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8280367Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8280516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8280572Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8280626Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8280768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8282134Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8282175Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8282292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8282359Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8282403Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8282528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8282592Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8282653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8282796Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8282841Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8282880Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8283017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8283106Z return aot_autograd( 2025-09-07T07:33:27.8283142Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8283277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8283346Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8283392Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8283554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8283639Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8283684Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8283865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8283910Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8285421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8285463Z fx_g = _create_graph( 2025-09-07T07:33:27.8285499Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8285662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8285718Z fx_g = make_fx( 2025-09-07T07:33:27.8285752Z ^^^^^^^^ 2025-09-07T07:33:27.8285903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8285950Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8285989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8286134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8286192Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8286229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8286387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8286426Z t = dispatch_trace( 2025-09-07T07:33:27.8286460Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8286574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8286616Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8286667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8286888Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8286929Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8286966Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8288456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8288539Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8288581Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8288704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8288743Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8288778Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8288922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8288965Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8289001Z ^^^^^^^^^ 2025-09-07T07:33:27.8289133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8289174Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8289211Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8289358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8289408Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8289442Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8289601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8289665Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8289712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8289885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8289925Z outs_pair = fn(*args) 2025-09-07T07:33:27.8289959Z ^^^^^^^^^ 2025-09-07T07:33:27.8290129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8291505Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8291551Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8291723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8291762Z outs_pair = fn(*args) 2025-09-07T07:33:27.8291796Z ^^^^^^^^^ 2025-09-07T07:33:27.8292005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8292066Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8292109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8292301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8292386Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8292432Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8292603Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8292641Z outs_pair = fn(*args) 2025-09-07T07:33:27.8292676Z ^^^^^^^^^ 2025-09-07T07:33:27.8292885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8292933Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8292970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8293230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8293277Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8293314Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8293439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8294823Z return handle_torch_function( 2025-09-07T07:33:27.8294861Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8295003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8295108Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8295155Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8295322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8295365Z return func(*args, **kwargs) 2025-09-07T07:33:27.8295402Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8295524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8295566Z result = _engine_run_backward( 2025-09-07T07:33:27.8295602Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8295749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8295870Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8295922Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8296047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8296090Z return user_fn(self, *args) 2025-09-07T07:33:27.8296126Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8296270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8296313Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8296351Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8296509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8296554Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8297914Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8298062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8298103Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8298139Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8298303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8298356Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8298414Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8298549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8298598Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8298638Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8298797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8298847Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8298903Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8299061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8299100Z t = dispatch_trace( 2025-09-07T07:33:27.8299134Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8299247Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8299290Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8299330Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8299453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8299493Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8299528Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8300997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8301092Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8301134Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8301257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8301297Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8301333Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8301460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8301502Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8301537Z ^^^^^^^^^ 2025-09-07T07:33:27.8301687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8301736Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8301770Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8301814Z File "", line 1, in 2025-09-07T07:33:27.8301959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8302038Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8302084Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8302221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8302268Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8302306Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8302497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8302540Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8303985Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8304162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8304206Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8304244Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8304386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8304450Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8304488Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8304621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8304710Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8304756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8304883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8304965Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8305010Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8305135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8305174Z leaves = list(leaves) 2025-09-07T07:33:27.8305210Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8305333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8305368Z return func(x) 2025-09-07T07:33:27.8305402Z ^^^^^^^ 2025-09-07T07:33:27.8305539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8305604Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8305647Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8307167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8307210Z return func(*args, **kwargs) 2025-09-07T07:33:27.8307247Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8307427Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8307515Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8307517Z 2025-09-07T07:33:27.8307722Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8307724Z 2025-09-07T07:33:27.8307726Z 2025-09-07T07:33:27.8307801Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8308011Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8308014Z 2025-09-07T07:33:27.8308099Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8308172Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8308207Z inline_call [] 2025-09-07T07:33:27.8308264Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8308338Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8308409Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8308665Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8308797Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8308851Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8309000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8309086Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8309217Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8309351Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8310786Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8310833Z Traceback (most recent call last): 2025-09-07T07:33:27.8310995Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8311033Z self._run_test( 2025-09-07T07:33:27.8311165Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8311221Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8311262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8311396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8311445Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8311484Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8311634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8311679Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8311718Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8311854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8311920Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8311959Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8312102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8312182Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8312221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8312372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8312418Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8312566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8314033Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8314074Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8314222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8314273Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8314314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8314429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8314497Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8314542Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8314668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8314731Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8314773Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8314938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8314986Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8315023Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8315160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8315198Z return aot_autograd( 2025-09-07T07:33:27.8315233Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8315402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8315470Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8315516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8315676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8317083Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8317152Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8317335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8317378Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8317563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8317603Z fx_g = _create_graph( 2025-09-07T07:33:27.8317640Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8317803Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8317838Z fx_g = make_fx( 2025-09-07T07:33:27.8317871Z ^^^^^^^^ 2025-09-07T07:33:27.8318024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8318090Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8318129Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8318274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8318317Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8318353Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8318511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8318549Z t = dispatch_trace( 2025-09-07T07:33:27.8318584Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8318696Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8318738Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8318773Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8320203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8320244Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8320281Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8320440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8320519Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8320562Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8320686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8320725Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8320760Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8320886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8320927Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8320983Z ^^^^^^^^^ 2025-09-07T07:33:27.8321117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8321158Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8321194Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8321343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8321408Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8321443Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8321599Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8321662Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8321707Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8323250Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8323324Z outs_pair = fn(*args) 2025-09-07T07:33:27.8323361Z ^^^^^^^^^ 2025-09-07T07:33:27.8323531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8323598Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8323644Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8323818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8323856Z outs_pair = fn(*args) 2025-09-07T07:33:27.8323891Z ^^^^^^^^^ 2025-09-07T07:33:27.8324065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8324146Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8324189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8324381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8324452Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8324501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8324676Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8324714Z outs_pair = fn(*args) 2025-09-07T07:33:27.8324749Z ^^^^^^^^^ 2025-09-07T07:33:27.8324937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8324986Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8325023Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8325192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8326560Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8326600Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8326804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8326847Z return handle_torch_function( 2025-09-07T07:33:27.8326884Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8327025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8327099Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8327168Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8327336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8327379Z return func(*args, **kwargs) 2025-09-07T07:33:27.8327414Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8327538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8327599Z result = _engine_run_backward( 2025-09-07T07:33:27.8327636Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8327780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8327900Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8327951Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8328095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8328137Z return user_fn(self, *args) 2025-09-07T07:33:27.8328174Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8328317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8329678Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8329719Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8329877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8329921Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8329958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8330080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8330119Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8330176Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8330341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8330394Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8330434Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8330569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8330620Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8330659Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8330818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8330866Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8330904Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8331062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8331101Z t = dispatch_trace( 2025-09-07T07:33:27.8331136Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8331249Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8331292Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8332635Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8332762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8332801Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8332836Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8332996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8333161Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8333232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8333357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8333395Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8333430Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8333555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8333615Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8333650Z ^^^^^^^^^ 2025-09-07T07:33:27.8333798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8333848Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8333882Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8333925Z File "", line 1, in 2025-09-07T07:33:27.8334069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8334172Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8334218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8334353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8334400Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8335770Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8335964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8336008Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8336044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8336215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8336281Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8336320Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8336462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8336505Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8336541Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8336678Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8336765Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8336812Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8336937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8336997Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8337042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8337168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8337207Z leaves = list(leaves) 2025-09-07T07:33:27.8337241Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8337363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8337399Z return func(x) 2025-09-07T07:33:27.8338741Z ^^^^^^^ 2025-09-07T07:33:27.8338880Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8338946Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8338987Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8339154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8339214Z return func(*args, **kwargs) 2025-09-07T07:33:27.8339253Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8339434Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8339521Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8339523Z 2025-09-07T07:33:27.8339742Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8339744Z 2025-09-07T07:33:27.8339746Z 2025-09-07T07:33:27.8339819Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8340027Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8340030Z 2025-09-07T07:33:27.8340118Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8340206Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8340242Z inline_call [] 2025-09-07T07:33:27.8340299Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8340373Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8340445Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8340701Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8340813Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8340865Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8341015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8342432Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8342563Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8342685Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8342758Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8342794Z inline_call [] 2025-09-07T07:33:27.8342850Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8342924Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8342992Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8343349Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8343462Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8343514Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8343661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8343749Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8343878Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8343996Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8344046Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8344190Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8344237Z Traceback (most recent call last): 2025-09-07T07:33:27.8344398Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8344433Z self._run_test( 2025-09-07T07:33:27.8344547Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8345946Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8345991Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8346123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8346170Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8346209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8346362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8346410Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8346470Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8346606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8346650Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8346688Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8346833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8346914Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8346952Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8347104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8347149Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8347320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8347373Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8347414Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8347554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8347608Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8347649Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8349085Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8349151Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8349196Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8349322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8349389Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8349430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8349571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8349616Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8349655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8349792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8349831Z return aot_autograd( 2025-09-07T07:33:27.8349866Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8350002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8350071Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8350135Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8350296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8350380Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8350425Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8350622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8350666Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8350853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8352201Z fx_g = _create_graph( 2025-09-07T07:33:27.8352239Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8352403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8352455Z fx_g = make_fx( 2025-09-07T07:33:27.8352490Z ^^^^^^^^ 2025-09-07T07:33:27.8352641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8352688Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8352727Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8352877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8352921Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8352958Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8353180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8353219Z t = dispatch_trace( 2025-09-07T07:33:27.8353253Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8353387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8353429Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8353466Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8353590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8353631Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8353668Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8353828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8353906Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8355271Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8355400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8355442Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8355477Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8355604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8355647Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8355681Z ^^^^^^^^^ 2025-09-07T07:33:27.8355812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8355854Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8355890Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8356037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8356086Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8356122Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8356304Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8356369Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8356414Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8356587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8356626Z outs_pair = fn(*args) 2025-09-07T07:33:27.8356686Z ^^^^^^^^^ 2025-09-07T07:33:27.8356857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8356923Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8358277Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8358452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8358493Z outs_pair = fn(*args) 2025-09-07T07:33:27.8358545Z ^^^^^^^^^ 2025-09-07T07:33:27.8358723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8358782Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8358825Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8359018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8359088Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8359134Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8359306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8359360Z outs_pair = fn(*args) 2025-09-07T07:33:27.8359396Z ^^^^^^^^^ 2025-09-07T07:33:27.8359585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8359631Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8359667Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8359836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8359882Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8359918Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8360043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8360085Z return handle_torch_function( 2025-09-07T07:33:27.8360123Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8361573Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8361650Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8361696Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8361863Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8361904Z return func(*args, **kwargs) 2025-09-07T07:33:27.8361941Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8362064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8362107Z result = _engine_run_backward( 2025-09-07T07:33:27.8362143Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8362288Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8362428Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8362482Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8362606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8362649Z return user_fn(self, *args) 2025-09-07T07:33:27.8362699Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8362845Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8362888Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8362926Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8363136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8363182Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8363219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8364684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8364726Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8364763Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8364926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8364980Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8365019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8365154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8365204Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8365243Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8365404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8365471Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8365512Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8365667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8365707Z t = dispatch_trace( 2025-09-07T07:33:27.8365743Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8365855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8365897Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8365935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8366058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8366097Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8366133Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8366295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8367746Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8367790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8367916Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8367956Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8367991Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8368120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8368162Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8368196Z ^^^^^^^^^ 2025-09-07T07:33:27.8368344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8368419Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8368456Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8368498Z File "", line 1, in 2025-09-07T07:33:27.8368639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8368717Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8368781Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8368916Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8368964Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8369002Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8369194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8369239Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8369289Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8369459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8370818Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8370856Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8371002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8371045Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8371082Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8371215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8371302Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8371350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8371493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8371553Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8371597Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8371722Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8371763Z leaves = list(leaves) 2025-09-07T07:33:27.8371798Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8371919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8371954Z return func(x) 2025-09-07T07:33:27.8371987Z ^^^^^^^ 2025-09-07T07:33:27.8372123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8372188Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8372232Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8372397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8373817Z return func(*args, **kwargs) 2025-09-07T07:33:27.8373855Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8374037Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8374121Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8374124Z 2025-09-07T07:33:27.8374330Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8374332Z 2025-09-07T07:33:27.8374334Z 2025-09-07T07:33:27.8374434Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8374645Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8374647Z 2025-09-07T07:33:27.8374733Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8374806Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8374859Z inline_call [] 2025-09-07T07:33:27.8374915Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8374988Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8375061Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8375316Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8375449Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8375500Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8375651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8375735Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8375868Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8375986Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8376057Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8376091Z inline_call [] 2025-09-07T07:33:27.8377469Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8377544Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8377636Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8377887Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8378001Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8378052Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8378200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8378284Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8378413Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8378532Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8378603Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8378637Z inline_call [] 2025-09-07T07:33:27.8378692Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8378764Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8378834Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8379084Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8379195Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8379245Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8379414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8379500Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8379628Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8381065Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8381301Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-62b287dd2cdd2240.xml - 2025-09-07T07:33:27.8381358Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8381734Z FAILED [0.2330s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8381833Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8381835Z 2025-09-07T07:33:27.8382040Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8382042Z 2025-09-07T07:33:27.8382045Z 2025-09-07T07:33:27.8382117Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8382326Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8382329Z 2025-09-07T07:33:27.8382413Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8382472Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8382557Z ============= 1 failed, 2 passed, 65 deselected, 2 rerun in 4.69s ============== 2025-09-07T07:33:27.8382594Z Got exit code 1 2025-09-07T07:33:27.8382632Z Retrying single test... 2025-09-07T07:33:27.8383052Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8383153Z import pkg_resources 2025-09-07T07:33:27.8383323Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-62cafe3a32f5056c.xml 2025-09-07T07:33:27.8383379Z ============================= test session starts ============================== 2025-09-07T07:33:27.8383491Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8383531Z cachedir: .pytest_cache 2025-09-07T07:33:27.8383688Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8383732Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8385099Z configfile: pytest.ini 2025-09-07T07:33:27.8385262Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8385341Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.8385584Z stepcurrent: skipping 67 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8385628Z Running 1 items in this shard 2025-09-07T07:33:27.8385630Z 2025-09-07T07:33:27.8385866Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5896s] [100%] 2025-09-07T07:33:27.8386075Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2357s] [100%] 2025-09-07T07:33:27.8386257Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True FAILED [0.2215s] [100%] 2025-09-07T07:33:27.8386280Z 2025-09-07T07:33:27.8386329Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8386453Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8386496Z Traceback (most recent call last): 2025-09-07T07:33:27.8386658Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8386694Z self._run_test( 2025-09-07T07:33:27.8386806Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8386883Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8386925Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8387059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8387105Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8387146Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8387300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8387347Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8387385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8388843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8388890Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8388951Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8389095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8389177Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8389215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8389368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8389415Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8389565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8389619Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8389660Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8389801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8389855Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8389894Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8390011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8390079Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8390126Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8390252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8390314Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8390357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8390496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8391887Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8391930Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8392068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8392107Z return aot_autograd( 2025-09-07T07:33:27.8392143Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8392277Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8392362Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8392408Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8392567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8392650Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8392697Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8392898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8392944Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8393199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8393241Z fx_g = _create_graph( 2025-09-07T07:33:27.8393276Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8393441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8393475Z fx_g = make_fx( 2025-09-07T07:33:27.8393509Z ^^^^^^^^ 2025-09-07T07:33:27.8393658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8393726Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8393766Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8395231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8395277Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8395315Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8395472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8395512Z t = dispatch_trace( 2025-09-07T07:33:27.8395546Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8395659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8395701Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8395736Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8395863Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8395905Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8395943Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8396102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8396183Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8396225Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8396350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8396389Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8396424Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8396549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8396591Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8396626Z ^^^^^^^^^ 2025-09-07T07:33:27.8398089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8398133Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8398169Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8398317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8398386Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8398420Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8398576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8398637Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8398682Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8398856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8398897Z outs_pair = fn(*args) 2025-09-07T07:33:27.8398949Z ^^^^^^^^^ 2025-09-07T07:33:27.8399119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8399186Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8399232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8399404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8399443Z outs_pair = fn(*args) 2025-09-07T07:33:27.8399478Z ^^^^^^^^^ 2025-09-07T07:33:27.8399652Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8399713Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8399779Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8399972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8401357Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8401405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8401586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8401625Z outs_pair = fn(*args) 2025-09-07T07:33:27.8401660Z ^^^^^^^^^ 2025-09-07T07:33:27.8401849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8401895Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8401935Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8402102Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8402150Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8402187Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8402312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8402355Z return handle_torch_function( 2025-09-07T07:33:27.8402393Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8402533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8402608Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8402653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8402837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8402880Z return func(*args, **kwargs) 2025-09-07T07:33:27.8402916Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8403038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8404442Z result = _engine_run_backward( 2025-09-07T07:33:27.8404508Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8404655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8404774Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8404826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8404953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8405014Z return user_fn(self, *args) 2025-09-07T07:33:27.8405051Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8405194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8405239Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8405276Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8405434Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8405478Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8405515Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8405637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8405678Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8405713Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8405901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8405952Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8405993Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8406128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8406179Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8407590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8407756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8407803Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8407843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8408000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8408040Z t = dispatch_trace( 2025-09-07T07:33:27.8408076Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8408189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8408232Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8408268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8408393Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8408432Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8408468Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8408626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8408705Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8408746Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8408896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8408935Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8408971Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8409095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8409137Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8409186Z ^^^^^^^^^ 2025-09-07T07:33:27.8410650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8410700Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8410734Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8410776Z File "", line 1, in 2025-09-07T07:33:27.8410918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8410998Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8411060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8411196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8411244Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8411282Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8411477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8411519Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8411555Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8411725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8411770Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8411821Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8411962Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8412006Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8412042Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8412174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8412263Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8413686Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8413816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8413877Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8413921Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8414049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8414088Z leaves = list(leaves) 2025-09-07T07:33:27.8414124Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8414245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8414281Z return func(x) 2025-09-07T07:33:27.8414315Z ^^^^^^^ 2025-09-07T07:33:27.8414453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8414517Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8414559Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8414725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8414768Z return func(*args, **kwargs) 2025-09-07T07:33:27.8414832Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8415015Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8415101Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8415103Z 2025-09-07T07:33:27.8415308Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8415330Z 2025-09-07T07:33:27.8415332Z 2025-09-07T07:33:27.8415405Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8415615Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8415617Z 2025-09-07T07:33:27.8415703Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8417117Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8417153Z inline_call [] 2025-09-07T07:33:27.8417210Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8417245Z inductor [] 2025-09-07T07:33:27.8417319Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8417391Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8417648Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8417761Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8417813Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8417964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8418069Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8418199Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8418322Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8418446Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8418490Z Traceback (most recent call last): 2025-09-07T07:33:27.8418650Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8418686Z self._run_test( 2025-09-07T07:33:27.8418797Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8418854Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8418895Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8419027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8420384Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8420426Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8420576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8420624Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8420663Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8420798Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8420843Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8420881Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8421041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8421125Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8421165Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8421319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8421379Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8421528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8421581Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8421621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8421763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8421815Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8421855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8421991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8422058Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8422103Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8423598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8423666Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8423709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8423848Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8423893Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8423931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8424096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8424135Z return aot_autograd( 2025-09-07T07:33:27.8424171Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8424307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8424376Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8424423Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8424582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8424666Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8424712Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8424896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8424942Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8425127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8425166Z fx_g = _create_graph( 2025-09-07T07:33:27.8425202Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8425365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8426719Z fx_g = make_fx( 2025-09-07T07:33:27.8426753Z ^^^^^^^^ 2025-09-07T07:33:27.8426905Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8426951Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8426990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8427159Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8427203Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8427240Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8427397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8427453Z t = dispatch_trace( 2025-09-07T07:33:27.8427488Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8427600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8427643Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8427678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8427803Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8427842Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8427881Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8428057Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8428135Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8428177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8428301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8428341Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8429687Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8429815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8429858Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8429893Z ^^^^^^^^^ 2025-09-07T07:33:27.8430024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8430086Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8430123Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8430272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8430321Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8430356Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8430512Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8430574Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8430618Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8430792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8430832Z outs_pair = fn(*args) 2025-09-07T07:33:27.8430867Z ^^^^^^^^^ 2025-09-07T07:33:27.8431039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8431107Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8431151Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8431323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8431362Z outs_pair = fn(*args) 2025-09-07T07:33:27.8432702Z ^^^^^^^^^ 2025-09-07T07:33:27.8432882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8432942Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8432985Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8433268Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8433338Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8433385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8433557Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8433615Z outs_pair = fn(*args) 2025-09-07T07:33:27.8433648Z ^^^^^^^^^ 2025-09-07T07:33:27.8433836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8433882Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8433919Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8434088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8434152Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8434191Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8434315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8434358Z return handle_torch_function( 2025-09-07T07:33:27.8434396Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8434536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8434610Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8434655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8436152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8436218Z return func(*args, **kwargs) 2025-09-07T07:33:27.8436255Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8436381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8436423Z result = _engine_run_backward( 2025-09-07T07:33:27.8436460Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8436606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8436726Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8436775Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8436901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8436942Z return user_fn(self, *args) 2025-09-07T07:33:27.8436981Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8437125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8437169Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8437206Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8437362Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8437407Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8437443Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8437566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8437605Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8437642Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8437804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8439199Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8439241Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8439377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8439426Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8439466Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8439644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8439692Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8439731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8439890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8439928Z t = dispatch_trace( 2025-09-07T07:33:27.8439964Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8440094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8440139Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8440175Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8440299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8440339Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8440374Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8440532Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8440611Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8440653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8440775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8442141Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8442178Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8442305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8442348Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8442382Z ^^^^^^^^^ 2025-09-07T07:33:27.8442530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8442581Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8442615Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8442658Z File "", line 1, in 2025-09-07T07:33:27.8442800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8442881Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8442928Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8443154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8443202Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8443241Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8443430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8443475Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8443510Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8443679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8443723Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8443761Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8443926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8445296Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8445334Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8445469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8445556Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8445641Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8445766Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8445827Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8445869Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8445995Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8446035Z leaves = list(leaves) 2025-09-07T07:33:27.8446092Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8446218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8446253Z return func(x) 2025-09-07T07:33:27.8446287Z ^^^^^^^ 2025-09-07T07:33:27.8446423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8446489Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8446530Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8446751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8446792Z return func(*args, **kwargs) 2025-09-07T07:33:27.8446828Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8447009Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8448437Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8448440Z 2025-09-07T07:33:27.8448649Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8448652Z 2025-09-07T07:33:27.8448655Z 2025-09-07T07:33:27.8448729Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8448936Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8448940Z 2025-09-07T07:33:27.8449025Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8449099Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8449136Z inline_call [] 2025-09-07T07:33:27.8449193Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8449228Z inductor [] 2025-09-07T07:33:27.8449301Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8449374Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8449628Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8449743Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8449795Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8449946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8450048Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8450183Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8450301Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8450372Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8450407Z inline_call [] 2025-09-07T07:33:27.8450477Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8450549Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8451932Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8452189Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8452303Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8452372Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8452522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8452606Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8452737Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8452855Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8452906Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8453028Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8453155Z Traceback (most recent call last): 2025-09-07T07:33:27.8453318Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8453375Z self._run_test( 2025-09-07T07:33:27.8453487Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8453543Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8453584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8453717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8453763Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8453802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8453953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8453999Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8455369Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8455509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8455554Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8455591Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8455734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8455815Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8455855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8456005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8456052Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8456200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8456278Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8456322Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8456466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8456518Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8456558Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8456692Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8456758Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8456802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8456928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8456990Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8457034Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8457190Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8458553Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8458592Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8458729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8458770Z return aot_autograd( 2025-09-07T07:33:27.8458805Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8458940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8459009Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8459055Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8459216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8459674Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8459720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8459906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8459951Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8460136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8460176Z fx_g = _create_graph( 2025-09-07T07:33:27.8460212Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8460373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8460408Z fx_g = make_fx( 2025-09-07T07:33:27.8460443Z ^^^^^^^^ 2025-09-07T07:33:27.8460595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8460641Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8461995Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8462143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8462189Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8462226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8462384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8462422Z t = dispatch_trace( 2025-09-07T07:33:27.8462457Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8462568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8462630Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8462668Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8462794Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8462834Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8462870Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8463029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8463203Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8463245Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8463368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8463407Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8463442Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8463568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8463632Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8463668Z ^^^^^^^^^ 2025-09-07T07:33:27.8465129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8465173Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8465208Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8465358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8465407Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8465442Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8465598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8465661Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8465728Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8465903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8465943Z outs_pair = fn(*args) 2025-09-07T07:33:27.8465978Z ^^^^^^^^^ 2025-09-07T07:33:27.8466147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8466215Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8466259Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8466432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8466470Z outs_pair = fn(*args) 2025-09-07T07:33:27.8466505Z ^^^^^^^^^ 2025-09-07T07:33:27.8466681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8466742Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8466785Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8468285Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8468358Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8468405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8468578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8468616Z outs_pair = fn(*args) 2025-09-07T07:33:27.8468650Z ^^^^^^^^^ 2025-09-07T07:33:27.8468871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8468917Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8468954Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8469121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8469185Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8469222Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8469347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8469390Z return handle_torch_function( 2025-09-07T07:33:27.8469426Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8469567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8469643Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8469705Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8469873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8469915Z return func(*args, **kwargs) 2025-09-07T07:33:27.8469950Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8470075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8471430Z result = _engine_run_backward( 2025-09-07T07:33:27.8471470Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8471615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8471735Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8471803Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8471929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8471970Z return user_fn(self, *args) 2025-09-07T07:33:27.8472007Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8472150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8472196Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8472233Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8472389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8472433Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8472469Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8472592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8472634Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8472671Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8472834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8472886Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8472927Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8473146Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8473195Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8474555Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8474717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8474808Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8474848Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8475007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8475045Z t = dispatch_trace( 2025-09-07T07:33:27.8475080Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8475192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8475253Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8475289Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8475412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8475451Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8475487Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8475647Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8475744Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8475786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8475910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8475948Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8475982Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8476111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8476153Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8477502Z ^^^^^^^^^ 2025-09-07T07:33:27.8477653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8477704Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8477738Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8477783Z File "", line 1, in 2025-09-07T07:33:27.8477951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8478031Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8478077Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8478213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8478261Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8478300Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8478490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8478534Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8478569Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8478742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8478786Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8478824Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8478966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8479010Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8479046Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8479179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8479267Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8480621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8480767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8480830Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8480874Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8481000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8481039Z leaves = list(leaves) 2025-09-07T07:33:27.8481074Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8481212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8481247Z return func(x) 2025-09-07T07:33:27.8481280Z ^^^^^^^ 2025-09-07T07:33:27.8481417Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8481482Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8481524Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8481706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8481748Z return func(*args, **kwargs) 2025-09-07T07:33:27.8481784Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8481965Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8482052Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8482054Z 2025-09-07T07:33:27.8482259Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8482261Z 2025-09-07T07:33:27.8482263Z 2025-09-07T07:33:27.8482336Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8482544Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8482559Z 2025-09-07T07:33:27.8484039Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8484118Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8484153Z inline_call [] 2025-09-07T07:33:27.8484210Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8484246Z inductor [] 2025-09-07T07:33:27.8484319Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8484393Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8484647Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8484761Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8484813Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8484965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8485051Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8485182Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8485301Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8485373Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8485407Z inline_call [] 2025-09-07T07:33:27.8485463Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8485535Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8485632Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8485886Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8485998Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8486048Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8487614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8487701Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8487831Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8487949Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8488022Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8488081Z inline_call [] 2025-09-07T07:33:27.8488138Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8488209Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8488279Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8488530Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8488641Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8488690Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8488837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8488945Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8489074Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8489191Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8489405Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-62cafe3a32f5056c.xml - 2025-09-07T07:33:27.8489464Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8489838Z FAILED [0.2215s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8489923Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8489926Z 2025-09-07T07:33:27.8490131Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8490133Z 2025-09-07T07:33:27.8490135Z 2025-09-07T07:33:27.8491521Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8491733Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8491736Z 2025-09-07T07:33:27.8491820Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8491881Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8491946Z ================== 1 failed, 220 deselected, 2 rerun in 1.22s ================== 2025-09-07T07:33:27.8491982Z Got exit code 1 2025-09-07T07:33:27.8492039Z Retrying single test... 2025-09-07T07:33:27.8492460Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8492499Z import pkg_resources 2025-09-07T07:33:27.8492685Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-44cae65ae0eadbe0.xml 2025-09-07T07:33:27.8492741Z ============================= test session starts ============================== 2025-09-07T07:33:27.8492853Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8492892Z cachedir: .pytest_cache 2025-09-07T07:33:27.8493050Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8493206Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8493247Z configfile: pytest.ini 2025-09-07T07:33:27.8493406Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8493482Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.8493727Z stepcurrent: skipping 67 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8493770Z Running 1 items in this shard 2025-09-07T07:33:27.8493772Z 2025-09-07T07:33:27.8493979Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.5849s] [100%] 2025-09-07T07:33:27.8495523Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True ('RERUN', {'yellow': True}) [0.2246s] [100%] 2025-09-07T07:33:27.8495731Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True FAILED [0.2236s] [100%] 2025-09-07T07:33:27.8495735Z 2025-09-07T07:33:27.8495786Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8495909Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8495955Z Traceback (most recent call last): 2025-09-07T07:33:27.8496116Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8496152Z self._run_test( 2025-09-07T07:33:27.8496264Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8496321Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8496364Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8496499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8496546Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8496586Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8496737Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8496785Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8496824Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8496960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8497004Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8497042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8497205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8497288Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8497326Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8498791Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8498859Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8499009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8499062Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8499103Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8499245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8499298Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8499353Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8499469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8499537Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8499581Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8499713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8499777Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8499819Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8499959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8500005Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8500042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8500199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8500238Z return aot_autograd( 2025-09-07T07:33:27.8500274Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8500409Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8501784Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8501833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8501995Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8502079Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8502127Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8502310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8502356Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8502543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8502584Z fx_g = _create_graph( 2025-09-07T07:33:27.8502621Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8502783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8502817Z fx_g = make_fx( 2025-09-07T07:33:27.8502851Z ^^^^^^^^ 2025-09-07T07:33:27.8503001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8503048Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8503156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8503326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8503370Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8503406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8503565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8503618Z t = dispatch_trace( 2025-09-07T07:33:27.8503653Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8505082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8505127Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8505163Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8505290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8505330Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8505369Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8505549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8505631Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8505672Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8505796Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8505836Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8505871Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8505996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8506039Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8506073Z ^^^^^^^^^ 2025-09-07T07:33:27.8506209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8506267Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8506305Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8506453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8506503Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8506537Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8508006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8508071Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8508117Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8508290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8508331Z outs_pair = fn(*args) 2025-09-07T07:33:27.8508368Z ^^^^^^^^^ 2025-09-07T07:33:27.8508541Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8508611Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8508656Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8508828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8508867Z outs_pair = fn(*args) 2025-09-07T07:33:27.8508902Z ^^^^^^^^^ 2025-09-07T07:33:27.8509077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8509137Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8509180Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8509392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8509463Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8509509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8509679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8509731Z outs_pair = fn(*args) 2025-09-07T07:33:27.8509765Z ^^^^^^^^^ 2025-09-07T07:33:27.8509954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8511306Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8511345Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8511542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8511591Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8511627Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8511754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8511796Z return handle_torch_function( 2025-09-07T07:33:27.8511835Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8511974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8512048Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8512096Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8512265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8512325Z return func(*args, **kwargs) 2025-09-07T07:33:27.8512362Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8512486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8512528Z result = _engine_run_backward( 2025-09-07T07:33:27.8512565Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8512709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8512831Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8512880Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8513006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8513048Z return user_fn(self, *args) 2025-09-07T07:33:27.8514468Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8514613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8514657Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8514694Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8514851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8514896Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8514933Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8515056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8515096Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8515131Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8515320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8515374Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8515416Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8515550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8515601Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8515639Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8515815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8515862Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8515902Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8516059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8516097Z t = dispatch_trace( 2025-09-07T07:33:27.8517442Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8517581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8517625Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8517662Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8517786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8517827Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8517862Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8518022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8518103Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8518144Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8518267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8518326Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8518362Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8518488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8518530Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8518564Z ^^^^^^^^^ 2025-09-07T07:33:27.8518713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8518763Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8518799Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8518840Z File "", line 1, in 2025-09-07T07:33:27.8518984Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8519063Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8520420Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8520560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8520609Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8520648Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8520839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8520883Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8520919Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8521088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8521132Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8521170Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8521330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8521375Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8521410Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8521544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8521631Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8521694Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8521821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8521882Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8521925Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8522052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8522092Z leaves = list(leaves) 2025-09-07T07:33:27.8523514Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8523641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8523677Z return func(x) 2025-09-07T07:33:27.8523710Z ^^^^^^^ 2025-09-07T07:33:27.8523847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8523912Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8523955Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8524121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8524163Z return func(*args, **kwargs) 2025-09-07T07:33:27.8524198Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8524381Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8524488Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8524490Z 2025-09-07T07:33:27.8524696Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8524700Z 2025-09-07T07:33:27.8524701Z 2025-09-07T07:33:27.8524774Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8524982Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8524984Z 2025-09-07T07:33:27.8525068Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8525143Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8525179Z inline_call [] 2025-09-07T07:33:27.8525237Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8525272Z inductor [] 2025-09-07T07:33:27.8525346Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8525417Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8527055Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8527173Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8527225Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8527376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8527487Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8527621Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8527740Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8527862Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8527923Z Traceback (most recent call last): 2025-09-07T07:33:27.8528083Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8528119Z self._run_test( 2025-09-07T07:33:27.8528231Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8528286Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8528328Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8528475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8528522Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8528560Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8528711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8528758Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8528798Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8528933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8530306Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8530346Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8530489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8530588Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8530629Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8530781Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8530827Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8530975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8531031Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8531070Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8531211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8531263Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8531303Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8531419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8531487Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8531531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8531657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8531721Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8531763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8531901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8531946Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8531984Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8533485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8533555Z return aot_autograd( 2025-09-07T07:33:27.8533593Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8533731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8533799Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8533847Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8534029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8534112Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8534157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8534340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8534385Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8534590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8534631Z fx_g = _create_graph( 2025-09-07T07:33:27.8534667Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8534828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8534864Z fx_g = make_fx( 2025-09-07T07:33:27.8534896Z ^^^^^^^^ 2025-09-07T07:33:27.8535049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8535095Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8535134Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8535280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8536659Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8536700Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8536859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8536897Z t = dispatch_trace( 2025-09-07T07:33:27.8536932Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8537042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8537086Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8537121Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8537247Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8537286Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8537322Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8537483Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8537563Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8537605Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8537728Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8537767Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8537803Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8537930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8537971Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8538006Z ^^^^^^^^^ 2025-09-07T07:33:27.8538138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8538179Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8539525Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8539679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8539730Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8539764Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8539924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8540002Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8540047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8540223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8540263Z outs_pair = fn(*args) 2025-09-07T07:33:27.8540298Z ^^^^^^^^^ 2025-09-07T07:33:27.8540468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8540552Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8540598Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8540770Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8540809Z outs_pair = fn(*args) 2025-09-07T07:33:27.8540844Z ^^^^^^^^^ 2025-09-07T07:33:27.8541020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8541079Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8541123Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8541317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8541401Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8541447Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8542948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8542987Z outs_pair = fn(*args) 2025-09-07T07:33:27.8543023Z ^^^^^^^^^ 2025-09-07T07:33:27.8543299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8543345Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8543381Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8543549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8543596Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8543635Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8543760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8543803Z return handle_torch_function( 2025-09-07T07:33:27.8543839Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8543979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8544053Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8544103Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8544272Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8544314Z return func(*args, **kwargs) 2025-09-07T07:33:27.8544349Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8544499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8544542Z result = _engine_run_backward( 2025-09-07T07:33:27.8544578Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8546045Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8546168Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8546238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8546365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8546407Z return user_fn(self, *args) 2025-09-07T07:33:27.8546443Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8546587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8546649Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8546687Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8546844Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8546889Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8546926Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8547049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8547088Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8547125Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8547287Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8547339Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8547379Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8547533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8547582Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8547621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8547780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8549146Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8549186Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8549346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8549384Z t = dispatch_trace( 2025-09-07T07:33:27.8549420Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8549533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8549578Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8549615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8549740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8549779Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8549814Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8549975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8550052Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8550093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8550216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8550255Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8550290Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8550437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8550479Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8550516Z ^^^^^^^^^ 2025-09-07T07:33:27.8550663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8552021Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8552075Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8552119Z File "", line 1, in 2025-09-07T07:33:27.8552263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8552344Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8552389Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8552526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8552589Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8552629Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8552819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8552863Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8552899Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8553150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8553194Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8553232Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8553374Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8553419Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8553476Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8553610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8553698Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8553748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8553875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8555261Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8555306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8555431Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8555471Z leaves = list(leaves) 2025-09-07T07:33:27.8555506Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8555630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8555665Z return func(x) 2025-09-07T07:33:27.8555698Z ^^^^^^^ 2025-09-07T07:33:27.8555834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8555900Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8555942Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8556109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8556150Z return func(*args, **kwargs) 2025-09-07T07:33:27.8556186Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8556367Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8556486Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8556489Z 2025-09-07T07:33:27.8556696Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8556699Z 2025-09-07T07:33:27.8556701Z 2025-09-07T07:33:27.8556774Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8556998Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8557000Z 2025-09-07T07:33:27.8557086Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8557159Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8558514Z inline_call [] 2025-09-07T07:33:27.8558573Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8558611Z inductor [] 2025-09-07T07:33:27.8558706Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8558779Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8559035Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8559150Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8559201Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8559352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8559441Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8559574Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8559708Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8559779Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8559814Z inline_call [] 2025-09-07T07:33:27.8559871Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8559943Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8560016Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8560269Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8560382Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8560433Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8560584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8560668Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8562111Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8562232Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8562284Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8562405Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True _ 2025-09-07T07:33:27.8562450Z Traceback (most recent call last): 2025-09-07T07:33:27.8562610Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8562665Z self._run_test( 2025-09-07T07:33:27.8562778Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8562834Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8562874Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8563005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8563116Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8563156Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8563310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8563355Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8563395Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8563529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8563576Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8563639Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8563784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8563865Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8565228Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8565381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8565428Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8565577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8565630Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8565671Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8565836Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8565887Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8565927Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8566042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8566112Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8566157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8566284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8566346Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8566391Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8566531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8566578Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8566615Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8566822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8566862Z return aot_autograd( 2025-09-07T07:33:27.8566897Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8567033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8568420Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8568468Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8568629Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8568736Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8568783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8568966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8569010Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8569194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8569251Z fx_g = _create_graph( 2025-09-07T07:33:27.8569288Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8569453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8569488Z fx_g = make_fx( 2025-09-07T07:33:27.8569521Z ^^^^^^^^ 2025-09-07T07:33:27.8569672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8569733Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8569773Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8569919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8569962Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8570000Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8570157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8570195Z t = dispatch_trace( 2025-09-07T07:33:27.8571540Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8571658Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8571701Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8571737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8571881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8571921Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8571958Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8572122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8572199Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8572242Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8572366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8572405Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8572440Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8572566Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8572608Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8572645Z ^^^^^^^^^ 2025-09-07T07:33:27.8572777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8572818Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8572853Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8573001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8573051Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8573148Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8574622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8574687Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8574734Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8574938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8574979Z outs_pair = fn(*args) 2025-09-07T07:33:27.8575014Z ^^^^^^^^^ 2025-09-07T07:33:27.8575184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8575251Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8575312Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8575485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8575523Z outs_pair = fn(*args) 2025-09-07T07:33:27.8575558Z ^^^^^^^^^ 2025-09-07T07:33:27.8575736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8575798Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8575858Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8576050Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8576121Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8576169Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8576343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8576382Z outs_pair = fn(*args) 2025-09-07T07:33:27.8576417Z ^^^^^^^^^ 2025-09-07T07:33:27.8576606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8577988Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8578026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8578195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8578240Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8578278Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8578403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8578446Z return handle_torch_function( 2025-09-07T07:33:27.8578483Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8578625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8578699Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8578746Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8578914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8578955Z return func(*args, **kwargs) 2025-09-07T07:33:27.8578991Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8579117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8579160Z result = _engine_run_backward( 2025-09-07T07:33:27.8579197Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8579341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8579461Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8579509Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8579653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8580997Z return user_fn(self, *args) 2025-09-07T07:33:27.8581036Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8581180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8581224Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8581279Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8581435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8581480Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8581516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8581640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8581680Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8581718Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8581895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8581948Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8581989Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8582123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8582173Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8582213Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8582372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8582419Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8582458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8582635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8582673Z t = dispatch_trace( 2025-09-07T07:33:27.8584122Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8584236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8584280Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8584318Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8584443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8584482Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8584518Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8584677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8584754Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8584798Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8584922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8584962Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8584996Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8585122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8585165Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8585201Z ^^^^^^^^^ 2025-09-07T07:33:27.8585348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8585398Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8585431Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8585474Z File "", line 1, in 2025-09-07T07:33:27.8585641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8587051Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8587099Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8587237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8587285Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8587346Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8587536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8587580Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8587616Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8587787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8587833Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8587888Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8588030Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8588074Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8588109Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8588243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8588331Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8588377Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8588503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8588563Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8588628Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8588755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8588795Z leaves = list(leaves) 2025-09-07T07:33:27.8590140Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8590266Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8590302Z return func(x) 2025-09-07T07:33:27.8590336Z ^^^^^^^ 2025-09-07T07:33:27.8590474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8590540Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8590581Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8590749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8590790Z return func(*args, **kwargs) 2025-09-07T07:33:27.8590827Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8591007Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8591092Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8591094Z 2025-09-07T07:33:27.8591301Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8591303Z 2025-09-07T07:33:27.8591305Z 2025-09-07T07:33:27.8591379Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8591586Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8591588Z 2025-09-07T07:33:27.8591693Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8591767Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8591803Z inline_call [] 2025-09-07T07:33:27.8591859Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8591894Z inductor [] 2025-09-07T07:33:27.8591967Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8593436Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8593693Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8593806Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8593857Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8594033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8594121Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8594253Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8594371Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8594444Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8594478Z inline_call [] 2025-09-07T07:33:27.8594535Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8594608Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8594679Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8594933Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8595062Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8595112Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8595260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8595345Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8595474Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8595591Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8595661Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8595698Z inline_call [] 2025-09-07T07:33:27.8597079Z stats [('calls_captured', 18), ('unique_graphs', 1)] 2025-09-07T07:33:27.8597154Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8597224Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8597474Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8597587Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8597636Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8597784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8597866Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8598018Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8598136Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8598354Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-44cae65ae0eadbe0.xml - 2025-09-07T07:33:27.8598427Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8598804Z FAILED [0.2236s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8598888Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8598890Z 2025-09-07T07:33:27.8599115Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8599119Z 2025-09-07T07:33:27.8599120Z 2025-09-07T07:33:27.8599193Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8599400Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True 2025-09-07T07:33:27.8599403Z 2025-09-07T07:33:27.8599486Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8599546Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8599611Z ================== 1 failed, 220 deselected, 2 rerun in 1.20s ================== 2025-09-07T07:33:27.8599647Z Got exit code 1 2025-09-07T07:33:27.8601089Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.8601525Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8601565Z import pkg_resources 2025-09-07T07:33:27.8601735Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-843b678339bc8f15.xml 2025-09-07T07:33:27.8601791Z ============================= test session starts ============================== 2025-09-07T07:33:27.8601903Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8601942Z cachedir: .pytest_cache 2025-09-07T07:33:27.8602099Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8602145Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8602185Z configfile: pytest.ini 2025-09-07T07:33:27.8602344Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8602420Z collecting ... collected 467 items / 68 deselected / 399 selected 2025-09-07T07:33:27.8602469Z stepcurrent: skipping 68 already run items. 2025-09-07T07:33:27.8602514Z Running 153 items in this shard 2025-09-07T07:33:27.8602516Z 2025-09-07T07:33:27.8602725Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.1297s] [ 0%] 2025-09-07T07:33:27.8602931Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.7109s] [ 0%] 2025-09-07T07:33:27.8603184Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True FAILED [0.7115s] [ 0%] 2025-09-07T07:33:27.8603187Z 2025-09-07T07:33:27.8603237Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8603361Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8603405Z Traceback (most recent call last): 2025-09-07T07:33:27.8603582Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8604941Z self._run_test( 2025-09-07T07:33:27.8605057Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8605113Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8605154Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8605291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8605359Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8605400Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8605551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8605599Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8605639Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8605776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8605820Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8605858Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8606003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8606086Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8606142Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8606293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8606340Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8606488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8606543Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8606584Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8606774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8608143Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8608184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8608302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8608371Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8608416Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8608543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8608605Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8608650Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8608790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8608836Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8608874Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8609011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8609050Z return aot_autograd( 2025-09-07T07:33:27.8609105Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8609242Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8609312Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8609357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8609517Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8609612Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8609660Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8609842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8611195Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8611400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8611442Z fx_g = _create_graph( 2025-09-07T07:33:27.8611477Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8611640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8611676Z fx_g = make_fx( 2025-09-07T07:33:27.8611710Z ^^^^^^^^ 2025-09-07T07:33:27.8611860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8611906Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8611946Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8612091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8612136Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8612185Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8612343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8612381Z t = dispatch_trace( 2025-09-07T07:33:27.8612416Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8612528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8612572Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8612607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8612732Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8612772Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8612808Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8614336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8614421Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8614463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8614590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8614628Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8614664Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8614790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8614833Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8614867Z ^^^^^^^^^ 2025-09-07T07:33:27.8615001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8615042Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8615077Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8615254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8615306Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8615341Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8615496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8615559Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8615620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8615795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8615835Z outs_pair = fn(*args) 2025-09-07T07:33:27.8615870Z ^^^^^^^^^ 2025-09-07T07:33:27.8616041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8617428Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8617498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8617673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8617711Z outs_pair = fn(*args) 2025-09-07T07:33:27.8617747Z ^^^^^^^^^ 2025-09-07T07:33:27.8617922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8617983Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8618025Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8618220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8618311Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8618359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8618530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8618569Z outs_pair = fn(*args) 2025-09-07T07:33:27.8618603Z ^^^^^^^^^ 2025-09-07T07:33:27.8618792Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8618838Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8618875Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8619042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8619089Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8619128Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8619253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8620605Z return handle_torch_function( 2025-09-07T07:33:27.8620645Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8620787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8620861Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8620907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8621073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8621115Z return func(*args, **kwargs) 2025-09-07T07:33:27.8621151Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8621292Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8621337Z result = _engine_run_backward( 2025-09-07T07:33:27.8621374Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8621519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8621640Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8621711Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8621837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8621879Z return user_fn(self, *args) 2025-09-07T07:33:27.8621916Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8622059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8622106Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8622158Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8622317Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8622361Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8623786Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8623915Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8623956Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8623992Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8624156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8624209Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8624249Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8624412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8624462Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8624501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8624662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8624712Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8624750Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8624907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8624945Z t = dispatch_trace( 2025-09-07T07:33:27.8624980Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8625092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8625137Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8625174Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8625298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8625337Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8626692Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8626858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8626941Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8626982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8627107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8627146Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8627182Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8627330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8627375Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8627409Z ^^^^^^^^^ 2025-09-07T07:33:27.8627558Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8627606Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8627658Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8627701Z File "", line 1, in 2025-09-07T07:33:27.8627845Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8627924Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8627970Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8628107Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8628155Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8628211Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8628402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8628446Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8629791Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8629964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8630009Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8630047Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8630189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8630232Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8630288Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8630423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8630512Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8630559Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8630682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8630745Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8630789Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8630917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8630956Z leaves = list(leaves) 2025-09-07T07:33:27.8630990Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8631112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8631150Z return func(x) 2025-09-07T07:33:27.8631183Z ^^^^^^^ 2025-09-07T07:33:27.8631319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8631385Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8632736Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8632904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8632947Z return func(*args, **kwargs) 2025-09-07T07:33:27.8632982Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8633217Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8633303Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8633333Z 2025-09-07T07:33:27.8633540Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8633542Z 2025-09-07T07:33:27.8633544Z 2025-09-07T07:33:27.8633617Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8633827Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8633845Z 2025-09-07T07:33:27.8633930Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8634003Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8634037Z inline_call [] 2025-09-07T07:33:27.8634095Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8634129Z inductor [] 2025-09-07T07:33:27.8634205Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8634295Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8634548Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8634665Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8634716Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8634867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8634951Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8635083Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8636543Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8636669Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8636714Z Traceback (most recent call last): 2025-09-07T07:33:27.8636875Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8636911Z self._run_test( 2025-09-07T07:33:27.8637024Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8637079Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8637121Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8637252Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8637299Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8637340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8637492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8637538Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8637577Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8637712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8637758Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8637795Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8637938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8638019Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8638058Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8638226Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8639582Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8639733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8639788Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8639829Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8639989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8640040Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8640079Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8640194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8640261Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8640306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8640446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8640510Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8640552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8640693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8640738Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8640777Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8640912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8640952Z return aot_autograd( 2025-09-07T07:33:27.8640987Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8641123Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8641204Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8641251Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8642717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8642805Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8642850Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8643032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8643138Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8643325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8643366Z fx_g = _create_graph( 2025-09-07T07:33:27.8643402Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8643567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8643602Z fx_g = make_fx( 2025-09-07T07:33:27.8643634Z ^^^^^^^^ 2025-09-07T07:33:27.8643785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8643832Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8643870Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8644015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8644058Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8644094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8644284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8644324Z t = dispatch_trace( 2025-09-07T07:33:27.8644358Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8644470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8644512Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8645872Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8646017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8646058Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8646093Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8646255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8646335Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8646379Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8646518Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8646559Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8646593Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8646887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8646930Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8646966Z ^^^^^^^^^ 2025-09-07T07:33:27.8647097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8647138Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8647173Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8647322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8647390Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8647424Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8647580Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8647642Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8649014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8649194Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8649234Z outs_pair = fn(*args) 2025-09-07T07:33:27.8649268Z ^^^^^^^^^ 2025-09-07T07:33:27.8649439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8649505Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8649552Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8649726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8649765Z outs_pair = fn(*args) 2025-09-07T07:33:27.8649799Z ^^^^^^^^^ 2025-09-07T07:33:27.8649976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8650037Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8650080Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8650273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8650344Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8650406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8650580Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8650619Z outs_pair = fn(*args) 2025-09-07T07:33:27.8650654Z ^^^^^^^^^ 2025-09-07T07:33:27.8650842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8650901Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8650938Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8652419Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8652467Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8652505Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8652630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8652690Z return handle_torch_function( 2025-09-07T07:33:27.8652727Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8652868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8652942Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8652990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8653234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8653276Z return func(*args, **kwargs) 2025-09-07T07:33:27.8653311Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8653436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8653478Z result = _engine_run_backward( 2025-09-07T07:33:27.8653536Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8653683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8653802Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8653852Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8653979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8654022Z return user_fn(self, *args) 2025-09-07T07:33:27.8654057Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8655524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8655570Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8655608Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8655768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8655813Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8655849Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8655972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8656013Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8656050Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8656214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8656266Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8656306Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8656442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8656513Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8656556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8656714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8656762Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8656800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8656977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8657015Z t = dispatch_trace( 2025-09-07T07:33:27.8657050Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8657162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8658520Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8658558Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8658683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8658744Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8658780Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8658940Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8659019Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8659062Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8659185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8659226Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8659261Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8659386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8659428Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8659479Z ^^^^^^^^^ 2025-09-07T07:33:27.8659627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8659677Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8659711Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8659753Z File "", line 1, in 2025-09-07T07:33:27.8659894Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8659973Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8660019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8661460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8661509Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8661550Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8661742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8661786Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8661822Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8661993Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8662039Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8662076Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8662218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8662260Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8662298Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8662445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8662536Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8662582Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8662708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8662768Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8662825Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8662955Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8662994Z leaves = list(leaves) 2025-09-07T07:33:27.8663029Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8663211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8664557Z return func(x) 2025-09-07T07:33:27.8664595Z ^^^^^^^ 2025-09-07T07:33:27.8664760Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8664826Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8664868Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8665034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8665076Z return func(*args, **kwargs) 2025-09-07T07:33:27.8665112Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8665293Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8665379Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8665381Z 2025-09-07T07:33:27.8665586Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8665613Z 2025-09-07T07:33:27.8665614Z 2025-09-07T07:33:27.8665691Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8665898Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8665902Z 2025-09-07T07:33:27.8665987Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8666059Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8666095Z inline_call [] 2025-09-07T07:33:27.8666151Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8666186Z inductor [] 2025-09-07T07:33:27.8666259Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8666332Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8666589Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8668021Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8668074Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8668228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8668312Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8668445Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8668564Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8668677Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8668713Z inline_call [] 2025-09-07T07:33:27.8668770Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8668843Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8668913Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8669184Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8669297Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8669347Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8669494Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8669580Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8669723Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8669841Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8669891Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8670013Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8670057Z Traceback (most recent call last): 2025-09-07T07:33:27.8670220Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8671565Z self._run_test( 2025-09-07T07:33:27.8671678Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8671734Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8671796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8671928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8671976Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8672015Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8672166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8672214Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8672253Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8672388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8672433Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8672470Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8672614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8672695Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8672734Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8672885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8672932Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8673167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8673223Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8673264Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8674723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8674800Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8674843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8674959Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8675026Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8675070Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8675215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8675278Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8675320Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8675460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8675504Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8675544Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8675703Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8675744Z return aot_autograd( 2025-09-07T07:33:27.8675779Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8675914Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8675983Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8676031Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8676189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8676273Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8676318Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8676500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8677877Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8678066Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8678107Z fx_g = _create_graph( 2025-09-07T07:33:27.8678145Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8678307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8678342Z fx_g = make_fx( 2025-09-07T07:33:27.8678375Z ^^^^^^^^ 2025-09-07T07:33:27.8678530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8678577Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8678616Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8678764Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8678807Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8678844Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8679001Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8679040Z t = dispatch_trace( 2025-09-07T07:33:27.8679074Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8679187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8679228Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8679264Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8679388Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8679429Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8679485Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8680954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8681034Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8681078Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8681203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8681261Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8681296Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8681422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8681464Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8681499Z ^^^^^^^^^ 2025-09-07T07:33:27.8681631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8681673Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8681723Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8681872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8681921Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8681956Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8682113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8682175Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8682219Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8682391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8682432Z outs_pair = fn(*args) 2025-09-07T07:33:27.8682482Z ^^^^^^^^^ 2025-09-07T07:33:27.8684028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8684098Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8684142Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8684316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8684357Z outs_pair = fn(*args) 2025-09-07T07:33:27.8684391Z ^^^^^^^^^ 2025-09-07T07:33:27.8684565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8684625Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8684669Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8684864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8684933Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8684978Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8685149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8685188Z outs_pair = fn(*args) 2025-09-07T07:33:27.8685223Z ^^^^^^^^^ 2025-09-07T07:33:27.8685413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8685459Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8685495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8685690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8685738Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8685776Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8685900Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8687304Z return handle_torch_function( 2025-09-07T07:33:27.8687366Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8687509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8687582Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8687629Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8687795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8687839Z return func(*args, **kwargs) 2025-09-07T07:33:27.8687897Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8688022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8688064Z result = _engine_run_backward( 2025-09-07T07:33:27.8688100Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8688246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8688368Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8688419Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8688543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8688585Z return user_fn(self, *args) 2025-09-07T07:33:27.8688639Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8688785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8688828Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8688866Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8689023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8690379Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8690419Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8690543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8690582Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8690619Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8690783Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8690838Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8690878Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8691015Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8691064Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8691103Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8691264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8691312Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8691350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8691507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8691545Z t = dispatch_trace( 2025-09-07T07:33:27.8691603Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8691718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8691760Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8691798Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8691921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8691975Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8693378Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8693542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8693620Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8693662Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8693785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8693827Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8693888Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8694014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8694056Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8694091Z ^^^^^^^^^ 2025-09-07T07:33:27.8694241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8694292Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8694326Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8694369Z File "", line 1, in 2025-09-07T07:33:27.8694511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8694589Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8694637Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8694795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8694842Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8694881Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8695073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8696444Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8696482Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8696653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8696697Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8696734Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8696879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8696922Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8696959Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8697091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8697180Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8697228Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8697353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8697413Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8697458Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8697604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8697645Z leaves = list(leaves) 2025-09-07T07:33:27.8697680Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8697804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8697839Z return func(x) 2025-09-07T07:33:27.8697873Z ^^^^^^^ 2025-09-07T07:33:27.8698009Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8698091Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8699443Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8699613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8699654Z return func(*args, **kwargs) 2025-09-07T07:33:27.8699691Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8699875Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8699978Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8699981Z 2025-09-07T07:33:27.8700185Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8700189Z 2025-09-07T07:33:27.8700191Z 2025-09-07T07:33:27.8700264Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8700471Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8700473Z 2025-09-07T07:33:27.8700559Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8700633Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8700683Z inline_call [] 2025-09-07T07:33:27.8700740Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8700775Z inductor [] 2025-09-07T07:33:27.8700848Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8700920Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8701173Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8701288Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8701338Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8701489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8701575Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8703018Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8703201Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8703273Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8703309Z inline_call [] 2025-09-07T07:33:27.8703367Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8703440Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8703510Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8703761Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8703902Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8703955Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8704104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8704188Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8704336Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8704453Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8704522Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8704557Z inline_call [] 2025-09-07T07:33:27.8704611Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8704683Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8704770Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8705027Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8705138Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8705189Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8706663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8706750Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8706877Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8706995Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8707230Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-843b678339bc8f15.xml - 2025-09-07T07:33:27.8707289Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8707664Z FAILED [0.7115s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8707749Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8707751Z 2025-09-07T07:33:27.8707955Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8707958Z 2025-09-07T07:33:27.8707961Z 2025-09-07T07:33:27.8708034Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8708240Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8708242Z 2025-09-07T07:33:27.8708325Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8708387Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8708451Z ================== 1 failed, 68 deselected, 2 rerun in 2.74s =================== 2025-09-07T07:33:27.8708487Z Got exit code 1 2025-09-07T07:33:27.8708525Z Retrying single test... 2025-09-07T07:33:27.8708960Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8709002Z import pkg_resources 2025-09-07T07:33:27.8709172Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-dbdf0f09d0221ad0.xml 2025-09-07T07:33:27.8709227Z ============================= test session starts ============================== 2025-09-07T07:33:27.8709359Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8710712Z cachedir: .pytest_cache 2025-09-07T07:33:27.8710873Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8710917Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8710957Z configfile: pytest.ini 2025-09-07T07:33:27.8711118Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8711210Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.8711452Z stepcurrent: skipping 68 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8711495Z Running 1 items in this shard 2025-09-07T07:33:27.8711498Z 2025-09-07T07:33:27.8711705Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.1268s] [100%] 2025-09-07T07:33:27.8711911Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.7064s] [100%] 2025-09-07T07:33:27.8712092Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True FAILED [0.7406s] [100%] 2025-09-07T07:33:27.8712109Z 2025-09-07T07:33:27.8712161Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8712283Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8712327Z Traceback (most recent call last): 2025-09-07T07:33:27.8712492Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8712530Z self._run_test( 2025-09-07T07:33:27.8712643Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8712700Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8712741Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8712876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8712924Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8714390Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8714547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8714595Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8714634Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8714771Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8714817Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8714855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8714998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8715078Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8715118Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8715296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8715345Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8715495Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8715550Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8715608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8715750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8715801Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8715841Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8715957Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8716025Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8716071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8716216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8717609Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8717654Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8717793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8717841Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8717878Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8718017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8718056Z return aot_autograd( 2025-09-07T07:33:27.8718093Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8718229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8718322Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8718367Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8718528Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8718613Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8718659Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8718841Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8718886Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8719073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8719114Z fx_g = _create_graph( 2025-09-07T07:33:27.8719151Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8719312Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8719348Z fx_g = make_fx( 2025-09-07T07:33:27.8719381Z ^^^^^^^^ 2025-09-07T07:33:27.8720850Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8720898Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8720937Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8721082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8721127Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8721164Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8721337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8721377Z t = dispatch_trace( 2025-09-07T07:33:27.8721413Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8721525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8721568Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8721619Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8721744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8721785Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8721822Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8721980Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8722060Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8722104Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8722243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8722282Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8722319Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8723811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8723859Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8723894Z ^^^^^^^^^ 2025-09-07T07:33:27.8724028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8724069Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8724105Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8724255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8724333Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8724370Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8724525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8724589Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8724633Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8724809Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8724849Z outs_pair = fn(*args) 2025-09-07T07:33:27.8724885Z ^^^^^^^^^ 2025-09-07T07:33:27.8725058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8725126Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8725171Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8725347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8725385Z outs_pair = fn(*args) 2025-09-07T07:33:27.8725420Z ^^^^^^^^^ 2025-09-07T07:33:27.8725595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8727026Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8727071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8727265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8727337Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8727405Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8727578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8727618Z outs_pair = fn(*args) 2025-09-07T07:33:27.8727652Z ^^^^^^^^^ 2025-09-07T07:33:27.8727840Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8727902Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8727940Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8728108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8728155Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8728193Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8728319Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8728380Z return handle_torch_function( 2025-09-07T07:33:27.8728418Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8728559Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8728632Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8728680Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8728846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8730204Z return func(*args, **kwargs) 2025-09-07T07:33:27.8730242Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8730368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8730411Z result = _engine_run_backward( 2025-09-07T07:33:27.8730468Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8730617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8730739Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8730789Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8730916Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8730958Z return user_fn(self, *args) 2025-09-07T07:33:27.8730996Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8731138Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8731183Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8731220Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8731380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8731424Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8731460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8731583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8731625Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8731661Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8731824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8731877Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8733333Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8733475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8733557Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8733601Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8733763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8733812Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8733852Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8734029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8734068Z t = dispatch_trace( 2025-09-07T07:33:27.8734104Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8734216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8734260Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8734298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8734440Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8734480Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8734517Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8734675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8734755Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8734800Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8734924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8734963Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8736336Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8736466Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8736509Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8736570Z ^^^^^^^^^ 2025-09-07T07:33:27.8736720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8736769Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8736803Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8736846Z File "", line 1, in 2025-09-07T07:33:27.8736988Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8737068Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8737115Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8737251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8737297Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8737338Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8737529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8737574Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8737609Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8737780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8737825Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8737863Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8738004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8738048Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8739392Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8739549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8739640Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8739687Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8739812Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8739873Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8739933Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8740059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8740099Z leaves = list(leaves) 2025-09-07T07:33:27.8740134Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8740258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8740294Z return func(x) 2025-09-07T07:33:27.8740329Z ^^^^^^^ 2025-09-07T07:33:27.8740480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8740547Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8740589Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8740756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8740797Z return func(*args, **kwargs) 2025-09-07T07:33:27.8740835Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8741016Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8741102Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8741104Z 2025-09-07T07:33:27.8741310Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8742655Z 2025-09-07T07:33:27.8742657Z 2025-09-07T07:33:27.8742733Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8742941Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8742944Z 2025-09-07T07:33:27.8743031Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8743161Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8743196Z inline_call [] 2025-09-07T07:33:27.8743252Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8743288Z inductor [] 2025-09-07T07:33:27.8743362Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8743437Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8743693Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8743808Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8743859Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8744010Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8744096Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8744228Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8744346Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8744496Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8744541Z Traceback (most recent call last): 2025-09-07T07:33:27.8744704Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8744739Z self._run_test( 2025-09-07T07:33:27.8744852Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8746248Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8746293Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8746424Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8746471Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8746511Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8746662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8746728Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8746769Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8746904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8746949Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8746988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8747130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8747210Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8747250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8747402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8747470Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8747621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8747675Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8747716Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8747857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8747910Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8747950Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8749386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8749451Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8749496Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8749622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8749689Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8749731Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8749871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8749916Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8749955Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8750093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8750134Z return aot_autograd( 2025-09-07T07:33:27.8750168Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8750304Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8750390Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8750440Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8750600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8750684Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8750729Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8750926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8750969Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8751157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8752503Z fx_g = _create_graph( 2025-09-07T07:33:27.8752542Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8752727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8752764Z fx_g = make_fx( 2025-09-07T07:33:27.8752797Z ^^^^^^^^ 2025-09-07T07:33:27.8752949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8752997Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8753036Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8753271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8753314Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8753351Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8753507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8753576Z t = dispatch_trace( 2025-09-07T07:33:27.8753610Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8753724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8753765Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8753802Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8753930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8753972Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8754008Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8754168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8754246Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8755613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8755743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8755784Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8755820Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8755947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8755988Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8756024Z ^^^^^^^^^ 2025-09-07T07:33:27.8756157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8756199Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8756234Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8756383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8756434Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8756467Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8756646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8756710Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8756755Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8756930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8756989Z outs_pair = fn(*args) 2025-09-07T07:33:27.8757024Z ^^^^^^^^^ 2025-09-07T07:33:27.8757197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8757264Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8758621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8758797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8758857Z outs_pair = fn(*args) 2025-09-07T07:33:27.8758892Z ^^^^^^^^^ 2025-09-07T07:33:27.8759068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8759129Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8759174Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8759366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8759437Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8759484Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8759657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8759711Z outs_pair = fn(*args) 2025-09-07T07:33:27.8759746Z ^^^^^^^^^ 2025-09-07T07:33:27.8759935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8759981Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8760020Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8760187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8760234Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8760272Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8760397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8760440Z return handle_torch_function( 2025-09-07T07:33:27.8760478Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8761935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8762011Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8762057Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8762223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8762266Z return func(*args, **kwargs) 2025-09-07T07:33:27.8762302Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8762425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8762467Z result = _engine_run_backward( 2025-09-07T07:33:27.8762503Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8762665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8762789Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8762839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8762963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8763021Z return user_fn(self, *args) 2025-09-07T07:33:27.8763057Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8763265Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8763309Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8763347Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8763503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8763549Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8763606Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8765052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8765094Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8765132Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8765296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8765349Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8765390Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8765526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8765575Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8765616Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8765801Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8765850Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8765889Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8766046Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8766086Z t = dispatch_trace( 2025-09-07T07:33:27.8766120Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8766234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8766277Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8766314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8766437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8766478Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8766514Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8766674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8768126Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8768172Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8768297Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8768336Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8768371Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8768498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8768539Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8768574Z ^^^^^^^^^ 2025-09-07T07:33:27.8768745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8768798Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8768832Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8768875Z File "", line 1, in 2025-09-07T07:33:27.8769016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8769113Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8769160Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8769295Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8769344Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8769381Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8769573Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8769630Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8769668Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8769837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8771199Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8771239Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8771383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8771425Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8771463Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8771595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8771685Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8771748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8771874Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8771935Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8771979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8772105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8772145Z leaves = list(leaves) 2025-09-07T07:33:27.8772180Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8772305Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8772340Z return func(x) 2025-09-07T07:33:27.8772373Z ^^^^^^^ 2025-09-07T07:33:27.8772510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8772577Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8772619Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8772785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8774223Z return func(*args, **kwargs) 2025-09-07T07:33:27.8774263Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8774445Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8774530Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8774533Z 2025-09-07T07:33:27.8774737Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8774741Z 2025-09-07T07:33:27.8774773Z 2025-09-07T07:33:27.8774849Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8775057Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8775059Z 2025-09-07T07:33:27.8775146Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8775236Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8775274Z inline_call [] 2025-09-07T07:33:27.8775331Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8775366Z inductor [] 2025-09-07T07:33:27.8775440Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8775513Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8775794Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8775909Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8775961Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8776111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8776199Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8776329Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8776447Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8777849Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8777888Z inline_call [] 2025-09-07T07:33:27.8777967Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8778041Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8778111Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8778364Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8778477Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8778528Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8778675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8778760Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8778888Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8779008Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8779059Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8779180Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8779226Z Traceback (most recent call last): 2025-09-07T07:33:27.8779386Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8779421Z self._run_test( 2025-09-07T07:33:27.8779535Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8779591Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8779633Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8779780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8779828Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8781174Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8781327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8781393Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8781433Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8781569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8781614Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8781653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8781795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8781878Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8781934Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8782086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8782133Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8782282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8782338Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8782379Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8782519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8782571Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8782610Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8782744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8782811Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8782856Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8782981Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8784459Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8784503Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8784643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8784688Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8784727Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8784865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8784906Z return aot_autograd( 2025-09-07T07:33:27.8784942Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8785080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8785149Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8785195Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8785357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8785440Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8785486Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8785668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8785739Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8785926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8785966Z fx_g = _create_graph( 2025-09-07T07:33:27.8786003Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8786164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8786217Z fx_g = make_fx( 2025-09-07T07:33:27.8787562Z ^^^^^^^^ 2025-09-07T07:33:27.8787718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8787764Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8787803Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8787951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8787995Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8788055Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8788212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8788251Z t = dispatch_trace( 2025-09-07T07:33:27.8788285Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8788399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8788440Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8788477Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8788602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8788642Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8788678Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8788839Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8788939Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8788981Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8789105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8789145Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8789181Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8790619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8790664Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8790700Z ^^^^^^^^^ 2025-09-07T07:33:27.8790833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8790874Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8790911Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8791060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8791112Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8791146Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8791302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8791365Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8791410Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8791583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8791624Z outs_pair = fn(*args) 2025-09-07T07:33:27.8791658Z ^^^^^^^^^ 2025-09-07T07:33:27.8791845Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8791915Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8791961Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8792133Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8792188Z outs_pair = fn(*args) 2025-09-07T07:33:27.8792222Z ^^^^^^^^^ 2025-09-07T07:33:27.8793803Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8793866Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8793909Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8794104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8794201Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8794247Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8794418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8794458Z outs_pair = fn(*args) 2025-09-07T07:33:27.8794495Z ^^^^^^^^^ 2025-09-07T07:33:27.8794681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8794728Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8794766Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8794934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8794998Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8795037Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8795163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8795207Z return handle_torch_function( 2025-09-07T07:33:27.8795243Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8795383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8795459Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8795505Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8795672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8797027Z return func(*args, **kwargs) 2025-09-07T07:33:27.8797065Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8797191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8797234Z result = _engine_run_backward( 2025-09-07T07:33:27.8797270Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8797415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8797533Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8797587Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8797713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8797755Z return user_fn(self, *args) 2025-09-07T07:33:27.8797792Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8797958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8798004Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8798043Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8798198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8798971Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8799031Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8799158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8799199Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8799235Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8801489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8801552Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8801596Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8801763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8801815Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8801855Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8802024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8802074Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8802114Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8802273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8802313Z t = dispatch_trace( 2025-09-07T07:33:27.8802348Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8802461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8802520Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8802559Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8802682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8802723Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8802758Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8802919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8802999Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8803040Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8804951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8804997Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8805032Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8805164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8805208Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8805243Z ^^^^^^^^^ 2025-09-07T07:33:27.8805398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8805452Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8805488Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8805531Z File "", line 1, in 2025-09-07T07:33:27.8805674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8805759Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8805807Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8805943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8805994Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8806032Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8806223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8806325Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8806381Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8806554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8806599Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8806639Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8806855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8806899Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8806936Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8807089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8807177Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8807226Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8807352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8807415Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8807459Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8807586Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8807625Z leaves = list(leaves) 2025-09-07T07:33:27.8809181Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8809332Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8809368Z return func(x) 2025-09-07T07:33:27.8809402Z ^^^^^^^ 2025-09-07T07:33:27.8809540Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8809606Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8809651Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8809817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8809860Z return func(*args, **kwargs) 2025-09-07T07:33:27.8809896Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8810078Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8810168Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8810172Z 2025-09-07T07:33:27.8810379Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8810382Z 2025-09-07T07:33:27.8810384Z 2025-09-07T07:33:27.8810458Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8810669Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8810672Z 2025-09-07T07:33:27.8810757Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8810833Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8810869Z inline_call [] 2025-09-07T07:33:27.8810927Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8810964Z inductor [] 2025-09-07T07:33:27.8811039Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8811112Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8812741Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8812872Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8812925Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8813143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8813232Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8813364Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8813507Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8813579Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8813615Z inline_call [] 2025-09-07T07:33:27.8813671Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8813748Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8813818Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8814075Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8814186Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8814237Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8814404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8814490Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8814619Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8814741Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8814811Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8814846Z inline_call [] 2025-09-07T07:33:27.8816264Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8816340Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8816409Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8816665Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8816775Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8816827Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8816977Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8817064Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8817192Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8817309Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8817525Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-dbdf0f09d0221ad0.xml - 2025-09-07T07:33:27.8817587Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8817993Z FAILED [0.7406s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8818096Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8818098Z 2025-09-07T07:33:27.8818303Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8818305Z 2025-09-07T07:33:27.8818307Z 2025-09-07T07:33:27.8818379Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8818600Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8818602Z 2025-09-07T07:33:27.8818688Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8818747Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8818816Z ================== 1 failed, 220 deselected, 2 rerun in 2.84s ================== 2025-09-07T07:33:27.8818851Z Got exit code 1 2025-09-07T07:33:27.8820223Z Retrying single test... 2025-09-07T07:33:27.8820645Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8820686Z import pkg_resources 2025-09-07T07:33:27.8820880Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-1a8f72f145988413.xml 2025-09-07T07:33:27.8820937Z ============================= test session starts ============================== 2025-09-07T07:33:27.8821050Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8821091Z cachedir: .pytest_cache 2025-09-07T07:33:27.8821248Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8821294Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8821333Z configfile: pytest.ini 2025-09-07T07:33:27.8821495Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8821572Z collecting ... collected 467 items / 220 deselected / 247 selected 2025-09-07T07:33:27.8821818Z stepcurrent: skipping 68 already run items. Running only test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8821861Z Running 1 items in this shard 2025-09-07T07:33:27.8821863Z 2025-09-07T07:33:27.8822072Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [1.1095s] [100%] 2025-09-07T07:33:27.8822278Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True ('RERUN', {'yellow': True}) [0.7005s] [100%] 2025-09-07T07:33:27.8822460Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True FAILED [0.7035s] [100%] 2025-09-07T07:33:27.8822462Z 2025-09-07T07:33:27.8822512Z ==================================== RERUNS ==================================== 2025-09-07T07:33:27.8822638Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8822683Z Traceback (most recent call last): 2025-09-07T07:33:27.8822846Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8822881Z self._run_test( 2025-09-07T07:33:27.8824521Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8824599Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8824642Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8824776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8824825Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8824865Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8825017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8825083Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8825125Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8825261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8825307Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8825347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8825491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8825572Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8825613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8825764Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8825828Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8825978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8826032Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8826075Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8826219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8827614Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8827657Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8827776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8827843Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8827888Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8828014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8828080Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8828122Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8828262Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8828308Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8828347Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8828486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8828526Z return aot_autograd( 2025-09-07T07:33:27.8828561Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8828697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8828768Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8828818Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8828978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8829062Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8829128Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8829327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8829370Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8830877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8830920Z fx_g = _create_graph( 2025-09-07T07:33:27.8830957Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8831233Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8831270Z fx_g = make_fx( 2025-09-07T07:33:27.8831303Z ^^^^^^^^ 2025-09-07T07:33:27.8831455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8831504Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8831542Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8831689Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8831732Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8831770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8831927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8831982Z t = dispatch_trace( 2025-09-07T07:33:27.8832017Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8832131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8832173Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8832210Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8832336Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8832378Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8832415Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8833965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8834048Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8834094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8834219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8834261Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8834296Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8834425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8834467Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8834504Z ^^^^^^^^^ 2025-09-07T07:33:27.8834636Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8834678Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8834714Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8834860Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8834912Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8834946Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8835104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8835166Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8835212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8835413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8835472Z outs_pair = fn(*args) 2025-09-07T07:33:27.8835507Z ^^^^^^^^^ 2025-09-07T07:33:27.8835679Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8837069Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8837118Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8837294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8837356Z outs_pair = fn(*args) 2025-09-07T07:33:27.8837391Z ^^^^^^^^^ 2025-09-07T07:33:27.8837568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8837628Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8837673Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8837866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8837938Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8837984Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8838155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8838212Z outs_pair = fn(*args) 2025-09-07T07:33:27.8838248Z ^^^^^^^^^ 2025-09-07T07:33:27.8838436Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8838484Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8838523Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8838693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8838740Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8838778Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8838903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8840266Z return handle_torch_function( 2025-09-07T07:33:27.8840306Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8840454Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8840529Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8840576Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8840744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8840787Z return func(*args, **kwargs) 2025-09-07T07:33:27.8840824Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8840947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8840990Z result = _engine_run_backward( 2025-09-07T07:33:27.8841026Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8841171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8841293Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8841345Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8841492Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8841551Z return user_fn(self, *args) 2025-09-07T07:33:27.8841588Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8841731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8841774Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8841812Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8841967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8842012Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8843455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8843584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8843624Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8843661Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8843827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8843880Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8843920Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8844056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8844105Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8844147Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8844331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8844380Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8844418Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8844577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8844617Z t = dispatch_trace( 2025-09-07T07:33:27.8844652Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8844766Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8844809Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8844846Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8844969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8845009Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8845044Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8846537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8846619Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8846662Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8846852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8846891Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8846926Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8847054Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8847097Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8847133Z ^^^^^^^^^ 2025-09-07T07:33:27.8847280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8847333Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8847367Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8847410Z File "", line 1, in 2025-09-07T07:33:27.8847551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8847670Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8847718Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8847853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8847902Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8847940Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8848130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8848189Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8849559Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8849733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8849780Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8849818Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8849961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8850005Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8850042Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8850176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8850264Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8850330Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8850456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8850516Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8850561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8850688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8850727Z leaves = list(leaves) 2025-09-07T07:33:27.8850762Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8850884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8850919Z return func(x) 2025-09-07T07:33:27.8850953Z ^^^^^^^ 2025-09-07T07:33:27.8851091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8851158Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8851200Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8852684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8852728Z return func(*args, **kwargs) 2025-09-07T07:33:27.8852766Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8852945Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8853031Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8853034Z 2025-09-07T07:33:27.8853307Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8853310Z 2025-09-07T07:33:27.8853312Z 2025-09-07T07:33:27.8853387Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8853595Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8853597Z 2025-09-07T07:33:27.8853708Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8853800Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8853836Z inline_call [] 2025-09-07T07:33:27.8853893Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8853928Z inductor [] 2025-09-07T07:33:27.8854002Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8854075Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8854347Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8854464Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8854515Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8854666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8854754Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8854884Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8856339Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8856464Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8856546Z Traceback (most recent call last): 2025-09-07T07:33:27.8856707Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8856743Z self._run_test( 2025-09-07T07:33:27.8856857Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8856915Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8856956Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8857091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8857136Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8857177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8857327Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8857374Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8857415Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8857551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8857596Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8857634Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8857777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8857859Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8857898Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8858049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8858095Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8859569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8859629Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8859672Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8859816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8859887Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8859943Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8860060Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8860126Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8860174Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8860299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8860364Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8860421Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8860560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8860607Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8860644Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8860784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8860823Z return aot_autograd( 2025-09-07T07:33:27.8860859Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8860996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8861066Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8861112Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8862605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8862691Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8862738Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8862920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8862965Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8863219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8863260Z fx_g = _create_graph( 2025-09-07T07:33:27.8863296Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8863457Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8863494Z fx_g = make_fx( 2025-09-07T07:33:27.8863528Z ^^^^^^^^ 2025-09-07T07:33:27.8863678Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8863725Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8863763Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8863912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8863954Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8863992Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8864150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8864189Z t = dispatch_trace( 2025-09-07T07:33:27.8864223Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8864335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8864380Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8865742Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8865870Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8865910Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8865973Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8866157Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8866237Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8866279Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8866403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8866442Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8866479Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8866622Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8866665Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8866700Z ^^^^^^^^^ 2025-09-07T07:33:27.8866834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8866876Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8866912Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8867059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8867110Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8867144Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8867300Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8867377Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8868749Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8868926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8868966Z outs_pair = fn(*args) 2025-09-07T07:33:27.8869002Z ^^^^^^^^^ 2025-09-07T07:33:27.8869175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8869242Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8869287Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8869461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8869500Z outs_pair = fn(*args) 2025-09-07T07:33:27.8869536Z ^^^^^^^^^ 2025-09-07T07:33:27.8869712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8869773Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8869816Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8870010Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8870082Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8870128Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8870298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8870338Z outs_pair = fn(*args) 2025-09-07T07:33:27.8870373Z ^^^^^^^^^ 2025-09-07T07:33:27.8870562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8870607Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8870645Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8872143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8872209Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8872247Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8872373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8872416Z return handle_torch_function( 2025-09-07T07:33:27.8872453Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8872593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8872682Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8872729Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8872895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8872938Z return func(*args, **kwargs) 2025-09-07T07:33:27.8872975Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8873161Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8873205Z result = _engine_run_backward( 2025-09-07T07:33:27.8873240Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8873385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8873505Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8873577Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8873708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8873749Z return user_fn(self, *args) 2025-09-07T07:33:27.8873788Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8873932Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8875333Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8875371Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8875529Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8875572Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8875610Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8875734Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8875775Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8875811Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8875979Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8876031Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8876072Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8876207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8876258Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8876298Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8876461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8876511Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8876551Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8876708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8876746Z t = dispatch_trace( 2025-09-07T07:33:27.8876806Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8876935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8878302Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8878341Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8878465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8878505Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8878541Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8878720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8878802Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8878843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8878967Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8879008Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8879044Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8879170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8879214Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8879249Z ^^^^^^^^^ 2025-09-07T07:33:27.8879397Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8879446Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8879494Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8879538Z File "", line 1, in 2025-09-07T07:33:27.8879680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8879759Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8879807Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8879943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8881315Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8881356Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8881549Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8881592Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8881630Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8881800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8881845Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8881882Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8882027Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8882071Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8882107Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8882241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8882329Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8882375Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8882503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8882565Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8882608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8882753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8882807Z leaves = list(leaves) 2025-09-07T07:33:27.8882842Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8882963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8884387Z return func(x) 2025-09-07T07:33:27.8884423Z ^^^^^^^ 2025-09-07T07:33:27.8884563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8884628Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8884671Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8884862Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8884905Z return func(*args, **kwargs) 2025-09-07T07:33:27.8884941Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8885122Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8885209Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8885211Z 2025-09-07T07:33:27.8885416Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8885418Z 2025-09-07T07:33:27.8885420Z 2025-09-07T07:33:27.8885492Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8885717Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8885720Z 2025-09-07T07:33:27.8885804Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8885879Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8885915Z inline_call [] 2025-09-07T07:33:27.8885972Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8886007Z inductor [] 2025-09-07T07:33:27.8886082Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8886154Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8886409Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8886525Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8887990Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8888144Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8888232Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8888365Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8888484Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8888555Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8888590Z inline_call [] 2025-09-07T07:33:27.8888645Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8888719Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8888790Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8889045Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8889186Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8889252Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8889400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8889486Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8889616Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8889734Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8889799Z =================================== FAILURES =================================== 2025-09-07T07:33:27.8889920Z _ WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True _ 2025-09-07T07:33:27.8889965Z Traceback (most recent call last): 2025-09-07T07:33:27.8890125Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1441, in test_while_loop_with_unbacked_symint_closure 2025-09-07T07:33:27.8891491Z self._run_test( 2025-09-07T07:33:27.8891606Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1171, in _run_test 2025-09-07T07:33:27.8891663Z result_compiled = compiled_fn(*cloned_inputs2) 2025-09-07T07:33:27.8891704Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8891837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 414, in __call__ 2025-09-07T07:33:27.8891904Z return super().__call__(*args, **kwargs) 2025-09-07T07:33:27.8891948Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8892098Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1775, in _wrapped_call_impl 2025-09-07T07:33:27.8892145Z return self._call_impl(*args, **kwargs) 2025-09-07T07:33:27.8892186Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8892323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1786, in _call_impl 2025-09-07T07:33:27.8892367Z return forward_call(*args, **kwargs) 2025-09-07T07:33:27.8892406Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8892548Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 845, in compile_wrapper 2025-09-07T07:33:27.8892629Z raise e.remove_dynamo_frames() from None # see TORCHDYNAMO_VERBOSE=1 2025-09-07T07:33:27.8892668Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8892822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2196, in _call_user_compiler 2025-09-07T07:33:27.8892867Z raise BackendCompilerFailed( 2025-09-07T07:33:27.8893017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/output_graph.py", line 2171, in _call_user_compiler 2025-09-07T07:33:27.8893136Z compiled_fn = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8893179Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8893322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/repro/after_dynamo.py", line 156, in __call__ 2025-09-07T07:33:27.8894706Z compiled_gm = compiler_fn(gm, example_inputs) 2025-09-07T07:33:27.8894747Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8894864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/__init__.py", line 2425, in __call__ 2025-09-07T07:33:27.8894932Z return self.compiler_fn(model_, inputs_, **self.kwargs) 2025-09-07T07:33:27.8894979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8895104Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/testing.py", line 267, in __call__ 2025-09-07T07:33:27.8895168Z return lookup_backend(self.backend)(gm, example_inputs) 2025-09-07T07:33:27.8895232Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8895389Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/inductor.py", line 31, in inductor 2025-09-07T07:33:27.8895434Z return compile_fx(*args, **kwargs) 2025-09-07T07:33:27.8895472Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8895609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/compile_fx.py", line 2681, in compile_fx 2025-09-07T07:33:27.8895648Z return aot_autograd( 2025-09-07T07:33:27.8895685Z ^^^^^^^^^^^^^ 2025-09-07T07:33:27.8895841Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/backends/common.py", line 117, in __call__ 2025-09-07T07:33:27.8895914Z cg = aot_module_simplified(gm, example_inputs, **self.kwargs) 2025-09-07T07:33:27.8895960Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8896124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/aot_autograd.py", line 1105, in aot_module_simplified 2025-09-07T07:33:27.8896208Z aot_graph_capture = aot_stage1_graph_capture(aot_state, functional_call) 2025-09-07T07:33:27.8896255Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8896435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_compile.py", line 161, in aot_stage1_graph_capture 2025-09-07T07:33:27.8897801Z aot_dispatch_autograd_graph( 2025-09-07T07:33:27.8897990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 436, in aot_dispatch_autograd_graph 2025-09-07T07:33:27.8898056Z fx_g = _create_graph( 2025-09-07T07:33:27.8898091Z ^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8898253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 82, in _create_graph 2025-09-07T07:33:27.8898288Z fx_g = make_fx( 2025-09-07T07:33:27.8898323Z ^^^^^^^^ 2025-09-07T07:33:27.8898474Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2429, in wrapped 2025-09-07T07:33:27.8898521Z return make_fx_tracer.trace(f, *args) 2025-09-07T07:33:27.8898561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8898707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2356, in trace 2025-09-07T07:33:27.8898750Z return self._trace_inner(f, *args) 2025-09-07T07:33:27.8898788Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8898947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8898986Z t = dispatch_trace( 2025-09-07T07:33:27.8899020Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8899131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8899176Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8899213Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8899337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8899377Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8899415Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8900892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8900974Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8901018Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8901143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8901181Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8901218Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8901360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8901416Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8901451Z ^^^^^^^^^ 2025-09-07T07:33:27.8901584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 721, in flatten_fn 2025-09-07T07:33:27.8901625Z tree_out = root_fn(*tree_args) 2025-09-07T07:33:27.8901662Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8901808Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8901872Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8901907Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8902063Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture.py", line 70, in inner_f 2025-09-07T07:33:27.8902124Z out, out_descs = call_and_expect_output_descs(f, args) 2025-09-07T07:33:27.8902172Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8902349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8902389Z outs_pair = fn(*args) 2025-09-07T07:33:27.8902424Z ^^^^^^^^^ 2025-09-07T07:33:27.8903990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1095, in inner_fn 2025-09-07T07:33:27.8904060Z outs, outs_descs = call_and_expect_output_descs(fn, args) 2025-09-07T07:33:27.8904134Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8904307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8904347Z outs_pair = fn(*args) 2025-09-07T07:33:27.8904381Z ^^^^^^^^^ 2025-09-07T07:33:27.8904565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 1043, in joint_helper 2025-09-07T07:33:27.8904626Z return _functionalized_f_helper(primals, tangents) 2025-09-07T07:33:27.8904669Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8904861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 801, in _functionalized_f_helper 2025-09-07T07:33:27.8904932Z f_outs, f_outs_descs = call_and_expect_output_descs(fn, f_args) 2025-09-07T07:33:27.8904980Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8905152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/utils.py", line 549, in call_and_expect_output_descs 2025-09-07T07:33:27.8905192Z outs_pair = fn(*args) 2025-09-07T07:33:27.8905226Z ^^^^^^^^^ 2025-09-07T07:33:27.8905416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8905463Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8905501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8905668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 396, in inner_fn 2025-09-07T07:33:27.8905717Z backward_out = torch.autograd.grad( 2025-09-07T07:33:27.8905754Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8905884Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 452, in grad 2025-09-07T07:33:27.8907253Z return handle_torch_function( 2025-09-07T07:33:27.8907292Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8907435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/overrides.py", line 1728, in handle_torch_function 2025-09-07T07:33:27.8907531Z result = mode.__torch_function__(public_api, types, args, kwargs) 2025-09-07T07:33:27.8907592Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8907759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8907800Z return func(*args, **kwargs) 2025-09-07T07:33:27.8907837Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8907960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/__init__.py", line 503, in grad 2025-09-07T07:33:27.8908004Z result = _engine_run_backward( 2025-09-07T07:33:27.8908059Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8908207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py", line 841, in _engine_run_backward 2025-09-07T07:33:27.8908326Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8908376Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8908503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/function.py", line 315, in apply 2025-09-07T07:33:27.8908546Z return user_fn(self, *args) 2025-09-07T07:33:27.8908582Z ^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8908726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 876, in backward 2025-09-07T07:33:27.8908771Z body_gm = materialize_as_graph( 2025-09-07T07:33:27.8908829Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8908987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1155, in materialize_as_graph 2025-09-07T07:33:27.8909030Z gm = _materialize_as_graph_inner() 2025-09-07T07:33:27.8910395Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8910521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8910564Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8910599Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8910763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 1153, in _materialize_as_graph_inner 2025-09-07T07:33:27.8910815Z return _maybe_reenter_make_fx(fn)(*unfunc_t) 2025-09-07T07:33:27.8910856Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8910991Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 124, in wrapped 2025-09-07T07:33:27.8911043Z gm = _CURRENT_MAKE_FX_TRACER.trace_subgraph( 2025-09-07T07:33:27.8911081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8911241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2374, in trace_subgraph 2025-09-07T07:33:27.8911289Z return sub_tracer._trace_inner(f, *args) 2025-09-07T07:33:27.8911331Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8911487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 2318, in _trace_inner 2025-09-07T07:33:27.8911526Z t = dispatch_trace( 2025-09-07T07:33:27.8911560Z ^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8911673Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_compile.py", line 53, in inner 2025-09-07T07:33:27.8911715Z return disable_fn(*args, **kwargs) 2025-09-07T07:33:27.8911751Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8911878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8911917Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8913323Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8913511Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1303, in dispatch_trace 2025-09-07T07:33:27.8913608Z graph = tracer.trace(root, concrete_args) # type: ignore[arg-type] 2025-09-07T07:33:27.8913650Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8913774Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/eval_frame.py", line 1044, in _fn 2025-09-07T07:33:27.8913813Z return fn(*args, **kwargs) 2025-09-07T07:33:27.8913850Z ^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8913975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/_symbolic_trace.py", line 868, in trace 2025-09-07T07:33:27.8914019Z (self.create_arg(fn(*args)),), 2025-09-07T07:33:27.8914073Z ^^^^^^^^^ 2025-09-07T07:33:27.8914225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1361, in wrapped 2025-09-07T07:33:27.8914274Z out = f(*tensors) # type:ignore[call-arg] 2025-09-07T07:33:27.8914309Z ^^^^^^^^^^^ 2025-09-07T07:33:27.8914351Z File "", line 1, in 2025-09-07T07:33:27.8914495Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 839, in body_fn 2025-09-07T07:33:27.8914573Z bw_body_fn(*selected_fw_carries, *additional_inputs, *grad_carries), 2025-09-07T07:33:27.8914620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8914755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 769, in flat_fn 2025-09-07T07:33:27.8914803Z grad_args = bw_fn(primals, tangents)[1] 2025-09-07T07:33:27.8914860Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8915052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 430, in inner_fn_with_anomaly 2025-09-07T07:33:27.8915096Z return inner_fn(primals, tangents) 2025-09-07T07:33:27.8916468Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8916643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_functorch/_aot_autograd/graph_capture_wrappers.py", line 289, in inner_fn 2025-09-07T07:33:27.8916688Z outs, tangent_mask = fn(*primals) 2025-09-07T07:33:27.8916726Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8916871Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 503, in fw_with_masks 2025-09-07T07:33:27.8916914Z fw_out = pytree.tree_map_only( 2025-09-07T07:33:27.8916951Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8917090Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1558, in tree_map_only 2025-09-07T07:33:27.8917177Z return tree_map(map_only(type_or_types_or_pred)(func), tree, is_leaf=is_leaf) 2025-09-07T07:33:27.8917224Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8917350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1376, in tree_map 2025-09-07T07:33:27.8917413Z return treespec.unflatten(map(func, *flat_args)) 2025-09-07T07:33:27.8917456Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8917583Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1193, in unflatten 2025-09-07T07:33:27.8917622Z leaves = list(leaves) 2025-09-07T07:33:27.8917658Z ^^^^^^^^^^^^ 2025-09-07T07:33:27.8917779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/utils/_pytree.py", line 1493, in wrapped 2025-09-07T07:33:27.8917816Z return func(x) 2025-09-07T07:33:27.8917848Z ^^^^^^^ 2025-09-07T07:33:27.8917986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/utils.py", line 504, in 2025-09-07T07:33:27.8918050Z torch.Tensor, lambda x: x.requires_grad_(True), fw_out 2025-09-07T07:33:27.8919399Z ^^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8919589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/fx/experimental/proxy_tensor.py", line 1409, in __torch_function__ 2025-09-07T07:33:27.8919646Z return func(*args, **kwargs) 2025-09-07T07:33:27.8919682Z ^^^^^^^^^^^^^^^^^^^^^ 2025-09-07T07:33:27.8919865Z torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8919950Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8919952Z 2025-09-07T07:33:27.8920173Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8920176Z 2025-09-07T07:33:27.8920178Z 2025-09-07T07:33:27.8920251Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8920459Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8920463Z 2025-09-07T07:33:27.8920547Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8920622Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8920657Z inline_call [] 2025-09-07T07:33:27.8920714Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8920749Z inductor [] 2025-09-07T07:33:27.8920822Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8920910Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8921168Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8921283Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8921335Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8921485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8921571Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8921701Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8923196Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8923272Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8923308Z inline_call [] 2025-09-07T07:33:27.8923365Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8923440Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8923511Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8923765Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8923877Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8923928Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8924080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8924167Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8924295Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8924413Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8924703Z ----------------------------- Captured stdout call ----------------------------- 2025-09-07T07:33:27.8924739Z inline_call [] 2025-09-07T07:33:27.8924794Z stats [('calls_captured', 16), ('unique_graphs', 1)] 2025-09-07T07:33:27.8924865Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('not_ok', 1)] 2025-09-07T07:33:27.8924934Z ----------------------------- Captured stderr call ----------------------------- 2025-09-07T07:33:27.8925186Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:841: UserWarning: Error detected in WhileLoopAutogradOpBackward. Traceback of forward call that caused the error: 2025-09-07T07:33:27.8925316Z File "/var/lib/jenkins/pytorch/test/inductor/test_control_flow.py", line 1020, in forward 2025-09-07T07:33:27.8925367Z return torch._higher_order_ops.while_loop( 2025-09-07T07:33:27.8926920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_higher_order_ops/while_loop.py", line 227, in while_loop 2025-09-07T07:33:27.8927011Z return while_loop_op(flat_cond_fn, flat_body_fn, tuple(flat_inputs), tuple()) 2025-09-07T07:33:27.8927141Z (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/python_anomaly_mode.cpp:122.) 2025-09-07T07:33:27.8927260Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-09-07T07:33:27.8927474Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-1a8f72f145988413.xml - 2025-09-07T07:33:27.8927534Z =========================== short test summary info ============================ 2025-09-07T07:33:27.8927933Z FAILED [0.7035s] inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True - torch._dynamo.exc.BackendCompilerFailed: backend='' raised: 2025-09-07T07:33:27.8928019Z RuntimeError: only Tensors of floating point dtype can require gradients 2025-09-07T07:33:27.8928022Z 2025-09-07T07:33:27.8928225Z Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo" 2025-09-07T07:33:27.8928228Z 2025-09-07T07:33:27.8928229Z 2025-09-07T07:33:27.8928302Z To execute this test, run the following from the base repo dir: 2025-09-07T07:33:27.8928507Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_control_flow.py WhileLoopTests.test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True 2025-09-07T07:33:27.8928510Z 2025-09-07T07:33:27.8928596Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-09-07T07:33:27.8928656Z !!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!! 2025-09-07T07:33:27.8928724Z ================== 1 failed, 220 deselected, 2 rerun in 2.69s ================== 2025-09-07T07:33:27.8928761Z Got exit code 1 2025-09-07T07:33:27.8928886Z Test failed consistently, continuing with the rest of the tests due to continue-through-error being set 2025-09-07T07:33:27.8929308Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T07:33:27.8929348Z import pkg_resources 2025-09-07T07:33:27.8929517Z Test results will be stored in test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-84ce0dabfd55fe42.xml 2025-09-07T07:33:27.8929575Z ============================= test session starts ============================== 2025-09-07T07:33:27.8929687Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T07:33:27.8931052Z cachedir: .pytest_cache 2025-09-07T07:33:27.8931230Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T07:33:27.8931291Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T07:33:27.8931330Z configfile: pytest.ini 2025-09-07T07:33:27.8931491Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T07:33:27.8931566Z collecting ... collected 467 items / 69 deselected / 398 selected 2025-09-07T07:33:27.8931617Z stepcurrent: skipping 69 already run items. 2025-09-07T07:33:27.8931661Z Running 152 items in this shard 2025-09-07T07:33:27.8931663Z 2025-09-07T07:33:27.8931833Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_zero_loop_device_cuda_dynamic_False PASSED [2.2715s] [ 0%] 2025-09-07T07:33:27.8931975Z inductor/test_control_flow.py::WhileLoopTests::test_while_loop_zero_loop_device_cuda_dynamic_True PASSED [2.6098s] [ 1%] 2025-09-07T07:33:27.8932170Z inductor/test_control_flow.py::AssociativeScanTests::test_associative_scan_CUDA_flip_combine_mode_generic_backend_inductor_device_cuda SKIPPED [0.0002s] [ 1%] 2025-09-07T07:33:27.8932332Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_False_dim_0_scan_length_5 PASSED [1.7211s] [ 2%] 2025-09-07T07:33:27.8932490Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_False_dim_1_scan_length_5 PASSED [1.7434s] [ 3%] 2025-09-07T07:33:27.8932646Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_1 PASSED [1.1792s] [ 3%] 2025-09-07T07:33:27.8932817Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_5 PASSED [1.5206s] [ 4%] 2025-09-07T07:33:27.8932972Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_False_reverse_True_dim_3_scan_length_1 PASSED [1.1714s] [ 5%] 2025-09-07T07:33:27.8933180Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_False_dim_0_scan_length_1 PASSED [2.1561s] [ 5%] 2025-09-07T07:33:27.8933337Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_5 PASSED [2.6860s] [ 6%] 2025-09-07T07:33:27.8933495Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_1 PASSED [1.7963s] [ 7%] 2025-09-07T07:33:27.8933650Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_1 PASSED [2.1951s] [ 7%] 2025-09-07T07:33:27.8933808Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_5 PASSED [2.7963s] [ 8%] 2025-09-07T07:33:27.8933967Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_1 PASSED [2.2355s] [ 9%] 2025-09-07T07:33:27.8935470Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_1_scan_length_1 PASSED [1.5160s] [ 9%] 2025-09-07T07:33:27.8935630Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_1 PASSED [1.4078s] [ 10%] 2025-09-07T07:33:27.8935789Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_5 PASSED [1.9221s] [ 11%] 2025-09-07T07:33:27.8935945Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_1 PASSED [1.3865s] [ 11%] 2025-09-07T07:33:27.8936105Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_5 PASSED [2.2963s] [ 12%] 2025-09-07T07:33:27.8936264Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_False_dim_0_scan_length_1 PASSED [2.0628s] [ 13%] 2025-09-07T07:33:27.8936462Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_False_dim_3_scan_length_1 PASSED [1.9968s] [ 13%] 2025-09-07T07:33:27.8936623Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_False_dim_3_scan_length_5 PASSED [3.6144s] [ 14%] 2025-09-07T07:33:27.8936780Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_True_dim_1_scan_length_1 PASSED [2.0533s] [ 15%] 2025-09-07T07:33:27.8936936Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_True_dim_3_scan_length_1 PASSED [2.0520s] [ 15%] 2025-09-07T07:33:27.8937116Z inductor/test_control_flow.py::ScanTests::test_cond_in_scan_device_cuda_dynamic_True_reverse_True_dim_3_scan_length_5 PASSED [3.8929s] [ 16%] 2025-09-07T07:33:27.8937267Z inductor/test_control_flow.py::ScanTests::test_scan_compare_chunked_ce_with_no_scan_device_cpu_dynamic_False PASSED [3.8112s] [ 17%] 2025-09-07T07:33:27.8937418Z inductor/test_control_flow.py::ScanTests::test_scan_compare_chunked_ce_with_no_scan_device_cuda_dynamic_True PASSED [6.7202s] [ 17%] 2025-09-07T07:33:27.8937667Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_0_scan_length_1 [W907 07:29:55.691467072 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8937773Z [W907 07:29:55.722900769 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8937874Z [W907 07:29:55.735274556 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8937993Z [W907 07:29:55.752363175 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8938091Z [W907 07:29:55.767057028 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8938192Z [W907 07:29:55.240467135 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8938292Z [W907 07:29:55.619080193 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8938331Z PASSED [0.9774s] [ 18%] 2025-09-07T07:33:27.8939900Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_1_scan_length_1 [W907 07:29:56.689740930 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940000Z [W907 07:29:56.708234729 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940099Z [W907 07:29:56.727529378 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940197Z [W907 07:29:56.745045743 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940295Z [W907 07:29:56.213965742 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940392Z [W907 07:29:56.579548562 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940431Z PASSED [0.9556s] [ 19%] 2025-09-07T07:33:27.8940672Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_1_scan_length_5 [W907 07:29:56.646960355 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940769Z [W907 07:29:56.661376022 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940866Z [W907 07:29:56.680081750 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8940966Z [W907 07:29:57.694037343 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941063Z [W907 07:29:57.711029054 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941160Z [W907 07:29:57.728029755 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941275Z [W907 07:29:57.745280544 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941390Z [W907 07:29:57.762043208 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941487Z [W907 07:29:57.779032719 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941584Z [W907 07:29:57.797845054 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941680Z [W907 07:29:57.814025937 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941790Z [W907 07:29:57.830465986 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941887Z [W907 07:29:57.290761136 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8941984Z [W907 07:29:57.300046536 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8943454Z [W907 07:29:57.317026807 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8943555Z [W907 07:29:57.334020608 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8943652Z [W907 07:29:57.350020513 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8943751Z [W907 07:29:58.762093971 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8943851Z [W907 07:29:58.774023983 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8943975Z [W907 07:29:58.791013445 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944072Z [W907 07:29:58.807017229 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944168Z [W907 07:29:58.821017132 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944206Z PASSED [1.2454s] [ 19%] 2025-09-07T07:33:27.8944449Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_False_dim_3_scan_length_1 [W907 07:29:58.892939991 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944546Z [W907 07:29:58.905102731 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944643Z [W907 07:29:58.924956352 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944739Z [W907 07:29:58.941943533 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944838Z [W907 07:29:58.397993882 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944935Z [W907 07:29:59.751648882 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8944972Z PASSED [0.9235s] [ 20%] 2025-09-07T07:33:27.8945211Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_1 [W907 07:29:59.815360237 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8945311Z [W907 07:29:59.826086676 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8945407Z [W907 07:29:59.840132208 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8945505Z [W907 07:29:59.854032172 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8945603Z [W907 07:29:59.311908227 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947030Z [W907 07:29:59.675570205 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947068Z PASSED [0.9259s] [ 21%] 2025-09-07T07:33:27.8947333Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_False_reverse_True_dim_1_scan_length_1 [W907 07:30:00.743367803 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947448Z [W907 07:30:00.755100227 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947546Z [W907 07:30:00.771163871 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947642Z [W907 07:30:00.787037679 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947740Z [W907 07:30:00.244812175 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947857Z [W907 07:30:00.607622255 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8947895Z PASSED [0.9305s] [ 21%] 2025-09-07T07:33:27.8948135Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_0_scan_length_1 [W907 07:30:00.672809439 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8948234Z [W907 07:30:01.683070495 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8948330Z [W907 07:30:01.697097927 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8948427Z [W907 07:30:01.710024916 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8948523Z [W907 07:30:01.645860251 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8948620Z [W907 07:30:02.042798823 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8948669Z PASSED [1.4298s] [ 22%] 2025-09-07T07:33:27.8948908Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_0_scan_length_5 [W907 07:30:02.105770427 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8949006Z [W907 07:30:02.118086114 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8949104Z [W907 07:30:02.131057341 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8949201Z [W907 07:30:02.147941014 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8949298Z [W907 07:30:02.169033528 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8949394Z [W907 07:30:02.183023101 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8950813Z [W907 07:30:02.199087926 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8950915Z [W907 07:30:02.217027203 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951013Z [W907 07:30:02.234211192 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951112Z [W907 07:30:02.246037946 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951210Z [W907 07:30:02.260025059 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951306Z [W907 07:30:02.276020354 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951403Z [W907 07:30:03.202110578 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951499Z [W907 07:30:03.213038224 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951596Z [W907 07:30:03.226018621 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951693Z [W907 07:30:03.241016030 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951790Z [W907 07:30:03.256932226 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8951905Z [W907 07:30:04.171825387 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952023Z [W907 07:30:04.185035401 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952119Z [W907 07:30:04.200014141 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952218Z [W907 07:30:04.216014276 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952314Z [W907 07:30:04.230009039 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952352Z PASSED [2.1903s] [ 23%] 2025-09-07T07:33:27.8952606Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_1 [W907 07:30:04.298315390 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952705Z [W907 07:30:04.310073415 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952802Z [W907 07:30:04.327106735 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8952900Z [W907 07:30:04.342026725 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8954385Z [W907 07:30:06.802620296 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8954488Z [W907 07:30:06.219435657 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8954524Z PASSED [1.9870s] [ 23%] 2025-09-07T07:33:27.8954765Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_False_dim_3_scan_length_1 [W907 07:30:06.286833709 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8954889Z [W907 07:30:06.297101715 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8954986Z [W907 07:30:06.311152737 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955085Z [W907 07:30:06.325030183 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955184Z [W907 07:30:07.258093178 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955282Z [W907 07:30:07.667629562 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955319Z PASSED [1.4460s] [ 24%] 2025-09-07T07:33:27.8955555Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_1 [W907 07:30:08.733407417 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955654Z [W907 07:30:08.746094599 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955750Z [W907 07:30:08.760159221 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955848Z [W907 07:30:08.777030534 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8955946Z [W907 07:30:09.702459396 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8956043Z [W907 07:30:09.099784852 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8956079Z PASSED [1.4304s] [ 25%] 2025-09-07T07:33:27.8956315Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_5 [W907 07:30:09.163791002 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8956414Z [W907 07:30:09.178015151 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8956511Z [W907 07:30:09.195042202 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8956607Z [W907 07:30:09.208034669 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958051Z [W907 07:30:09.225384786 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958170Z [W907 07:30:09.242030732 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958268Z [W907 07:30:09.260095958 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958366Z [W907 07:30:09.272030611 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958463Z [W907 07:30:09.288026915 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958578Z [W907 07:30:09.302033829 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958676Z [W907 07:30:09.316029492 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958772Z [W907 07:30:09.337803546 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958871Z [W907 07:30:10.331090705 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8958968Z [W907 07:30:10.343044606 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959067Z [W907 07:30:10.357022849 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959164Z [W907 07:30:10.372028329 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959263Z [W907 07:30:10.390024806 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959376Z [W907 07:30:11.308505075 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959474Z [W907 07:30:11.323032972 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959570Z [W907 07:30:11.338017101 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959668Z [W907 07:30:11.357922741 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959765Z [W907 07:30:11.372019423 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8959801Z PASSED [2.2772s] [ 25%] 2025-09-07T07:33:27.8960037Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_1 [W907 07:30:11.443793794 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8960135Z [W907 07:30:11.456100111 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8960234Z [W907 07:30:11.475084255 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8961654Z [W907 07:30:11.491985727 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8961754Z [W907 07:30:12.413417875 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8961853Z [W907 07:30:13.827303498 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8961891Z PASSED [1.4486s] [ 26%] 2025-09-07T07:33:27.8962136Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_1 [W907 07:30:13.903099823 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8962233Z [W907 07:30:13.984864104 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8962330Z [W907 07:30:13.985317727 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8962428Z [W907 07:30:13.985393286 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8962526Z [W907 07:30:13.529260672 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8962639Z [W907 07:30:14.714638147 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8962690Z PASSED [0.8818s] [ 26%] 2025-09-07T07:33:27.8962934Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_5 [W907 07:30:14.777560431 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963032Z [W907 07:30:14.777783389 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963221Z [W907 07:30:14.777885447 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963341Z [W907 07:30:14.777946367 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963438Z [W907 07:30:14.778013866 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963536Z [W907 07:30:14.778069195 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963635Z [W907 07:30:14.778174023 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963732Z [W907 07:30:14.778223503 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963830Z [W907 07:30:14.778263672 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8963926Z [W907 07:30:14.778300961 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8965358Z [W907 07:30:14.778337951 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8965482Z [W907 07:30:14.778375520 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8965579Z [W907 07:30:14.320929354 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8965677Z [W907 07:30:14.332044157 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8965774Z [W907 07:30:14.332156176 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8965874Z [W907 07:30:14.332211395 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8965971Z [W907 07:30:14.332252585 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966068Z [W907 07:30:15.760644013 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966164Z [W907 07:30:15.760931780 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966263Z [W907 07:30:15.760966700 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966360Z [W907 07:30:15.760996728 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966459Z [W907 07:30:15.761040319 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966496Z PASSED [1.0527s] [ 27%] 2025-09-07T07:33:27.8966796Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_1_scan_length_1 [W907 07:30:15.833863875 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966894Z [W907 07:30:15.834122941 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8966991Z [W907 07:30:15.834286479 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8967088Z [W907 07:30:15.834338338 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8967186Z [W907 07:30:15.362883489 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8967284Z [W907 07:30:15.522669873 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8967320Z PASSED [0.7530s] [ 28%] 2025-09-07T07:33:27.8967582Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_1 [W907 07:30:15.584715841 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969026Z [W907 07:30:15.584989277 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969128Z [W907 07:30:15.585172884 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969226Z [W907 07:30:15.585228013 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969325Z [W907 07:30:16.129994196 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969440Z [W907 07:30:16.294956928 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969477Z PASSED [0.7717s] [ 28%] 2025-09-07T07:33:27.8969719Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_5 [W907 07:30:16.360933950 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969818Z [W907 07:30:16.361279955 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8969916Z [W907 07:30:16.361399693 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970012Z [W907 07:30:16.361457773 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970109Z [W907 07:30:16.361508723 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970237Z [W907 07:30:16.361557731 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970334Z [W907 07:30:16.361722229 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970431Z [W907 07:30:16.361776559 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970528Z [W907 07:30:16.361815208 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970626Z [W907 07:30:16.361851627 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970723Z [W907 07:30:16.361888006 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970821Z [W907 07:30:16.361925426 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8970917Z [W907 07:30:17.057472800 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8971015Z [W907 07:30:17.067964682 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8971112Z [W907 07:30:17.068242189 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8971209Z [W907 07:30:17.068366216 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8972620Z [W907 07:30:17.068469886 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8972719Z [W907 07:30:18.049680804 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8972816Z [W907 07:30:18.059744723 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8972913Z [W907 07:30:18.059925930 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973009Z [W907 07:30:18.060031278 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973172Z [W907 07:30:18.060066598 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973210Z PASSED [1.7631s] [ 29%] 2025-09-07T07:33:27.8973452Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_False_reverse_True_dim_3_scan_length_1 [W907 07:30:18.122388502 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973578Z [W907 07:30:18.122698408 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973695Z [W907 07:30:18.122928854 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973791Z [W907 07:30:18.122993593 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973888Z [W907 07:30:19.800936915 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8973984Z [W907 07:30:19.973851204 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8974022Z PASSED [0.9142s] [ 30%] 2025-09-07T07:33:27.8974276Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_False_dim_1_scan_length_1 [W907 07:30:19.037603098 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8974375Z [W907 07:30:19.037828365 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8974472Z [W907 07:30:19.038046701 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8974569Z [W907 07:30:19.038114140 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8974665Z [W907 07:30:20.052580211 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8974762Z [W907 07:30:20.252778038 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8974798Z PASSED [1.2771s] [ 30%] 2025-09-07T07:33:27.8976385Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_False_dim_3_scan_length_5 [W907 07:30:20.315748912 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8976487Z [W907 07:30:20.315961500 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8976586Z [W907 07:30:20.316080279 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8976686Z [W907 07:30:20.316142538 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8976784Z [W907 07:30:20.316198857 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8976881Z [W907 07:30:20.316251416 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8976978Z [W907 07:30:20.316359044 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977076Z [W907 07:30:20.316420643 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977174Z [W907 07:30:20.316463842 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977270Z [W907 07:30:20.316504602 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977368Z [W907 07:30:20.316543992 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977465Z [W907 07:30:20.316582520 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977562Z [W907 07:30:21.380184682 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977661Z [W907 07:30:21.397888062 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977759Z [W907 07:30:21.398104429 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977857Z [W907 07:30:21.398168948 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8977955Z [W907 07:30:21.398227348 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8978053Z [W907 07:30:22.349236890 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8978166Z [W907 07:30:22.349554537 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8978278Z [W907 07:30:22.349592276 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8978376Z [W907 07:30:22.349623525 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8978472Z [W907 07:30:22.349666924 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8979824Z PASSED [2.1028s] [ 31%] 2025-09-07T07:33:27.8980080Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_True_dim_0_scan_length_5 [W907 07:30:22.420633537 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980181Z [W907 07:30:22.420940053 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980277Z [W907 07:30:22.421066721 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980376Z [W907 07:30:22.421128280 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980474Z [W907 07:30:22.421180069 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980572Z [W907 07:30:22.421227709 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980668Z [W907 07:30:22.421381506 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980765Z [W907 07:30:22.421435436 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980876Z [W907 07:30:22.421474715 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8980974Z [W907 07:30:22.421512374 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981070Z [W907 07:30:22.421549224 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981169Z [W907 07:30:22.421585683 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981266Z [W907 07:30:23.614760493 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981364Z [W907 07:30:23.625093198 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981459Z [W907 07:30:23.625336694 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981556Z [W907 07:30:23.625390183 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981654Z [W907 07:30:23.625433913 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981752Z [W907 07:30:24.527567772 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981848Z [W907 07:30:24.536670515 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8981946Z [W907 07:30:24.536741644 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8983437Z [W907 07:30:24.536776063 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8983539Z [W907 07:30:24.536807423 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8983575Z PASSED [2.1776s] [ 32%] 2025-09-07T07:33:27.8983814Z inductor/test_control_flow.py::ScanTests::test_scan_conv_device_cuda_dynamic_True_reverse_True_dim_3_scan_length_5 [W907 07:30:24.599775768 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8983913Z [W907 07:30:24.600112423 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984011Z [W907 07:30:24.600234982 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984134Z [W907 07:30:24.600294310 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984249Z [W907 07:30:24.600346009 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984345Z [W907 07:30:24.600403529 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984442Z [W907 07:30:24.600561806 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984538Z [W907 07:30:24.600616076 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984638Z [W907 07:30:24.600654005 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984754Z [W907 07:30:24.600690164 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984852Z [W907 07:30:24.600727675 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8984951Z [W907 07:30:24.600764263 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8985051Z [W907 07:30:26.767470325 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8985147Z [W907 07:30:26.777814489 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8985244Z [W907 07:30:26.777975607 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8985340Z [W907 07:30:26.778117225 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8985437Z [W907 07:30:26.778238113 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8985552Z [W907 07:30:27.714632292 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8986979Z [W907 07:30:27.723885212 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8987080Z [W907 07:30:27.723956731 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8987179Z [W907 07:30:27.723990631 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8987275Z [W907 07:30:27.724037680 NNPACK.cpp:56] Could not initialize NNPACK! Reason: Unsupported hardware. 2025-09-07T07:33:27.8987315Z PASSED [2.1858s] [ 32%] 2025-09-07T07:33:27.8987495Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_0_pred_False_scan_length_1 PASSED [1.4790s] [ 33%] 2025-09-07T07:33:27.8987668Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_0_pred_True_scan_length_1 PASSED [2.0644s] [ 34%] 2025-09-07T07:33:27.8987840Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_0_pred_True_scan_length_5 PASSED [1.7322s] [ 34%] 2025-09-07T07:33:27.8988013Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_1_pred_False_scan_length_1 PASSED [1.5294s] [ 35%] 2025-09-07T07:33:27.8988183Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_1_pred_True_scan_length_1 PASSED [1.4796s] [ 36%] 2025-09-07T07:33:27.8988352Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_False_dim_3_pred_True_scan_length_5 PASSED [1.7369s] [ 36%] 2025-09-07T07:33:27.8988520Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_0_pred_False_scan_length_1 PASSED [2.1225s] [ 37%] 2025-09-07T07:33:27.8988691Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_0_pred_False_scan_length_5 PASSED [1.7015s] [ 38%] 2025-09-07T07:33:27.8988858Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_1_pred_False_scan_length_1 PASSED [1.4653s] [ 38%] 2025-09-07T07:33:27.8989045Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_1_pred_False_scan_length_5 PASSED [1.7123s] [ 39%] 2025-09-07T07:33:27.8989229Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_1_pred_True_scan_length_5 PASSED [2.3521s] [ 40%] 2025-09-07T07:33:27.8989399Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_False_reverse_True_dim_3_pred_False_scan_length_1 PASSED [1.4876s] [ 40%] 2025-09-07T07:33:27.8989568Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_0_pred_True_scan_length_1 PASSED [1.4940s] [ 41%] 2025-09-07T07:33:27.8989751Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_0_pred_True_scan_length_5 PASSED [2.2368s] [ 42%] 2025-09-07T07:33:27.8989921Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_3_pred_False_scan_length_1 PASSED [1.5038s] [ 42%] 2025-09-07T07:33:27.8990091Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_3_pred_False_scan_length_5 PASSED [2.9258s] [ 43%] 2025-09-07T07:33:27.8991576Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_False_dim_3_pred_True_scan_length_5 PASSED [2.2441s] [ 44%] 2025-09-07T07:33:27.8991748Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_0_pred_False_scan_length_1 PASSED [1.5096s] [ 44%] 2025-09-07T07:33:27.8991915Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_0_pred_True_scan_length_5 PASSED [2.2805s] [ 45%] 2025-09-07T07:33:27.8992107Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_1_pred_False_scan_length_5 PASSED [2.8879s] [ 46%] 2025-09-07T07:33:27.8992277Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_1_pred_True_scan_length_1 PASSED [1.5683s] [ 46%] 2025-09-07T07:33:27.8992446Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cpu_dynamic_True_reverse_True_dim_3_pred_False_scan_length_5 PASSED [2.2035s] [ 47%] 2025-09-07T07:33:27.8992618Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_0_pred_True_scan_length_1 PASSED [1.4148s] [ 48%] 2025-09-07T07:33:27.8992789Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_0_pred_True_scan_length_5 PASSED [2.5198s] [ 48%] 2025-09-07T07:33:27.8992963Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_1_pred_False_scan_length_1 PASSED [1.4285s] [ 49%] 2025-09-07T07:33:27.8993195Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_1_pred_True_scan_length_5 PASSED [1.8214s] [ 50%] 2025-09-07T07:33:27.8993368Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_3_pred_False_scan_length_1 PASSED [1.4021s] [ 50%] 2025-09-07T07:33:27.8993539Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_False_dim_3_pred_True_scan_length_5 PASSED [1.8345s] [ 51%] 2025-09-07T07:33:27.8993708Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_False_scan_length_1 PASSED [2.1531s] [ 51%] 2025-09-07T07:33:27.8993877Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_False_scan_length_5 PASSED [1.8298s] [ 52%] 2025-09-07T07:33:27.8994052Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_True_scan_length_1 PASSED [1.3866s] [ 53%] 2025-09-07T07:33:27.8994242Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_0_pred_True_scan_length_5 PASSED [1.8889s] [ 53%] 2025-09-07T07:33:27.8994428Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_1_pred_False_scan_length_5 PASSED [1.8236s] [ 54%] 2025-09-07T07:33:27.8994596Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_1_pred_True_scan_length_5 PASSED [2.5944s] [ 55%] 2025-09-07T07:33:27.8994767Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_3_pred_False_scan_length_1 PASSED [1.4166s] [ 55%] 2025-09-07T07:33:27.8994950Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_False_reverse_True_dim_3_pred_True_scan_length_5 PASSED [1.8352s] [ 56%] 2025-09-07T07:33:27.8995120Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_0_pred_False_scan_length_1 PASSED [1.5458s] [ 57%] 2025-09-07T07:33:27.8996622Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_0_pred_True_scan_length_1 PASSED [1.4360s] [ 57%] 2025-09-07T07:33:27.8996796Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_1_pred_False_scan_length_5 PASSED [3.1810s] [ 58%] 2025-09-07T07:33:27.8996966Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_False_dim_1_pred_True_scan_length_5 PASSED [2.4174s] [ 59%] 2025-09-07T07:33:27.8997136Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_0_pred_False_scan_length_1 PASSED [1.4697s] [ 59%] 2025-09-07T07:33:27.8997326Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_0_pred_True_scan_length_1 PASSED [1.4408s] [ 60%] 2025-09-07T07:33:27.8997495Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_0_pred_True_scan_length_5 PASSED [2.4210s] [ 61%] 2025-09-07T07:33:27.8997665Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_1_pred_False_scan_length_1 PASSED [2.2077s] [ 61%] 2025-09-07T07:33:27.8997835Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_1_pred_False_scan_length_5 PASSED [2.3627s] [ 62%] 2025-09-07T07:33:27.8998004Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_1_pred_True_scan_length_5 PASSED [2.3725s] [ 63%] 2025-09-07T07:33:27.8998173Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_False_scan_length_1 PASSED [1.5102s] [ 63%] 2025-09-07T07:33:27.8998344Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_False_scan_length_5 PASSED [2.4059s] [ 64%] 2025-09-07T07:33:27.8998512Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_True_scan_length_1 PASSED [2.3113s] [ 65%] 2025-09-07T07:33:27.8998683Z inductor/test_control_flow.py::ScanTests::test_scan_in_cond_device_cuda_dynamic_True_reverse_True_dim_3_pred_True_scan_length_5 PASSED [2.3597s] [ 65%] 2025-09-07T07:33:27.8998847Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_False_dim_0_scan_length_5 PASSED [1.1206s] [ 66%] 2025-09-07T07:33:27.8999014Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_False_dim_3_scan_length_1 PASSED [0.9087s] [ 67%] 2025-09-07T07:33:27.8999176Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_False_dim_3_scan_length_5 PASSED [1.1183s] [ 67%] 2025-09-07T07:33:27.8999338Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_False_reverse_True_dim_0_scan_length_5 PASSED [1.2142s] [ 68%] 2025-09-07T07:33:27.8999510Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_1 PASSED [1.6122s] [ 69%] 2025-09-07T07:33:27.8999683Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_False_dim_1_scan_length_5 PASSED [2.2879s] [ 69%] 2025-09-07T07:33:27.8999843Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_False_dim_3_scan_length_5 PASSED [2.2439s] [ 70%] 2025-09-07T07:33:27.9000002Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_1 PASSED [2.4551s] [ 71%] 2025-09-07T07:33:27.9001496Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_True_dim_1_scan_length_5 PASSED [2.3056s] [ 71%] 2025-09-07T07:33:27.9001660Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cpu_dynamic_True_reverse_True_dim_3_scan_length_5 PASSED [2.2847s] [ 72%] 2025-09-07T07:33:27.9001826Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_False_dim_0_scan_length_1 PASSED [0.7814s] [ 73%] 2025-09-07T07:33:27.9001992Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_False_dim_1_scan_length_1 PASSED [0.7424s] [ 73%] 2025-09-07T07:33:27.9002159Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_False_dim_3_scan_length_1 PASSED [0.7803s] [ 74%] 2025-09-07T07:33:27.9002320Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_True_dim_0_scan_length_5 PASSED [1.1752s] [ 75%] 2025-09-07T07:33:27.9002496Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_True_dim_1_scan_length_1 PASSED [0.8111s] [ 75%] 2025-09-07T07:33:27.9002658Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_False_reverse_True_dim_3_scan_length_1 PASSED [0.7834s] [ 76%] 2025-09-07T07:33:27.9002821Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_False_dim_1_scan_length_1 PASSED [1.3790s] [ 76%] 2025-09-07T07:33:27.9002982Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_True_dim_0_scan_length_1 PASSED [1.3949s] [ 77%] 2025-09-07T07:33:27.9003193Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_True_dim_0_scan_length_5 PASSED [3.2698s] [ 78%] 2025-09-07T07:33:27.9003354Z inductor/test_control_flow.py::ScanTests::test_scan_nn_modules_device_cuda_dynamic_True_reverse_True_dim_1_scan_length_1 PASSED [1.4416s] [ 78%] 2025-09-07T07:33:27.9003509Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_False_reverse_False_dim_1 PASSED [1.2884s] [ 79%] 2025-09-07T07:33:27.9003658Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_False_reverse_False_dim_2 PASSED [1.1972s] [ 80%] 2025-09-07T07:33:27.9003810Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_False_reverse_True_dim_1 PASSED [1.2428s] [ 80%] 2025-09-07T07:33:27.9003959Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_True_reverse_False_dim_0 PASSED [1.8153s] [ 81%] 2025-09-07T07:33:27.9004108Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_True_reverse_False_dim_2 PASSED [1.7948s] [ 82%] 2025-09-07T07:33:27.9004255Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cpu_dynamic_True_reverse_True_dim_0 PASSED [1.9109s] [ 82%] 2025-09-07T07:33:27.9004410Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_False_reverse_False_dim_2 PASSED [1.3421s] [ 83%] 2025-09-07T07:33:27.9004557Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_False_reverse_True_dim_1 PASSED [2.2457s] [ 84%] 2025-09-07T07:33:27.9004731Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_False_reverse_True_dim_2 PASSED [1.3848s] [ 84%] 2025-09-07T07:33:27.9004898Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_True_reverse_False_dim_0 PASSED [1.9414s] [ 85%] 2025-09-07T07:33:27.9006397Z inductor/test_control_flow.py::ScanTests::test_scan_pytree_in_out_device_cuda_dynamic_True_reverse_False_dim_2 PASSED [1.8482s] [ 86%] 2025-09-07T07:33:27.9006527Z inductor/test_control_flow.py::ScanTests::test_scan_with_clamp_device_cpu_dynamic_False PASSED [0.9969s] [ 86%] 2025-09-07T07:33:27.9006652Z inductor/test_control_flow.py::ScanTests::test_scan_with_clamp_device_cpu_dynamic_True PASSED [2.1138s] [ 87%] 2025-09-07T07:33:27.9006891Z inductor/test_control_flow.py::MapTests::test_map_nested_with_cond_device_cpu_dynamic_True_autograd_True PASSED [2.3446s] [ 88%] 2025-09-07T07:33:27.9007040Z inductor/test_control_flow.py::MapTests::test_map_nested_with_cond_device_cuda_dynamic_False_autograd_True PASSED [1.1133s] [ 88%] 2025-09-07T07:33:27.9007188Z inductor/test_control_flow.py::MapTests::test_map_nested_with_cond_device_cuda_dynamic_True_autograd_False PASSED [2.3761s] [ 89%] 2025-09-07T07:33:27.9007331Z inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cpu_dynamic_False_autograd_True PASSED [1.3786s] [ 90%] 2025-09-07T07:33:27.9007471Z inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cpu_dynamic_True_autograd_False PASSED [2.0686s] [ 90%] 2025-09-07T07:33:27.9007613Z inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_False_autograd_False PASSED [0.9219s] [ 91%] 2025-09-07T07:33:27.9007780Z inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_False_autograd_True PASSED [1.2619s] [ 92%] 2025-09-07T07:33:27.9007921Z inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_True_autograd_False PASSED [2.2959s] [ 92%] 2025-09-07T07:33:27.9008062Z inductor/test_control_flow.py::MapTests::test_map_pytree_in_out_device_cuda_dynamic_True_autograd_True PASSED [2.1784s] [ 93%] 2025-09-07T07:33:27.9008198Z inductor/test_control_flow.py::MapTests::test_map_simple_device_cpu_dynamic_False_autograd_False PASSED [0.5719s] [ 94%] 2025-09-07T07:33:27.9008331Z inductor/test_control_flow.py::MapTests::test_map_simple_device_cpu_dynamic_True_autograd_True PASSED [1.0434s] [ 94%] 2025-09-07T07:33:27.9008468Z inductor/test_control_flow.py::MapTests::test_map_simple_device_cuda_dynamic_False_autograd_False PASSED [0.6667s] [ 95%] 2025-09-07T07:33:27.9008604Z inductor/test_control_flow.py::MapTests::test_map_simple_device_cuda_dynamic_False_autograd_True PASSED [0.8380s] [ 96%] 2025-09-07T07:33:27.9008762Z inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cpu_dynamic_False_autograd_False PASSED [0.5841s] [ 96%] 2025-09-07T07:33:27.9008916Z inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cpu_dynamic_True_autograd_False PASSED [3.0182s] [ 97%] 2025-09-07T07:33:27.9009068Z inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cpu_dynamic_True_autograd_True PASSED [1.7830s] [ 98%] 2025-09-07T07:33:27.9009224Z inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cuda_dynamic_False_autograd_False PASSED [0.7058s] [ 98%] 2025-09-07T07:33:27.9009377Z inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cuda_dynamic_False_autograd_True PASSED [1.2039s] [ 99%] 2025-09-07T07:33:27.9010852Z inductor/test_control_flow.py::MapTests::test_map_simple_linear_with_view_device_cuda_dynamic_True_autograd_False PASSED [2.1846s] [100%] 2025-09-07T07:33:27.9010856Z 2025-09-07T07:33:27.9011079Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_control_flow/inductor.test_control_flow-84ce0dabfd55fe42.xml - 2025-09-07T07:33:27.9011158Z ========== 151 passed, 1 skipped, 69 deselected in 269.48s (0:04:29) =========== 2025-09-07T07:33:27.9013875Z The following tests failed consistently: ['test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cpu_dynamic_True_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_nested_control_flow_device_cuda_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cpu_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_simple_control_flow_device_cuda_dynamic_True_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cpu_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_buffers_device_cuda_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cpu_dynamic_True_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_outer_code_device_cuda_dynamic_True_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_parameters_device_cuda_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_pytree_inputs_device_cpu_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_sym_expr_cond_device_cuda_dynamic_True_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_False_autograd_True', 'test/inductor/test_control_flow.py::WhileLoopTests::test_while_loop_with_unbacked_symint_closure_device_cuda_dynamic_True_autograd_True'] 2025-09-07T07:33:27.9013920Z 2025-09-07T07:33:27.9014084Z FINISHED PRINTING LOG FILE of inductor/test_control_flow 2/2 (test/test-reports/inductor.test_control_flow_2.2_02da08eb26b3c1e5_.log) 2025-09-07T07:33:27.9014086Z 2025-09-07T07:33:27.9014178Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T07:33:27.9014225Z Uploading artifacts took 0.00 seconds 2025-09-07T07:33:27.9014270Z inductor/test_control_flow 2/2 failed! 2025-09-07T07:33:27.9014350Z Running inductor/test_cpu_repro 5/5 ... [2025-09-07 07:33:27.339097] 2025-09-07T07:33:27.9014396Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:33:27.9014692Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_cpu_repro.py', '--shard-id=5', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:33:27.339344] 2025-09-07T07:40:47.2939126Z 2025-09-07T07:40:47.2941169Z inductor/test_cpu_repro 5/5 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cpu_repro_5.5_7198a71f381f52a4_.log 2025-09-07T07:40:47.2981162Z Running 149 items in this shard: test/inductor/test_cpu_repro.py::CPUReproTests::test_add_layernorm, test/inductor/test_cpu_repro.py::CPUReproTests::test_argmax_argmin_with_nan_value, test/inductor/test_cpu_repro.py::CPUReproTests::test_argmin, test/inductor/test_cpu_repro.py::CPUReproTests::test_auto_simd, test/inductor/test_cpu_repro.py::CPUReproTests::test_broadcast_mul_lowp_fp, test/inductor/test_cpu_repro.py::CPUReproTests::test_channel_shuffle_cl_output, test/inductor/test_cpu_repro.py::CPUReproTests::test_channels_last_view_as_complex, test/inductor/test_cpu_repro.py::CPUReproTests::test_concat_inner_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_convert_double_to_fp32_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_convert_fp32_to_double_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_cpu_vec_cosim, test/inductor/test_cpu_repro.py::CPUReproTests::test_decomposed_dequant_relu_quant_uint8, test/inductor/test_cpu_repro.py::CPUReproTests::test_dequant_maxpool2d_lowering_uint8, test/inductor/test_cpu_repro.py::CPUReproTests::test_dequant_quant_lowering_uint8, test/inductor/test_cpu_repro.py::CPUReproTests::test_disabled_amp_is_inference_True, test/inductor/test_cpu_repro.py::CPUReproTests::test_expr_vec_non_contiguous, test/inductor/test_cpu_repro.py::CPUReproTests::test_for_loop_collapsed, test/inductor/test_cpu_repro.py::CPUReproTests::test_fp8_cast_float16_shape_15,3,13, test/inductor/test_cpu_repro.py::CPUReproTests::test_fp8_cast_float16_shape_4,2048,4096, test/inductor/test_cpu_repro.py::CPUReproTests::test_fused_node, test/inductor/test_cpu_repro.py::CPUReproTests::test_group_norm_large_input, test/inductor/test_cpu_repro.py::CPUReproTests::test_group_norm_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_index_propagation_issue_102065, test/inductor/test_cpu_repro.py::CPUReproTests::test_index_put, test/inductor/test_cpu_repro.py::CPUReproTests::test_index_put2, test/inductor/test_cpu_repro.py::CPUReproTests::test_inplace_add_alpha, test/inductor/test_cpu_repro.py::CPUReproTests::test_int32_pointwise_vec, test/inductor/test_cpu_repro.py::CPUReproTests::test_int_div, test/inductor/test_cpu_repro.py::CPUReproTests::test_linear_float64, test/inductor/test_cpu_repro.py::CPUReproTests::test_linear_packed, test/inductor/test_cpu_repro.py::CPUReproTests::test_load_inf_bf16, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_False_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_1_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_False_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_False_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_1_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_False_empty_state_True_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_False_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_False_empty_state_False_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_False_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_1_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_False_batch_first_True_batch_size_7_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_False_batch_size_7_seq_len_1, test/inductor/test_cpu_repro.py::CPUReproTests::test_lstm_packed_unbatched_True_input_size_7_hidden_size_7_num_layers_7_bidirectional_True_bias_True_empty_state_True_batch_first_True_batch_size_1_seq_len_7, test/inductor/test_cpu_repro.py::CPUReproTests::test_maxpool2d_cpu_only, test/inductor/test_cpu_repro.py::CPUReproTests::test_non_contiguous_index_with_constant_stride, test/inductor/test_cpu_repro.py::CPUReproTests::test_non_contiguous_load_buf_quant_uint8, test/inductor/test_cpu_repro.py::CPUReproTests::test_non_contiguous_reduction_store, test/inductor/test_cpu_repro.py::CPUReproTests::test_parallel_reduction_vectorization, test/inductor/test_cpu_repro.py::CPUReproTests::test_per_channel_fake_quant_module_uint8, test/inductor/test_cpu_repro.py::CPUReproTests::test_per_tensor_fake_quant_int8, test/inductor/test_cpu_repro.py::CPUReproTests::test_pow_cos, test/inductor/test_cpu_repro.py::CPUReproTests::test_redundant_to_node_elimination_lowp_fp, test/inductor/test_cpu_repro.py::CPUReproTests::test_require_stride_order_non_owning, test/inductor/test_cpu_repro.py::CPUReproTests::test_scalar_mul_bfloat16, test/inductor/test_cpu_repro.py::CPUReproTests::test_share_local_buffers_in_outer_loop_fusion, test/inductor/test_cpu_repro.py::CPUReproTests::test_sign_cpu_only, test/inductor/test_cpu_repro.py::CPUReproTests::test_skip_cpp_codegen, test/inductor/test_cpu_repro.py::CPUReproTests::test_symbolic_shape_scalar_value_reduction, test/inductor/test_cpu_repro.py::CPUReproTests::test_timed_cpu_only, test/inductor/test_cpu_repro.py::CPUReproTests::test_to_channels_last_lowp_fp, test/inductor/test_cpu_repro.py::CPUReproTests::test_to_dtype_float_bool, test/inductor/test_cpu_repro.py::CPUReproTests::test_to_uint8_rounding_method, test/inductor/test_cpu_repro.py::CPUReproTests::test_transpose_with_norm, test/inductor/test_cpu_repro.py::CPUReproTests::test_vec_bitwise, test/inductor/test_cpu_repro.py::CPUReproTests::test_vec_randn, test/inductor/test_cpu_repro.py::CPUReproTests::test_view_dtype 2025-09-07T07:40:47.3010734Z 2025-09-07T07:40:47.3010826Z Running inductor/test_cudacodecache 1/1 ... [2025-09-07 07:40:47.293862] 2025-09-07T07:40:47.3011009Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:40:47.3011409Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_cudacodecache.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:40:47.294083] 2025-09-07T07:40:53.3379327Z 2025-09-07T07:40:53.3404277Z inductor/test_cudacodecache 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_cudacodecache_1.1_df3143fc38f02aa8_.log 2025-09-07T07:40:53.3404879Z 2025-09-07T07:40:53.3405445Z Running inductor/test_flex_decoding 2/2 ... [2025-09-07 07:40:53.337595] 2025-09-07T07:40:53.3406857Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:40:53.3407549Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_flex_decoding.py', '--shard-id=2', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:40:53.337862] 2025-09-07T07:49:55.5376088Z 2025-09-07T07:49:55.5384172Z inductor/test_flex_decoding 2/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_flex_decoding_2.2_a0851d96e064a8f7_.log 2025-09-07T07:49:55.5437492Z Running 294 items in this shard: test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod1_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod1_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod2_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod2_head_dims2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod3_head_dims2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod4_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod4_head_dims2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod5_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod5_head_dims2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod6_head_dims2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod7_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod7_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod7_head_dims2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod8_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_bfloat16_score_mod8_head_dims2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod0_BLOCK_SIZE2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod0_BLOCK_SIZE_128_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod1_BLOCK_SIZE_128_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod2_BLOCK_SIZE2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod2_BLOCK_SIZE_128_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod3_BLOCK_SIZE_128_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod3_BLOCK_SIZE_64_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod4_BLOCK_SIZE2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod4_BLOCK_SIZE3_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod4_BLOCK_SIZE_128_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod4_BLOCK_SIZE_64_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod5_BLOCK_SIZE2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod5_BLOCK_SIZE_64_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod6_BLOCK_SIZE2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod6_BLOCK_SIZE3_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod6_BLOCK_SIZE_128_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod6_BLOCK_SIZE_64_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod7_BLOCK_SIZE2_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod7_BLOCK_SIZE_64_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_bfloat16_score_mod8_BLOCK_SIZE_64_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod0_BLOCK_SIZE3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod0_BLOCK_SIZE_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod0_BLOCK_SIZE_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod1_BLOCK_SIZE2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod1_BLOCK_SIZE_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod2_BLOCK_SIZE2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod3_BLOCK_SIZE2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod3_BLOCK_SIZE_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod3_BLOCK_SIZE_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod4_BLOCK_SIZE3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod4_BLOCK_SIZE_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod5_BLOCK_SIZE2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod5_BLOCK_SIZE3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod5_BLOCK_SIZE_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod6_BLOCK_SIZE2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod6_BLOCK_SIZE3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod7_BLOCK_SIZE2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod7_BLOCK_SIZE3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod7_BLOCK_SIZE_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod8_BLOCK_SIZE_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float16_score_mod8_BLOCK_SIZE_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod0_BLOCK_SIZE3_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod0_BLOCK_SIZE_128_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod0_BLOCK_SIZE_64_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod1_BLOCK_SIZE_64_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod2_BLOCK_SIZE2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod2_BLOCK_SIZE3_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod2_BLOCK_SIZE_128_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod2_BLOCK_SIZE_64_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod3_BLOCK_SIZE2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod3_BLOCK_SIZE_64_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod4_BLOCK_SIZE3_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod4_BLOCK_SIZE_64_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod5_BLOCK_SIZE2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod5_BLOCK_SIZE_128_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod5_BLOCK_SIZE_64_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod6_BLOCK_SIZE2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod6_BLOCK_SIZE_128_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod6_BLOCK_SIZE_64_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod8_BLOCK_SIZE2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod8_BLOCK_SIZE3_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_different_block_size_float32_score_mod8_BLOCK_SIZE_128_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod1_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod1_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod2_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod2_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod3_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod3_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod4_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod5_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod6_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float16_score_mod7_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod0_head_dims2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod1_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod1_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod2_head_dims2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod3_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod3_head_dims2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod4_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod4_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod4_head_dims2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod5_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod5_head_dims2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod6_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod6_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod7_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod7_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_builtin_score_mods_float32_score_mod8_head_dims2_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_bw_decoding_fails_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_captured_buffers_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_captured_reduction_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_captured_scale_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_decode_at_different_input_position_float16_score_mod0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_decode_at_different_input_position_float16_score_mod4_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_decode_at_different_input_position_float16_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_decode_at_different_input_position_float16_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_decode_at_different_input_position_float16_score_mod7_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_decode_at_different_input_position_float16_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_function_composition_bfloat16_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_function_composition_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod0_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod0_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod1_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod1_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod3_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod3_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod4_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod5_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod6_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod6_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod7_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod8_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod8_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_head_dependent_mask_mod_float16_score_mod8_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims0_score_mod1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims0_score_mod3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims0_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims0_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims1_score_mod1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims1_score_mod2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims1_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims2_score_mod1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims2_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims2_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims2_score_mod7_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims0_batch_dims3_score_mod3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims0_score_mod0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims0_score_mod2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims0_score_mod3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims0_score_mod4_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims0_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims0_score_mod7_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims0_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims1_score_mod0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims1_score_mod2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims1_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims1_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims1_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims2_score_mod0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims2_score_mod3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims2_score_mod4_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims2_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims2_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims3_score_mod4_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims3_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims1_batch_dims3_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims0_score_mod2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims0_score_mod3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims0_score_mod7_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims0_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims1_score_mod0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims1_score_mod1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims1_score_mod2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims1_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims1_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod6_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod7_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims2_score_mod8_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims3_score_mod2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims3_score_mod3_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims3_score_mod4_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_kv_batch_broadcast_float16_head_dims2_batch_dims3_score_mod5_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_load_from_bias_head_seq_batch_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_load_from_bias_seq_batch_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_logsumexp_correctness_bfloat16_score_mod1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_logsumexp_only_return_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_max_autotune_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_max_autotune_with_captured_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_mixed_dtypes_fails_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_multiple_score_mod_calls_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_njt_causal_bfloat16_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_njt_causal_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_divisible_multi_token_offset_mask_with_captured_buffer_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod0_bfloat16_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod0_float16_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod0_float16_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod1_bfloat16_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod1_bfloat16_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod1_float16_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod1_float32_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod1_float32_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod2_bfloat16_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod2_float16_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod2_float32_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod3_bfloat16_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod3_bfloat16_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod3_float16_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod3_float32_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod4_float16_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod4_float16_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod4_float32_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod5_float16_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod6_bfloat16_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod6_float16_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod6_float32_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod6_float32_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod7_bfloat16_head_dims0_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod7_bfloat16_head_dims1_cuda_bfloat16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod7_float16_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod7_float16_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod7_float32_head_dims1_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_equal_head_dims_score_mod8_float32_head_dims0_cuda_float32, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_pow_2_headdim_head_dim_17_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_pow_2_headdim_head_dim_94_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_non_sparse_mulitple_block_size_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod0_head_dims0_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod0_head_dims0_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod0_head_dims2_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod0_head_dims2_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod1_head_dims0_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod1_head_dims0_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod1_head_dims1_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod1_head_dims2_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod1_head_dims2_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod2_head_dims0_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod2_head_dims0_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod2_head_dims1_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod2_head_dims1_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod2_head_dims2_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod3_head_dims0_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod3_head_dims0_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod3_head_dims1_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod3_head_dims2_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod4_head_dims0_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod4_head_dims1_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod4_head_dims1_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod4_head_dims2_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod5_head_dims0_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod5_head_dims0_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod5_head_dims1_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod5_head_dims2_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod5_head_dims2_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod6_head_dims0_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod6_head_dims1_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod6_head_dims1_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod6_head_dims2_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod7_head_dims0_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod7_head_dims0_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod7_head_dims1_page_size_64_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod7_head_dims2_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod7_head_dims2_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod8_head_dims1_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod8_head_dims2_page_size_128_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_paged_attention_page_size_float16_score_mod8_head_dims2_page_size_256_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_seq_masking_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_silu_on_score_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_skip_odd_keys_float16_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s0_v_s0_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s0_v_s1_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s0_v_s1_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s0_v_s1_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s0_v_s2_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s0_v_s2_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s0_v_s3_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s1_v_s0_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s1_v_s1_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s1_v_s1_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s1_v_s2_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s1_v_s3_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s2_v_s0_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s2_v_s0_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s2_v_s0_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s2_v_s2_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s3_v_s0_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s3_v_s0_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s3_v_s1_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s3_v_s2_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s3_v_s2_head_dims2_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s3_v_s3_head_dims0_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_strided_inputs_float16_k_s3_v_s3_head_dims1_cuda_float16, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_windowed_full_mask_vs_sdpa_paged_attention_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_windowed_no_mask_vs_sdpa_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_windowed_no_mask_vs_sdpa_paged_attention_cuda, test/inductor/test_flex_decoding.py::TestFlexDecodingCUDA::test_windowed_partial_block_vs_sdpa_cuda 2025-09-07T07:49:55.5487943Z 2025-09-07T07:49:55.5488053Z Running inductor/test_graph_transform_observer 1/1 ... [2025-09-07 07:49:55.537836] 2025-09-07T07:49:55.5488240Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:49:55.5488645Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_graph_transform_observer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:49:55.538038] 2025-09-07T07:50:01.0634358Z 2025-09-07T07:50:01.0635467Z inductor/test_graph_transform_observer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_graph_transform_observer_1.1_37cd9089f0025bef_.log 2025-09-07T07:50:01.0635987Z Running 1 items in this shard: test/inductor/test_graph_transform_observer.py::TestGraphTransformObserver::test_sdpa_rewriter 2025-09-07T07:50:01.0636183Z 2025-09-07T07:50:01.0636516Z Running inductor/test_group_batch_fusion 1/1 ... [2025-09-07 07:50:01.063190] 2025-09-07T07:50:01.0641740Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:50:01.0642198Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_group_batch_fusion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:50:01.063453] 2025-09-07T07:50:35.1519974Z 2025-09-07T07:50:35.1520976Z inductor/test_group_batch_fusion 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_group_batch_fusion_1.1_0f4102a7594119d5_.log 2025-09-07T07:50:35.1523449Z Running 12 items in this shard: test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_batch_layer_norm_fusion, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_batch_linear_lhs_fusion, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_batch_linear_pre_grad_fusion, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_gate_fusion_post_grad, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_group_linear_fusion, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_group_linear_fusion_different_shapes, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_math_op_fusion, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_pointwise_op_fusion, test/inductor/test_group_batch_fusion.py::TestGroupBatchFusion::test_pointwise_op_fusion_post_grad, test/inductor/test_group_batch_fusion.py::TestPostGradBatchLinearFusion::test_batch_linear_post_grad_fusion, test/inductor/test_group_batch_fusion.py::TestFindIndependentSubsetGreedy::test_find_independent_subset_greedy, test/inductor/test_group_batch_fusion.py::TestFindIndependentSubsetGreedy::test_find_independent_subset_greedy_fuse 2025-09-07T07:50:35.1525296Z 2025-09-07T07:50:35.1525405Z Running inductor/test_inductor_utils 1/1 ... [2025-09-07 07:50:35.151869] 2025-09-07T07:50:35.1525576Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:50:35.1525970Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_inductor_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:50:35.152069] 2025-09-07T07:50:38.8235640Z 2025-09-07T07:50:38.8236498Z inductor/test_inductor_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_inductor_utils_1.1_980590f56d05189b_.log 2025-09-07T07:50:38.8237424Z Running 2 items in this shard: test/inductor/test_inductor_utils.py::TestBench::test_benchmarker, test/inductor/test_inductor_utils.py::TestBench::test_do_bench_using_profiling 2025-09-07T07:50:38.8244040Z 2025-09-07T07:50:38.8244432Z Running inductor/test_inplacing_pass 1/1 ... [2025-09-07 07:50:38.823551] 2025-09-07T07:50:38.8244720Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:50:38.8245400Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_inplacing_pass.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:50:38.823783] 2025-09-07T07:50:51.6135839Z 2025-09-07T07:50:51.6136957Z inductor/test_inplacing_pass 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_inplacing_pass_1.1_dc267be24643cd2f_.log 2025-09-07T07:50:51.6151328Z Running 22 items in this shard: test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_counters_functionalize_old, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_counters_functionalize_v2, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_dont_modify_input, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_dont_modify_live, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_dont_modify_view_of_live, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_generalized_scatter, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_lists_functionalize_v2, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_lists_old_functionalize, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_multi_output_intermediate, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_multiple_intermediate, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_multiple_mutations, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_partitioner_recomputes_factory_empty_like_sin_op, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_partitioner_recomputes_factory_empty_like_sin_triton, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_partitioner_recomputes_factory_ones_like_sin_op, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_partitioner_recomputes_factory_ones_like_sin_triton, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_should_modify_inner, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_should_modify_input, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_view_inplaced2_functionalize_v2, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_view_inplaced_functionalize_v2, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_views_not_inplaced2_functionalize_v2, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_views_not_inplaced3_functionalize_v2, test/inductor/test_inplacing_pass.py::TestReinplacingPassCorrectness::test_views_not_inplaced_functionalize_v2 2025-09-07T07:50:51.6155161Z 2025-09-07T07:50:51.6155253Z Running inductor/test_metrics 1/1 ... [2025-09-07 07:50:51.613639] 2025-09-07T07:50:51.6155428Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:50:51.6155824Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_metrics.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:50:51.613886] 2025-09-07T07:51:00.0942089Z 2025-09-07T07:51:00.0942967Z inductor/test_metrics 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_metrics_1.1_ec5e071ecc183314_.log 2025-09-07T07:51:00.0944651Z Running 6 items in this shard: test/inductor/test_metrics.py::TestMetrics::test_atomic_add, test/inductor/test_metrics.py::TestMetrics::test_count_args, test/inductor/test_metrics.py::TestMetrics::test_count_pattern, test/inductor/test_metrics.py::TestMetrics::test_kernel_args_num_gb, test/inductor/test_metrics.py::TestMetrics::test_parse_proper_kernel_fn_code, test/inductor/test_metrics.py::TestMetrics::test_parse_reduction_hint 2025-09-07T07:51:00.0945832Z 2025-09-07T07:51:00.0949365Z Running inductor/test_minifier 1/1 ... [2025-09-07 07:51:00.094370] 2025-09-07T07:51:00.0956400Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:51:00.0957029Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_minifier.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:51:00.094594] 2025-09-07T07:52:11.1951289Z 2025-09-07T07:52:11.1952415Z inductor/test_minifier 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_minifier_1.1_8baf109065fee953_.log 2025-09-07T07:52:11.1957950Z Running 14 items in this shard: test/inductor/test_minifier.py::MinifierTests::test_accuracy_vs_strict_accuracy, test/inductor/test_minifier.py::MinifierTests::test_after_aot_cpu_accuracy_error, test/inductor/test_minifier.py::MinifierTests::test_after_aot_cpu_compile_error, test/inductor/test_minifier.py::MinifierTests::test_after_aot_gpu_accuracy_error, test/inductor/test_minifier.py::MinifierTests::test_after_aot_gpu_compile_error, test/inductor/test_minifier.py::MinifierTests::test_aoti_cpu_accuracy_error, test/inductor/test_minifier.py::MinifierTests::test_aoti_cpu_compile_error, test/inductor/test_minifier.py::MinifierTests::test_aoti_cpu_compile_error_unflatten, test/inductor/test_minifier.py::MinifierTests::test_aoti_gpu_accuracy_error, test/inductor/test_minifier.py::MinifierTests::test_aoti_gpu_compile_error, test/inductor/test_minifier.py::MinifierTests::test_aoti_gpu_compile_error_unflatten, test/inductor/test_minifier.py::MinifierTests::test_constant_in_graph, test/inductor/test_minifier.py::MinifierTests::test_offload_to_disk, test/inductor/test_minifier.py::MinifierTests::test_rmse_improves_over_atol 2025-09-07T07:52:11.1962352Z 2025-09-07T07:52:11.1962472Z Running inductor/test_padding 1/1 ... [2025-09-07 07:52:11.194948] 2025-09-07T07:52:11.1962716Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:52:11.1963333Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_padding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:52:11.195134] 2025-09-07T07:52:54.4947239Z 2025-09-07T07:52:54.4948596Z inductor/test_padding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_padding_1.1_2389227c2e71cbf9_.log 2025-09-07T07:52:54.4960666Z Running 55 items in this shard: test/inductor/test_padding.py::PerfTestBetweenGoodAndBadShape::test_BertForMaskedLM, test/inductor/test_padding.py::PerfTestBetweenGoodAndBadShape::test_LinearAndSoftmax_both_shapes, test/inductor/test_padding.py::PerfTestBetweenGoodAndBadShape::test_nobias_LinearAndSoftmax_both_shapes, test/inductor/test_padding.py::PerfTestWithAndWithoutPadding::test_longformer, test/inductor/test_padding.py::PerfTestWithAndWithoutPadding::test_longformer_small_bs, test/inductor/test_padding.py::PerfTestWithAndWithoutPadding::test_nvidia_deeprecommender, test/inductor/test_padding.py::PaddingTest::test_LinearAndSoftmax_codegen, test/inductor/test_padding.py::PaddingTest::test_attention, test/inductor/test_padding.py::PaddingTest::test_cat, test/inductor/test_padding.py::PaddingTest::test_conv, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape0_alignment_bytes_32_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape1_alignment_bytes_32_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape2_alignment_bytes_64_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape3_alignment_bytes_64_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape4_alignment_bytes_32_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape5_alignment_bytes_32_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape6_alignment_bytes_64_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_dynamic_shape_padding_shape7_alignment_bytes_64_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_matmul, test/inductor/test_padding.py::PaddingTest::test_mm_padding_perf, test/inductor/test_padding.py::PaddingTest::test_nobias_LinearAndSoftmax_codegen, test/inductor/test_padding.py::PaddingTest::test_noop_concat_output_padding_shape0_alignment_bytes_32_pad_output_False, test/inductor/test_padding.py::PaddingTest::test_noop_concat_output_padding_shape1_alignment_bytes_32_pad_output_True, test/inductor/test_padding.py::PaddingTest::test_noop_concat_output_padding_shape2_alignment_bytes_64_pad_output_False, test/inductor/test_padding.py::PaddingTest::test_noop_concat_output_padding_shape3_alignment_bytes_64_pad_output_True, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape0_alignment_bytes_32_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape1_alignment_bytes_32_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape2_alignment_bytes_64_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape3_alignment_bytes_64_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape4_alignment_bytes_32_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape5_alignment_bytes_32_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape6_alignment_bytes_64_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_outer_dynamic_shape_padding_shape7_alignment_bytes_64_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_pad_3d_tensor, test/inductor/test_padding.py::PaddingTest::test_pad_channels_last, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_128_shape0_float16, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_128_shape0_float32, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_128_shape1_float16, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_128_shape1_float32, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_32_shape0_float16, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_32_shape0_float32, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_32_shape1_float16, test/inductor/test_padding.py::PaddingTest::test_pad_outputs_alignment_bytes_32_shape1_float32, test/inductor/test_padding.py::PaddingTest::test_pad_strides, test/inductor/test_padding.py::PaddingTest::test_pad_strides_skip, test/inductor/test_padding.py::PaddingTest::test_padmm, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape0_perm0_alignment_bytes_32_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape1_perm1_alignment_bytes_32_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape2_perm2_alignment_bytes_64_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape3_perm3_alignment_bytes_64_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape4_perm4_alignment_bytes_32_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape5_perm5_alignment_bytes_32_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape6_perm6_alignment_bytes_64_enable_pad_True, test/inductor/test_padding.py::PaddingTest::test_perm_outer_dynamic_shape_padding_shape7_perm7_alignment_bytes_64_enable_pad_False, test/inductor/test_padding.py::PaddingTest::test_view 2025-09-07T07:52:54.4972467Z 2025-09-07T07:52:54.4972593Z Running inductor/test_pattern_matcher 1/1 ... [2025-09-07 07:52:54.492215] 2025-09-07T07:52:54.4972845Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:52:54.4973465Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_pattern_matcher.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:52:54.492478] 2025-09-07T07:53:32.6306158Z 2025-09-07T07:53:32.6312468Z inductor/test_pattern_matcher 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_pattern_matcher_1.1_896bc9a7ea2adec2_.log 2025-09-07T07:53:32.6318778Z Running 47 items in this shard: test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_addmm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_addmm_broadcasting_bias, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_addmm_dtype_mismatch, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_addmm_symbolic_scalar, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_bmm_to_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_cat_addmm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_cat_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_cat_slice_cat_cuda, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_cat_splitwithsizes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_duplicate_search, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_fused_int_mm_mul, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_fused_int_mm_mul_epilogue, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_fused_int_mm_mul_gating, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_fwd_only_generate_original_aten_meta, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_match_equivalent_function_invocations1, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_match_equivalent_function_invocations2, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_match_equivalent_function_invocations3, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_match_with_mutation, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_cpu, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_gating, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mm_plus_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_multioutput_register_replacement, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mutation_op_matching, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_original_aten_preserved_split_addmm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_pointless_convert, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_pointless_cumsum, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_pointless_permute_pair, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_pointless_permute_pair_3d, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_pointless_view_pair, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_pointless_view_pair_dynamic_shapes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_pointless_clones, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_replace_mul_zero, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_scaled_softmax, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_serialized_patterns_up_to_date, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_splitwithsizes_cat, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_stable_topological_sort, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_successful_partial_reuse_case0, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_successful_partial_reuse_case1, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_successful_partial_reuse_case2, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_symint_pattern_matching, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_unfuse_bias_addmm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_unsuccessful_partial_reuse_case0, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_unsuccessful_partial_reuse_case1 2025-09-07T07:53:32.6324557Z 2025-09-07T07:53:32.6324676Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T07:53:32.6324901Z Uploading artifacts took 0.00 seconds 2025-09-07T07:53:32.6325098Z Running inductor/test_select_algorithm 1/1 ... [2025-09-07 07:53:32.630351] 2025-09-07T07:53:32.6325266Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:53:32.6325660Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_select_algorithm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:53:32.630542] 2025-09-07T07:54:09.5762145Z 2025-09-07T07:54:09.5763888Z inductor/test_select_algorithm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_select_algorithm_1.1_7d2fcbec135b5939_.log 2025-09-07T07:54:09.5768399Z Running 21 items in this shard: test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_TritonTemplateCaller_str, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test__int_mm, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_addmm, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_addmm_fp16, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_baddbmm, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_bmm, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_convolution1, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_convolution2, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_convolution_as_mm, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_linear_relu, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_dropout, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_dup_args, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_dup_args_view, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_not_even_k, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_plus_mm, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_plus_mm2, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_plus_mm3, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_mm_skip, test/inductor/test_select_algorithm.py::TestSelectAlgorithm::test_preprocessing_single_choice, test/inductor/test_select_algorithm.py::TestTemplateRender::test_finalized_subclass_hooks 2025-09-07T07:54:09.5772117Z 2025-09-07T07:54:09.5772302Z Running inductor/test_torchinductor_codegen_config_overrides 1/1 ... [2025-09-07 07:54:09.576245] 2025-09-07T07:54:09.5772606Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:54:09.5773381Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_codegen_config_overrides.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:54:09.576479] 2025-09-07T07:54:19.3604978Z 2025-09-07T07:54:19.3607209Z inductor/test_torchinductor_codegen_config_overrides 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_codegen_config_overrides_1.1_6da82f0f5815e9cc_.log 2025-09-07T07:54:19.3609651Z Running 3 items in this shard: test/inductor/test_torchinductor_codegen_config_overrides.py::CodegenInductorTest::test_force_pointwise_cat_force_pointwise_cat_False, test/inductor/test_torchinductor_codegen_config_overrides.py::CodegenInductorTest::test_force_pointwise_cat_force_pointwise_cat_True, test/inductor/test_torchinductor_codegen_config_overrides.py::CodegenInductorTest::test_kernel_fusion_thresholds 2025-09-07T07:54:19.3610988Z 2025-09-07T07:54:19.3611303Z Running inductor/test_torchinductor_codegen_dynamic_shapes 1/4 ... [2025-09-07 07:54:19.360365] 2025-09-07T07:54:19.3611761Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T07:54:19.3613285Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_codegen_dynamic_shapes.py', '--shard-id=1', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 07:54:19.360608] 2025-09-07T08:01:38.1255625Z 2025-09-07T08:01:38.1256402Z inductor/test_torchinductor_codegen_dynamic_shapes 1/4 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_codegen_dynamic_shapes_1.4_cc3802f7a1e721bd_.log 2025-09-07T08:01:38.1333629Z Running 418 items in this shard: test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_abs_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_adaptive_avg_pool1d_argmax_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_adaptive_avg_pool_with_output_size_0_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_add_complex6_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_add_complex7_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_add_const_float_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_aoti_eager_support_out_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_aoti_eager_with_scalar_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_arange2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_arange6_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_as_strided_scatter_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_assert_alignment_op_name_fail_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_assert_alignment_op_name_pass_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_assert_size_stride_op_name_fail_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_assert_size_stride_op_name_pass_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_avg_pool2d2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_avg_pool2d4_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_avg_pool2d_backward2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_avg_pool2d_backward3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_avg_pool2d_backward_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_avg_pool3d_backward2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_batch_norm_2d_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_int16_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_int16_uint8_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_int32_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_int64_int32_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_int8_int32_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_int8_int8_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_int8_uint8_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_bucketize_int_uint8_int8_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_builtins_round_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_builtins_round_float_ndigits_zero_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_cat_inplace_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_cat_negative_dim_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_cat_of_loops_and_extern_kernel_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_cat_unbacked_empty_1d_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_cat_upcasting_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_compar_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_config_option_dont_assume_alignment_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_const_int32_to_float_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_constant_pad_2d_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_conv3d_channels_last_use_block_ptr_False_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_conv_bn_fuse_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_conv_functional_bn_fuse_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_cudnn_rnn_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_custom_op_fixed_layout_sequential_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_data_type_propogation_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_device_assert_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_div6_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_div9_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_div_by_zero_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_bfloat16_bfloat16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_bfloat16_float32_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float16_float16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float16_int32_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float32_float64_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float32_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float32_int32_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float32_uint8_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float64_float16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_float64_int8_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int16_float32_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int16_float64_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int16_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int32_bfloat16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int32_float32_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int32_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int32_int64_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int64_int64_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int8_float64_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_int8_int8_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_dtypeview_uint8_bfloat16_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_embedding_bag_byte_unpack_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_embedding_bag_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_exp2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_exp_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_expand_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_fallback_mutable_op_list_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_fft_real_input_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_fmin_fmax_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_full_like_sliced_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_functionalize_rng_wrappers_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_gather2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_generated_code_has_alignment_assert_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_index3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_index_propagation_abs_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_index_put_failed_reinplace_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_inner_fn_str_and_stride_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_int8_weight_only_quant_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_invalid_operand_issue1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_isinf2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_lgamma_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_like_rands_sliced_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_linspace3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_linspace4_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_logcumsumexp_zero_dim_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_long_tensor_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_low_memory_max_pool_dilation_1_dim_3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_masked_fill_promotion_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_max_pool2d_with_indices_backward2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_max_pool2d_with_indices_backward4_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_mean_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_misaligned_address_issue1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_mix_device_index_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_move_arange_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_multi_gpu_recompile_on_index_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_multi_threading_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_nan_sort_stable_False_descending_False_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_nan_sort_stable_False_descending_True_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_nan_to_num_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_narrow_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_no_op_reduction_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_no_specization_over_symbolic_value_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_permute1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_philox_rand_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pixel_shuffle_channels_last_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_airy_ai_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_bessel_y1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_entr_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_gammaln_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_hermite_polynomial_he_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_log_ndtr_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_modified_bessel_i1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_modified_bessel_k1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_ndtri_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_scaled_modified_bessel_k0_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_shifted_chebyshev_polynomial_t_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pointwise_shifted_chebyshev_polynomial_w_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_polar_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_pow2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_prod_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_randint_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_randint_int64_mod_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_reflection_pad2d_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_reinterpret_dtypeview_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_remove_noop_view_dtype_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_repeat_interleave_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_replication_pad_errors_with_bool_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_require_stride_expanded_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_roll_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_round_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_rsqrt_dynamic_shapes_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_scalar_cpu_tensor_arg_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_scatter4_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_scatter_add2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_False_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_True_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sdpa_unaligned_mask_freezing_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_select_scatter_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_shape_padding_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_signbit_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice_mutation3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice_scatter2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice_scatter3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice_scatter5_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_slice_scatter_reinplace_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sort_bool_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sort_transpose_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_cumprod_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_cumprod_low_prec_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_cumsum_low_prec_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_failed_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_reduction_with_int64_size_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_with_list_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_with_sizes_with_unbacked_symints_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_split_with_unbacked_symints_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_stack_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_std_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_stride_preservation_with_stride_modifying_fx_pass_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_strided_inputs_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sum1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sum2_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_sum5_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_tensor_index_slice_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_topk_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_triton_kernel_bool_param_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_uint4x2_mixed_mm_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_unfold_zero_dimension_tensor_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_unroll_small_reduction_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_unsigned_constant_tensors_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_upsample_nearest2d_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_vdd_clamp_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_vectorized_ops_masked_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_view_on_aliased_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_views1_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_views3_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_views4_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenCpuTests::test_zero_element_mutation_dynamic_shapes_cpu, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_abs_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_adaptive_avg_pool2d1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_adaptive_avg_pool2d_low_prec_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_adaptive_max_pool2d2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_add_const_float_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_add_const_int_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_addmm_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_aliased_buffer_reuse_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_allow_reuse_active_if_under_peak_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_aoti_eager_override_registration_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_aoti_eager_with_persistent_cache_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_aoti_eager_with_scalar_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_arange5_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_argmax_argmin1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_as_strided_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_as_strided_scatter_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_assert_alignment_op_name_fail_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_assert_size_stride_op_name_fail_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_assert_size_stride_op_name_pass_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_avg_pool2d3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_avg_pool2d6_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_avg_pool2d8_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_avg_pool2d_backward3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_avg_pool3d_backward4_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_batch_norm_2d_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_bernoulli2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_both_scalars_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_bucketize_broadcast_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_bucketize_computed_offsets_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_bucketize_int_int16_int64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_bucketize_int_int16_uint8_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_bucketize_int_uint8_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_bucketize_int_uint8_int32_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_buffer_copied_in_graph_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_buffer_copied_in_graph_with_different_shapes_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_cat_empty_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_cat_empty_index_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_cat_upcasting_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_clamp_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_clone_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_compar_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_consecutive_split_cumprod_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_const_int32_to_float_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_constant_pad_2d_strides_nonpositive_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_constant_pad_3d_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_constant_pad_fill_dtype_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_conv_functional_bn_fuse_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_convolution3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_cudnn_rnn_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_cumsum_inf_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_cumsum_no_mask_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_cumsum_zero_dim_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_custom_op_3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_custom_op_default_layout_constraint_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_custom_op_unbacked_symints_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_custom_scan_op_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_data_type_propogation_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_device_assert_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_div9_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_div_precision_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_div_zero_dim_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dont_constant_fold_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dropout3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dropout_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_bfloat16_int32_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float16_bfloat16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float16_float64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float32_float64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float64_bfloat16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float64_float16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float64_float64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float64_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_float64_int64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int16_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int32_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int32_int64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int32_uint8_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int64_float16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int64_float32_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int64_uint8_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int8_float16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int8_float32_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int8_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_int8_int32_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_uint8_float64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_dtypeview_uint8_uint8_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_embedding_bag_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_exact_stride_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_exp_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_expand_as_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_expand_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_fallback_mutable_op_list_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_fill2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_flip_cat_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_float16_to_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_float32_to_int32_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_float_repr_dynamic_shapes_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_fmod_zero_dim_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_fractional_max_pool2d1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_full_like_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_gather1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_gather_scatter_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_generated_code_has_size_stride_assert_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_glu_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_graph_partition_arange1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_graph_partition_arange2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_graph_partition_constant_tensor2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_graph_partition_mutation_real_name_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_graph_partition_pad_dynamic_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_index1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_index_propagation_abs_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_index_put2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_index_put3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_index_put4_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_index_remainder_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_indirect_load_broadcast_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_inductor_assert_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_inplace_resize_as_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_inplace_where_pointwise_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_input_mutation1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_input_mutation2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_input_mutation4_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_insignificant_strides_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_int8_weight_only_quant_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_kwargs_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_large_offset_pointwise_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_leaky_relu_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_like_channels_last_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_like_rands3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_like_rands_sliced_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_linear_dynamic_maxautotune_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_linspace1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_linspace4_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_log_fp64_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_log_softmax_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_logsumexp_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_masked_fill_promotion_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_max_pool2d1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_max_pool2d7_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_max_pool2d8_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_max_pool2d_with_indices_backward2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_max_pool2d_with_indices_backward5_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_min_max_reduction_nan_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_misaligned_address_issue1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_mixed_mm2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_mixed_mm_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_move_arange_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_multilayer_prime_size_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_nan_sort_stable_False_descending_False_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_nan_sort_stable_True_descending_False_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_narrow_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_neg_index_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_new_ones_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_no_op_reduction_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_nonzero_unbacked_refinement_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pad_view_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pattern_matcher_unbacked_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_philox_rand_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_bessel_y1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_chebyshev_polynomial_v_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_digamma_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_entr_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_hermite_polynomial_he_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_i0e_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_legendre_polynomial_p_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_modified_bessel_i0_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_ndtr_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_ndtri_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_polygamma_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_pointwise_scaled_modified_bessel_k1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_profiler_mark_wrapper_call_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_randint_distribution_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_randint_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_randint_int64_mod_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_randint_kernel_count_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_reduction4_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_reduction5_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_remainder_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_remove_noop_clone_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_remove_noop_slice_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_repeat_interleave_Tensor_decomp_int64_nd_1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_rsqrt_dynamic_shapes_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_scaled_dot_product_attention_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_scatter1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_scatter4_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_scatter_bf16_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_scatter_reduce2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_scatter_reduce3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_False_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_searchsorted_broadcast_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_sigmoid_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_signbit_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_simplify_loops_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_slice1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_slice_scatter5_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_slice_scatter_dtype_consistency_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_slice_view_with_graph_break_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_softmax_one_kernel_loop_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_special_polygamma_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_split_reduction_with_int64_size_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_split_with_list_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_squeeze_varargs_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_stack_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_std_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_stride_preservation_with_stride_modifying_fx_pass_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_sum2_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_sum_dtype_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_sum_int_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_tan_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_tensor1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_tensor3_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_to_device_constant_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_transposed_propagates_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_unbacked_floordiv_simplify_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_unsigned_constant_tensors_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_unspec_inputs_int32_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_upsample_bilinear2d_b_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_upsample_nearest1d_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_upsample_nearest2d_backward_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_upsample_nearest3d_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_var_mean_div_by_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_var_mean_tile_reduction_True_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_vdd_clamp_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_views1_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_views6_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_where_broadcast_dynamic_shapes_cuda, test/inductor/test_torchinductor_codegen_dynamic_shapes.py::DynamicShapesCodegenGPUTests::test_zero_element_mutation_dynamic_shapes_cuda 2025-09-07T08:01:38.1409463Z 2025-09-07T08:01:38.1409577Z Running inductor/test_torchinductor_dynamic_shapes 2/4 ... [2025-09-07 08:01:38.125316] 2025-09-07T08:01:38.1409771Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:01:38.1410253Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_dynamic_shapes.py', '--shard-id=2', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:01:38.125510] 2025-09-07T08:11:36.2408211Z 2025-09-07T08:11:36.2410787Z inductor/test_torchinductor_dynamic_shapes 2/4 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_dynamic_shapes_2.4_c8d439c3065e33be_.log 2025-09-07T08:11:36.2559632Z Running 431 items in this shard: test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_adaptive_max_pool2d3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_add_complex10_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_add_complex5_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_add_complex6_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_allow_reuse_active_if_under_peak_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_aoti_eager_support_str_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_aoti_eager_with_scalar_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_arange1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_arange4_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_argmax_argmin3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_as_strided_scatter_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_assert_alignment_op_name_fail_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_assert_alignment_op_name_pass_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_assert_size_stride_op_name_fail_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_avg_pool2d3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_avg_pool2d6_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_avg_pool2d_backward4_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_avg_pool3d_backward_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_baddbmm_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bernoulli2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bool_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_computed_offsets_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_default_kwargs_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_int_int32_int32_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_int_int32_int64_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_int_int32_int8_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_int_uint8_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_int_uint8_uint8_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_nd_tiling_False_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_bucketize_nd_tiling_True_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_buffer_batch_norm_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_builtins_round_float_ndigits_neg_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_cat_empty_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_cat_single_empty_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_cat_unbacked_empty_1d_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_check_stack_no_cycles_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_complex_fallback_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_computed_buffer_inlining_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_config_option_dont_assume_alignment_recompiles_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_constant_pad_2d_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_constant_pad_3d_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_constant_pad_nd_inplace_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_conv3d_channels_last_use_block_ptr_False_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_conv3d_channels_last_use_block_ptr_True_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_conv_backward_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_copy_non_blocking_is_pinned_use_cat_False_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_cos_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_cumsum_inf_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_cumsum_no_mask_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_custom_op_fixed_layout_sequential_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_custom_op_unbacked_symints_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_custom_scan_op_multi_input_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_deterministic_codegen_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_div5_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dropout2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dropout3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtype_mismatch_issue_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtype_sympy_expr_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_bfloat16_float32_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_bfloat16_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_bfloat16_int32_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_float32_int8_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_float64_float16_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_float64_float32_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_fusion_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int16_float64_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int32_bfloat16_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int32_float32_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int32_int64_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int64_float16_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int64_int64_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int8_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_int8_uint8_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_uint8_float64_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_dtypeview_uint8_int64_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_embedding_sparse_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_empty1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_erfc_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_exp2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_expand_as_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_fallback_mutable_op_list_tensor_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_fallback_mutable_op_no_mutated_tensors_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_fallback_mutable_op_with_return_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_flip_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_fractional_max_pool2d5_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_full_boolean_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_full_like_sliced_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_fuse_tiled_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_gather3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_gather_scatter_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_generated_code_has_size_stride_assert_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_graph_partition_arange1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_graph_partition_both_scalars_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_graph_partition_constant_tensor2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_graph_partition_refcount_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_hardtanh_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_index3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_index_propagation_floordiv_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_index_propagation_remainder_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_index_put_as_masked_fill_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_index_put_failed_reinplace_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_index_put_fallback1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_index_put_fallback2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_inductor_layout_optimization_input_mutations_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_inner_fn_str_and_stride_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_inplace_mixed_dtype_ops_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_input_mutation1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_input_mutation3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_int8_weight_only_quant_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_isin_tensor_scalar_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_isinf_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_kwargs_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_l1_loss_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_large_pointwise_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_large_tensor_reduction_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_like_rands3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_linear_dynamic_maxautotune_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_linspace3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_log2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_log_fp64_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_long_tensor_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_max_pool2d2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_max_pool2d6_dilation_1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_max_pool2d_with_indices_backward5_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_max_pool2d_with_indices_backward_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_mean_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_min_max_reduction_nan_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_mixed_mm_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_move_arange_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_multi_gpu_recompile_on_index_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_multilayer_prime_size_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_multilayer_sum_low_prec_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_neg_max_uint8_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_new_empty_strided_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_nll_loss_backward_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_no_mega_fusion_during_lowering_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_nonzero_unbacked_refinement_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_norm_constant_overflow_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_one_hot_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pad_cast_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_airy_ai_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_bessel_y1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_chebyshev_polynomial_t_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_chebyshev_polynomial_w_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_digamma_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_entr_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_erf_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_exp2_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_expit_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_gammaincc_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_ndtr_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_scaled_modified_bessel_k0_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_shifted_chebyshev_polynomial_t_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_pointwise_xlogy_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_prod_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_randint_distribution_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_randint_kernel_count_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_reduction3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_reduction_config_limit_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_remove_noop_slice1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_repeat_as_strided_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_resize_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_roll_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_scalar_cpu_tensor_arg_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_scatter3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_True_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_searchsorted_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_shape_padding_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_signbit_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_single_elem_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_slice1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_slice_mutation3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_softmax_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_sort_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_sort_transpose_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_split_cumprod_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_split_cumprod_low_prec_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_split_reduction_with_int64_size_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_split_with_list_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_split_with_sizes_with_unbacked_symints_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_sum5_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_tan_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_tensor1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_tensor3_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_tensor_index_slice_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_tmp_not_defined_issue1_use_block_ptr_True_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_to_device_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_to_dtype_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_torch_device_split_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_transpose_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_triton_kernel_bool_param_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_uint4x2_mixed_mm_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_unbacked_floordiv_simplify_errors_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_unbind_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_unsigned_constant_tensors_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_unspec_inputs_int16_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_unspec_inputs_int32_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_upsample_bicubic2d_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_upsample_bilinear2d_b_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_upsample_nearest1d_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_upsample_nearest2d_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_upsample_nearest3d_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_var_correction_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_var_mean_div_by_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_view_detach_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_views1_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_views4_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_views6_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesCpuTests::test_zeros_dynamic_shapes_cpu, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_AllenaiLongformerBase_repro_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_adaptive_avg_pool2d_low_prec_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_adaptive_max_pool2d1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_add_complex10_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_add_complex6_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_add_complex7_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_add_complex9_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_addmv_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_any_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_aoti_eager_cache_hit_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_aoti_eager_dtype_device_layout_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_aoti_eager_override_registration_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_aoti_eager_support_str_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_arange2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_arange6_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_argmax_argmin3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_as_strided_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_avg_pool2d1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_avg_pool2d4_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_avg_pool2d5_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_avg_pool2d_backward2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_avg_pool2d_backward3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_avg_pool3d_backward3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_batch_norm_2d_2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bernoulli1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bernoulli2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bitwise3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_computed_offsets_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_int_int16_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_int_int16_int8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_int_int32_int8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_int_int32_uint8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_int_int64_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_int_uint8_int8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_bucketize_nd_tiling_True_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_buffer_batch_norm_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_buffer_use_after_remove_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_builtins_round_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_builtins_round_float_ndigits_zero_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_cat_empty_index_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_cat_single_empty_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_cat_upcasting_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_check_stack_no_cycles_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_clone_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_complex_fallback_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_config_option_dont_assume_alignment_cudagraphs_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_constant_pad_fill_dtype_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_conv_shape_check_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_convolution1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_convolution5_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_copy_non_blocking_is_pinned_use_cat_False_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dist_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_div2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_div4_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_div6_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_div7_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_div8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_div_presicion_accuracy_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dont_constant_fold_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dropout3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dropout_trivial_0_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtype_sympy_expr_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_bfloat16_int64_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_bfloat16_int8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_float16_float32_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_float16_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_float16_int8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_float16_uint8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_float64_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_int16_bfloat16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_int32_bfloat16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_int32_int16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_int64_bfloat16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_int64_uint8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_int8_float32_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_dtypeview_uint8_float16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_embedding_bag_byte_unpack_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_embedding_sparse_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_expm1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_fft_real_input_real_output_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_flip_cat_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_fmin_fmax_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_fractional_max_pool2d2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_fractional_max_pool2d3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_fractional_max_pool2d5_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_full_boolean_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_full_like_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_full_like_transposed_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_gather1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_gather2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_getitem_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_graph_partition_arange2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_graph_partition_no_inputs_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_graph_partition_scalar_inputs_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_hardswish_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_horizonal_fusion2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_index_propagation_abs_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_index_propagation_device_assert_masked_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_index_propagation_nested_indirect_indexing_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_index_put1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_index_put2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_index_put_fallback1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_inductor_layout_optimization_input_mutations_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_inner_fn_str_and_stride_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_inplace_activations_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_input_mutation4_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_issue102546_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_l1_loss_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_large_grid_use_block_ptr_False_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_large_strided_reduction_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_lerp_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_like_channels_last_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_linear1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_log1p_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_long_tensor_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_low_memory_max_pool_dilation_2_dim_3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_max_min_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_max_pool2d2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_max_pool2d8_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_max_pool2d_with_indices_backward3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_max_pool2d_with_indices_backward6_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_mean_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_min_max_reduction_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_misaligned_address_issue1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_mixed_mm2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_mm_mixed_dtype_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_mul_index_expr_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_multilayer_var_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_nan_sort_stable_True_descending_False_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_nan_sort_stable_True_descending_True_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_neg_index_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_no_mega_fusion_during_lowering_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_no_op_reduction_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_no_specization_over_symbolic_value_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_nonzero_unbacked_refinement_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_one_hot_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pad_view_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pattern_matcher_multi_user_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_permute2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_bessel_j0_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_bessel_y1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_chebyshev_polynomial_t_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_entr_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_erf_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_gammaln_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_hermite_polynomial_h_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_laguerre_polynomial_l_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_log_ndtr_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_scaled_modified_bessel_k0_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pointwise_shifted_chebyshev_polynomial_t_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pow2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pow_by_natural_log2_dynamic_shapes_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_pow_int_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_prod_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_profiler_mark_wrapper_call_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_rand_like_deterministic_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_randint_int64_mod_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_reduction5_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_reflection_pad2d_backward_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_reflection_pad2d_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_reinterpret_dtypeview_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_remove_no_ops_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_remove_noop_slice1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_remove_noop_slice_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_repeat_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_roll_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_scaled_dot_product_efficient_attention_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_scatter2_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_scatter3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_scatter_add3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_scatter_bf16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_False_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_sdpa_prefer_nd_tiling_False_use_block_ptr_True_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_searchsorted_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_shape_padding_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_signbit_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_slice4_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_slice_scatter3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_slice_scatter5_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_softmax_one_kernel_persist_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_split_cumprod_low_prec_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_split_with_unbacked_symints_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_sqrt_dynamic_shapes_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_stack_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_sum1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_sum_int_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_tan_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_tensor1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_tmp_not_defined_issue3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_to_dtype_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_torch_device_split_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_transposed_propagates_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_unbacked_floordiv_simplify_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_unbacked_floordiv_simplify_errors_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_unbind_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_unroll_small_reduction_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_unsigned_constant_tensors_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_unspec_inputs_bfloat16_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_upsample_bilinear2d_a_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_upsample_bilinear2d_b_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_upsample_nearest1d_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_upsample_nearest2d_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_vectorized_ops_masked_var_novec_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_vertical_fusion1_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_views3_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_views6_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_where_broadcast_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::DynamicShapesGPUTests::test_xblock_divides_xnumel_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_abs_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_arange_dynamic_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_full_recompiles_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_item_nobreak_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_item_zeros_nobreak_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_math_ops_op0_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_math_ops_op10_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_math_ops_op4_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_math_ops_op6_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_meta_dynamic_shapes_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_return_unbacked_view_split_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_slice_scatter_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_symint_sum_list_cuda, test/inductor/test_torchinductor_dynamic_shapes.py::TestInductorDynamicCUDA::test_wrapper_codegen_statically_known_int_or_none_cuda 2025-09-07T08:11:36.2670915Z 2025-09-07T08:11:36.2671098Z Running inductor/test_torchinductor_opinfo 4/9 ... [2025-09-07 08:11:36.244660] 2025-09-07T08:11:36.2671395Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:11:36.2672004Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_opinfo.py', '--shard-id=4', '--num-shards=9', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:11:36.245128] 2025-09-07T08:21:31.1903302Z 2025-09-07T08:21:31.1904968Z inductor/test_torchinductor_opinfo 4/9 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_opinfo_4.9_11c2d607f899b65a_.log 2025-09-07T08:21:31.1972541Z Running 420 items in this shard: test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_H_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___getitem___cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___getitem___cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___rand___cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___rdiv___cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___rdiv___cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___rmul___cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___rmul___cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___ror___cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___ror___cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___ror___cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___rxor___cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive___rxor___cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive__segment_reduce_lengths_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive__unsafe_masked_index_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive__unsafe_masked_index_put_accumulate_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_abs_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_acos_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_addbmm_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_addmm_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_addmv_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_addr_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_alias_copy_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_all_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_all_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_amax_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_amin_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_aminmax_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_any_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_arange_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_argmax_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_argmin_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_argsort_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_as_strided_copy_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_as_strided_copy_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_as_strided_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_as_strided_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_as_strided_partial_views_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_asin_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_asin_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_asin_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_asinh_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_atan2_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_atan2_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_atan2_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_atan_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_atan_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_atleast_1d_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_bfloat16_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_bitwise_and_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_bitwise_left_shift_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_bitwise_not_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_bitwise_or_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_bitwise_right_shift_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_block_diag_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_block_diag_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_broadcast_to_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_byte_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cat_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cauchy_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cdouble_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cfloat_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_chalf_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_char_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_chunk_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_clamp_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_clamp_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_clamp_max_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_clamp_min_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_column_stack_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_constant_pad_nd_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_copysign_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_count_nonzero_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cross_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cross_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cummax_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cummin_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cummin_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cumprod_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_cumsum_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_deg2rad_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diag_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diag_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diag_embed_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diagonal_copy_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diagonal_copy_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diagonal_scatter_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diff_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diff_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_diff_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_digamma_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_div_floor_rounding_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_div_floor_rounding_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_div_no_rounding_mode_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_div_no_rounding_mode_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_div_trunc_rounding_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_dot_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_double_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_double_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_double_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_empty_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_empty_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_empty_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_empty_permuted_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_empty_strided_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_empty_strided_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_empty_strided_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_eq_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_eq_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_equal_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_equal_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_erfc_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_erfinv_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_expand_copy_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_expand_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fft2_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fft_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftn_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_hfft_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_hfft_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_ifft2_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_ifft2_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_ifftshift_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_ihfft_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_ihfftn_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_irfft_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_irfftn_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_rfftn_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_rfftn_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fill_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_flatten_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_flatten_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_flip_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fliplr_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_float_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_float_power_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_floor_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fmin_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_full_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_full_like_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_ge_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_ge_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_ge_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_ge_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_gradient_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_gradient_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_grid_sampler_3d_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_hash_tensor_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_hash_tensor_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_heaviside_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_histc_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_hsplit_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_hsplit_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_hsplit_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_hypot_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_i0_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_index_copy_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_index_copy_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_index_put_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_index_reduce_mean_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_inner_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_isclose_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_isfinite_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_isneginf_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_isposinf_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_isposinf_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_isreal_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_jiterator_4inputs_with_extra_args_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_jiterator_binary_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_jiterator_unary_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_kron_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_le_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_lgamma_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_cond_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_diagonal_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_eig_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_eigh_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_eigvalsh_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_inv_ex_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_ldl_factor_ex_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_lstsq_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_norm_subgradients_at_zero_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_pinv_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_qr_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_svd_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_tensorinv_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linalg_vander_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linspace_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_linspace_tensor_overload_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_logaddexp_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_logical_not_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_logical_not_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_logical_xor_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_logspace_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_logspace_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_long_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_lt_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_lu_unpack_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_mH_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_amax_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_argmax_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_argmin_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_fill_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_median_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_prod_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_prod_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_prod_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_scatter_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_std_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_std_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_var_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_masked_var_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_matmul_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_max_binary_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_max_reduction_no_dim_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_max_reduction_no_dim_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_maximum_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_maximum_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_meshgrid_list_of_tensors_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_meshgrid_list_of_tensors_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_meshgrid_list_of_tensors_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_min_reduction_no_dim_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_min_reduction_with_dim_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_mode_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_mode_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_msort_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_msort_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_multinomial_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_mvlgamma_mvlgamma_p_5_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_mvlgamma_mvlgamma_p_5_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nan_to_num_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_narrow_copy_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_narrow_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_neg_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_neg_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_new_empty_strided_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_new_full_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_new_full_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_new_ones_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_adaptive_avg_pool2d_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_adaptive_avg_pool3d_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_adaptive_max_pool2d_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_batch_norm_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_batch_norm_without_cudnn_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_binary_cross_entropy_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_channel_shuffle_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_conv1d_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_conv3d_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_conv_transpose1d_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_conv_transpose3d_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_cosine_similarity_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_cross_entropy_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_cross_entropy_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_dropout_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_embedding_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_feature_alpha_dropout_with_train_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_feature_alpha_dropout_without_train_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_fractional_max_pool3d_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_group_norm_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_hinge_embedding_loss_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_interpolate_area_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_interpolate_bilinear_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_interpolate_nearest-exact_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_leaky_relu_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_linear_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_max_pool1d_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_max_pool3d_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_max_unpool1d_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_multilabel_soft_margin_loss_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_normalize_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_normalize_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pad_circular_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pad_constant_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pad_replicate_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pad_replicate_negative_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pairwise_distance_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pdist_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pixel_shuffle_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_pixel_shuffle_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_poisson_nll_loss_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_poisson_nll_loss_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_relu_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_silu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_softmin_with_dtype_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_tanhshrink_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_threshold_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nonzero_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_norm_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_norm_fro_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_norm_nuc_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_normal_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_ones_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_ones_like_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_outer_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_outer_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_polygamma_polygamma_n_0_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_polygamma_polygamma_n_0_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_polygamma_polygamma_n_1_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_polygamma_polygamma_n_4_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_polygamma_polygamma_n_4_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_put_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_rad2deg_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_ravel_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_real_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_real_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_reciprocal_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_reciprocal_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_remainder_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_renorm_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_repeat_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_repeat_interleave_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_reshape_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_resize_as__cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_round_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_rsqrt_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_rsqrt_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_rsqrt_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_rsub_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_scatter_add_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_scatter_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_scatter_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_scatter_reduce_prod_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_select_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_select_scatter_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sgn_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sgn_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sigmoid_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_signal_windows_blackman_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_signbit_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_signbit_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sin_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sinh_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sinh_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sinh_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_slice_scatter_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_bessel_j0_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_chebyshev_polynomial_t_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_chebyshev_polynomial_v_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_chebyshev_polynomial_v_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_entr_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_entr_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_erfcx_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_hermite_polynomial_h_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_i1_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_i1_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_laguerre_polynomial_l_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_log_ndtr_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_modified_bessel_i0_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_modified_bessel_i1_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_polygamma_special_polygamma_n_0_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_polygamma_special_polygamma_n_0_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_scaled_modified_bessel_k0_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_u_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_v_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_w_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_spherical_bessel_j0_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_spherical_bessel_j0_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_xlog1py_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_special_zeta_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_split_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_split_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_split_list_args_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_split_list_args_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_split_with_sizes_copy_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_split_with_sizes_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sqrt_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_square_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_squeeze_copy_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_std_mean_unbiased_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_std_unbiased_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_sum_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_t_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_t_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_take_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_tan_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_tensor_split_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_tile_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_topk_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_torch_ops_aten__flash_attention_forward_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_torch_ops_aten__safe_softmax_default_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_trace_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_trace_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_transpose_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_trapz_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_trapz_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_tril_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_triu_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_triu_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_trunc_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_trunc_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unbind_copy_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unbind_copy_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unbind_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unbind_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unfold_copy_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unfold_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_uniform_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unique_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unique_cuda_uint32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unsafe_chunk_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unsafe_split_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_unsqueeze_copy_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_var_mean_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_view_as_complex_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_view_as_complex_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_view_as_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_view_as_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_view_copy_cuda_int32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_view_copy_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_vsplit_cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_vstack_cuda_bool, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_vstack_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_zero__cuda_int64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_zero__cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_zeros_cuda_float32, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_zeros_cuda_uint8, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_zeros_like_cuda_int64 2025-09-07T08:21:31.2044810Z 2025-09-07T08:21:31.2044952Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T08:21:31.2045154Z Uploading artifacts took 0.00 seconds 2025-09-07T08:21:31.2045364Z Running inductor/test_torchinductor_strided_blocks 1/1 ... [2025-09-07 08:21:31.190813] 2025-09-07T08:21:31.2045557Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:21:31.2045970Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_strided_blocks.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:21:31.191050] 2025-09-07T08:22:28.9925547Z 2025-09-07T08:22:28.9934466Z inductor/test_torchinductor_strided_blocks 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_strided_blocks_1.1_cc8bcbda55bfb6f6_.log 2025-09-07T08:22:29.0011090Z Running 297 items in this shard: test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reduction_multi_kernel_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reduction_odd_shapes_view_size0_num_block_pointers_1_num_triton_kernels_1_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reduction_odd_shapes_view_size1_num_block_pointers_3_num_triton_kernels_2_reduction_op1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reduction_odd_shapes_view_size2_num_block_pointers_1_num_triton_kernels_1_reduction_op2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reduction_odd_shapes_view_size3_num_block_pointers_1_num_triton_kernels_1_reduction_op3_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reduction_odd_shapes_view_size4_num_block_pointers_1_num_triton_kernels_1_reduction_op4_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_welford_reduction_size0_expected_num_block_pointers_1_expected_num_triton_kernels_1_expect_fallback_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_welford_reduction_size1_expected_num_block_pointers_9_expected_num_triton_kernels_2_expect_fallback_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_3d_permute_tiling_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_boundary_check_block_multiple_False_ynumel_exceed_ygrid_size_False_include_z_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_boundary_check_block_multiple_True_ynumel_exceed_ygrid_size_False_include_z_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_boundary_check_block_multiple_True_ynumel_exceed_ygrid_size_True_include_z_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_False_x_size0_y_size0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_False_x_size1_y_size1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_False_x_size2_y_size2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_False_x_size3_y_size3_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_True_x_size0_y_size0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_True_x_size1_y_size1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_True_x_size2_y_size2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_prefer_nd_tiling_True_x_size3_y_size3_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_broadcast_with_singleton_dims_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_complex_reshape_block_ptr_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_dynamic_shapes_pointwise_multiple_max_block_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_dynamic_shapes_pointwise_nd_tiling_False_num_block_pointers_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_dynamic_shapes_pointwise_nd_tiling_True_num_block_pointers_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_dynamic_shapes_reduction_with_tiling_False_num_block_pointers_0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_dynamic_shapes_reduction_with_tiling_True_num_block_pointers_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_enable_tiled_reductions_tile_reductions_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_enable_tiled_reductions_tile_reductions_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_ensure_integral_dims_and_strides_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size0_y_size0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size1_y_size1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size2_y_size2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size3_y_size3_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size4_y_size4_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size5_y_size5_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size6_y_size6_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size7_y_size7_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size8_y_size8_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_broadcast_x_size9_y_size9_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expand_clone_broadcast_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expected_num_block_pointers_expected_num_block_pointers_3_raises_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_expected_num_block_pointers_expected_num_block_pointers_9_raises_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_fused_2d_reduction_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_mixed_pointwise_reduction_view_size0_num_block_pointers_2_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_mixed_pointwise_reduction_view_size1_num_block_pointers1_num_triton_kernels1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_mul_broadcast_multi_output_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_multiple_max_block_non_power_of_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_nd_tiling_odd_shapes_pointwise_full_size0_view_size0_num_block_pointers_3_num_tiles_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_nd_tiling_odd_shapes_pointwise_full_size1_view_size1_num_block_pointers_3_num_tiles_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_nd_tiling_odd_shapes_pointwise_full_size2_view_size2_num_block_pointers_3_num_tiles_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_nd_tiling_odd_shapes_pointwise_full_size3_view_size3_num_block_pointers_3_num_tiles_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_nd_tiling_odd_shapes_pointwise_full_size4_view_size4_num_block_pointers_3_num_tiles_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_nd_tiling_odd_shapes_pointwise_full_size5_view_size5_num_block_pointers_1_num_tiles_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_negative_strides_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_broadcast_nonzero_strides_prefer_nd_tiling_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_broadcast_nonzero_strides_prefer_nd_tiling_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_index_order_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size0_view_size0_stride0_offset0_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size1_view_size1_stride1_offset1_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size2_view_size2_stride2_offset2_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size3_view_size3_stride3_offset_10_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size4_view_size4_stride4_offset4_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size5_view_size5_stride5_offset5_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size6_view_size6_stride6_offset6_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size7_view_size7_stride7_offset7_require_block_ptr_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size8_view_size8_stride8_offset8_require_block_ptr_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_False_full_size9_view_size9_stride9_offset9_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size0_view_size0_stride0_offset0_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size1_view_size1_stride1_offset1_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size2_view_size2_stride2_offset2_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size3_view_size3_stride3_offset_10_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size4_view_size4_stride4_offset4_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size5_view_size5_stride5_offset5_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size6_view_size6_stride6_offset6_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size7_view_size7_stride7_offset7_require_block_ptr_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size8_view_size8_stride8_offset8_require_block_ptr_False_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_pointwise_prefer_nd_tiling_True_full_size9_view_size9_stride9_offset9_require_block_ptr_True_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_multiple_discontiguous_dims_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_False_view_size0_num_block_pointers_1_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_False_view_size1_num_block_pointers_1_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_False_view_size2_num_block_pointers_1_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_False_view_size3_num_block_pointers3_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_False_view_size4_num_block_pointers_3_num_triton_kernels_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_False_view_size5_num_block_pointers_2_num_triton_kernels_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_False_view_size6_num_block_pointers_3_num_triton_kernels_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_True_view_size0_num_block_pointers_1_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_True_view_size1_num_block_pointers_1_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_True_view_size2_num_block_pointers_1_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_True_view_size3_num_block_pointers3_num_triton_kernels_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_True_view_size4_num_block_pointers_3_num_triton_kernels_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_True_view_size5_num_block_pointers_2_num_triton_kernels_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_reduction_prefer_nd_tiling_True_view_size6_num_block_pointers_3_num_triton_kernels_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_removed_buffers_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_unbacked_size_on_non_contig_dim_num_tile_candidates_1_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_unbacked_size_on_non_contig_dim_num_tile_candidates_2_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_welford_non_block_pointer_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reduction_multi_kernel_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reduction_odd_shapes_view_size0_num_block_pointers_1_num_triton_kernels_1_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reduction_odd_shapes_view_size1_num_block_pointers_3_num_triton_kernels_2_reduction_op1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reduction_odd_shapes_view_size2_num_block_pointers_1_num_triton_kernels_1_reduction_op2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reduction_odd_shapes_view_size3_num_block_pointers_1_num_triton_kernels_1_reduction_op3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reduction_odd_shapes_view_size4_num_block_pointers_1_num_triton_kernels_1_reduction_op4_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_welford_reduction_size0_expected_num_block_pointers_1_expected_num_triton_kernels_1_expect_fallback_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_welford_reduction_size1_expected_num_block_pointers_9_expected_num_triton_kernels_2_expect_fallback_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_3d_permute_tiling_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_boundary_check_block_multiple_False_ynumel_exceed_ygrid_size_False_include_z_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_boundary_check_block_multiple_True_ynumel_exceed_ygrid_size_False_include_z_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_boundary_check_block_multiple_True_ynumel_exceed_ygrid_size_True_include_z_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_False_x_size0_y_size0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_False_x_size1_y_size1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_False_x_size2_y_size2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_False_x_size3_y_size3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_True_x_size0_y_size0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_True_x_size1_y_size1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_True_x_size2_y_size2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_prefer_nd_tiling_True_x_size3_y_size3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_complex_reshape_block_ptr_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_dynamic_shapes_pointwise_multiple_max_block_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_dynamic_shapes_pointwise_nd_tiling_False_num_block_pointers_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_dynamic_shapes_pointwise_nd_tiling_True_num_block_pointers_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_dynamic_shapes_reduction_with_tiling_False_num_block_pointers_0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_dynamic_shapes_reduction_with_tiling_True_num_block_pointers_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_enable_tiled_reductions_tile_reductions_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_enable_tiled_reductions_tile_reductions_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_ensure_integral_dims_and_strides_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size0_y_size0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size1_y_size1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size2_y_size2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size3_y_size3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size4_y_size4_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size5_y_size5_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size6_y_size6_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size7_y_size7_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size8_y_size8_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_broadcast_x_size9_y_size9_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expand_clone_broadcast_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expected_num_block_pointers_expected_num_block_pointers_3_raises_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_expected_num_block_pointers_expected_num_block_pointers_9_raises_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_fused_2d_reduction_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_mixed_pointwise_reduction_view_size0_num_block_pointers_2_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_mixed_pointwise_reduction_view_size1_num_block_pointers1_num_triton_kernels1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_mul_broadcast_multi_output_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_multiple_max_block_non_power_of_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_nd_tiling_odd_shapes_pointwise_full_size0_view_size0_num_block_pointers_3_num_tiles_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_nd_tiling_odd_shapes_pointwise_full_size1_view_size1_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_nd_tiling_odd_shapes_pointwise_full_size2_view_size2_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_nd_tiling_odd_shapes_pointwise_full_size3_view_size3_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_nd_tiling_odd_shapes_pointwise_full_size4_view_size4_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_nd_tiling_odd_shapes_pointwise_full_size5_view_size5_num_block_pointers_1_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_negative_strides_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_broadcast_nonzero_strides_prefer_nd_tiling_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_broadcast_nonzero_strides_prefer_nd_tiling_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_index_order_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size0_view_size0_stride0_offset0_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size1_view_size1_stride1_offset1_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size2_view_size2_stride2_offset2_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size3_view_size3_stride3_offset_10_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size4_view_size4_stride4_offset4_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size5_view_size5_stride5_offset5_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size6_view_size6_stride6_offset6_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size7_view_size7_stride7_offset7_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size8_view_size8_stride8_offset8_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_False_full_size9_view_size9_stride9_offset9_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size0_view_size0_stride0_offset0_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size1_view_size1_stride1_offset1_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size2_view_size2_stride2_offset2_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size3_view_size3_stride3_offset_10_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size4_view_size4_stride4_offset4_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size5_view_size5_stride5_offset5_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size6_view_size6_stride6_offset6_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size7_view_size7_stride7_offset7_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size8_view_size8_stride8_offset8_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_pointwise_prefer_nd_tiling_True_full_size9_view_size9_stride9_offset9_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_multiple_discontiguous_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_False_view_size0_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_False_view_size1_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_False_view_size2_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_False_view_size3_num_block_pointers3_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_False_view_size4_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_False_view_size5_num_block_pointers_2_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_False_view_size6_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_True_view_size0_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_True_view_size1_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_True_view_size2_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_True_view_size3_num_block_pointers3_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_True_view_size4_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_True_view_size5_num_block_pointers_2_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_reduction_prefer_nd_tiling_True_view_size6_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_removed_buffers_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_unbacked_size_on_non_contig_dim_num_tile_candidates_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_unbacked_size_on_non_contig_dim_num_tile_candidates_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_welford_non_block_pointer_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reduction_multi_kernel_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reduction_odd_shapes_view_size0_num_block_pointers_1_num_triton_kernels_1_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reduction_odd_shapes_view_size1_num_block_pointers_3_num_triton_kernels_2_reduction_op1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reduction_odd_shapes_view_size2_num_block_pointers_1_num_triton_kernels_1_reduction_op2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reduction_odd_shapes_view_size3_num_block_pointers_1_num_triton_kernels_1_reduction_op3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reduction_odd_shapes_view_size4_num_block_pointers_1_num_triton_kernels_1_reduction_op4_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_welford_reduction_size0_expected_num_block_pointers_1_expected_num_triton_kernels_1_expect_fallback_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_welford_reduction_size1_expected_num_block_pointers_9_expected_num_triton_kernels_2_expect_fallback_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_3d_permute_tiling_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_boundary_check_block_multiple_False_ynumel_exceed_ygrid_size_False_include_z_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_boundary_check_block_multiple_True_ynumel_exceed_ygrid_size_False_include_z_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_boundary_check_block_multiple_True_ynumel_exceed_ygrid_size_True_include_z_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_False_x_size0_y_size0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_False_x_size1_y_size1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_False_x_size2_y_size2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_False_x_size3_y_size3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_True_x_size0_y_size0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_True_x_size1_y_size1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_True_x_size2_y_size2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_prefer_nd_tiling_True_x_size3_y_size3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_complex_reshape_block_ptr_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_dynamic_shapes_pointwise_multiple_max_block_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_dynamic_shapes_pointwise_nd_tiling_False_num_block_pointers_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_dynamic_shapes_pointwise_nd_tiling_True_num_block_pointers_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_dynamic_shapes_reduction_with_tiling_False_num_block_pointers_0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_dynamic_shapes_reduction_with_tiling_True_num_block_pointers_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_enable_tiled_reductions_tile_reductions_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_enable_tiled_reductions_tile_reductions_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_ensure_integral_dims_and_strides_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size0_y_size0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size1_y_size1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size2_y_size2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size3_y_size3_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size4_y_size4_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size5_y_size5_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size6_y_size6_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size7_y_size7_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size8_y_size8_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_broadcast_x_size9_y_size9_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expand_clone_broadcast_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expected_num_block_pointers_expected_num_block_pointers_3_raises_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_expected_num_block_pointers_expected_num_block_pointers_9_raises_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_fused_2d_reduction_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_mixed_pointwise_reduction_view_size0_num_block_pointers_2_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_mixed_pointwise_reduction_view_size1_num_block_pointers1_num_triton_kernels1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_mul_broadcast_multi_output_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_multiple_max_block_non_power_of_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_nd_tiling_odd_shapes_pointwise_full_size0_view_size0_num_block_pointers_3_num_tiles_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_nd_tiling_odd_shapes_pointwise_full_size1_view_size1_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_nd_tiling_odd_shapes_pointwise_full_size2_view_size2_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_nd_tiling_odd_shapes_pointwise_full_size3_view_size3_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_nd_tiling_odd_shapes_pointwise_full_size4_view_size4_num_block_pointers_3_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_nd_tiling_odd_shapes_pointwise_full_size5_view_size5_num_block_pointers_1_num_tiles_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_negative_strides_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_broadcast_nonzero_strides_prefer_nd_tiling_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_broadcast_nonzero_strides_prefer_nd_tiling_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_index_order_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size0_view_size0_stride0_offset0_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size1_view_size1_stride1_offset1_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size2_view_size2_stride2_offset2_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size3_view_size3_stride3_offset_10_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size4_view_size4_stride4_offset4_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size5_view_size5_stride5_offset5_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size6_view_size6_stride6_offset6_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size7_view_size7_stride7_offset7_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size8_view_size8_stride8_offset8_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_False_full_size9_view_size9_stride9_offset9_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size0_view_size0_stride0_offset0_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size1_view_size1_stride1_offset1_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size2_view_size2_stride2_offset2_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size3_view_size3_stride3_offset_10_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size4_view_size4_stride4_offset4_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size5_view_size5_stride5_offset5_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size6_view_size6_stride6_offset6_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size7_view_size7_stride7_offset7_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size8_view_size8_stride8_offset8_require_block_ptr_False_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_pointwise_prefer_nd_tiling_True_full_size9_view_size9_stride9_offset9_require_block_ptr_True_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_multiple_discontiguous_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_False_view_size0_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_False_view_size1_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_False_view_size2_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_False_view_size3_num_block_pointers3_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_False_view_size4_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_False_view_size5_num_block_pointers_2_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_False_view_size6_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_True_view_size0_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_True_view_size1_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_True_view_size2_num_block_pointers_1_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_True_view_size3_num_block_pointers3_num_triton_kernels_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_True_view_size4_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_True_view_size5_num_block_pointers_2_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_reduction_prefer_nd_tiling_True_view_size6_num_block_pointers_3_num_triton_kernels_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_removed_buffers_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_unbacked_size_on_non_contig_dim_num_tile_candidates_1_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_unbacked_size_on_non_contig_dim_num_tile_candidates_2_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_welford_non_block_pointer_cuda 2025-09-07T08:22:29.0074125Z 2025-09-07T08:22:29.0074279Z Running inductor/test_triton_cpu_backend 1/1 ... [2025-09-07 08:22:28.993682] 2025-09-07T08:22:29.0074463Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:22:29.0074869Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_triton_cpu_backend.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:22:28.994225] 2025-09-07T08:22:36.6829015Z 2025-09-07T08:22:36.6829772Z inductor/test_triton_cpu_backend 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_triton_cpu_backend_1.1_36d4c1628da61edd_.log 2025-09-07T08:22:36.6830196Z 2025-09-07T08:22:36.6872489Z Running inductor/test_triton_wrapper 1/1 ... [2025-09-07 08:22:36.683266] 2025-09-07T08:22:36.6874206Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:22:36.6878491Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_triton_wrapper.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:22:36.687491] 2025-09-07T08:22:52.8105288Z 2025-09-07T08:22:52.8105993Z inductor/test_triton_wrapper 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_triton_wrapper_1.1_2f29452dd173655e_.log 2025-09-07T08:22:52.8113041Z Running 1 items in this shard: test/inductor/test_triton_wrapper.py::TestTritonWrapper::test_wrapper_using_gpu_seed 2025-09-07T08:22:52.8113640Z 2025-09-07T08:22:52.8135798Z Running inductor/test_unbacked_symints 1/1 ... [2025-09-07 08:22:52.810583] 2025-09-07T08:22:52.8136066Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:22:52.8136670Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_unbacked_symints.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:22:52.810836] 2025-09-07T08:23:23.1528172Z 2025-09-07T08:23:23.1528834Z inductor/test_unbacked_symints 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_unbacked_symints_1.1_b8a8c7241847bfec_.log 2025-09-07T08:23:23.1533490Z Running 27 items in this shard: test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_autotuning_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_broadcast_tensors_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_einsum_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_equivalent_backed_unbacked_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_expand_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_expand_ok_with_runtime_assert_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_issue_143498_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_mm_and_friends_addmm_False_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_mm_and_friends_addmm_True_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_mm_and_friends_bmm_False_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_mm_and_friends_bmm_True_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_mm_and_friends_mm_False_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_mm_and_friends_mm_True_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_nonzero_in_inference_mode_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_sdpfa_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_split_with_sizes_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_to_int_with_unbacked_size_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_triton_kernel_grid_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_unbacked_linear_layer_norm_input_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_unbacked_masked_scatter_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_unbacked_range_tree_divisor_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_unbacked_repeat_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_unbacked_slice_on_subclass_dynamic2_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_unbacked_slice_on_subclass_dynamic_False_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_unbacked_slice_on_subclass_dynamic_True_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_vertical_pointwise_reduction_fusion_cuda, test/inductor/test_unbacked_symints.py::TestUnbackedSymintsCUDA::test_view_of_slice_cuda 2025-09-07T08:23:23.1537446Z 2025-09-07T08:23:23.1537747Z Running inductor/test_utils 1/1 ... [2025-09-07 08:23:23.152820] 2025-09-07T08:23:23.1538026Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:23.1538431Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:23.153096] 2025-09-07T08:23:26.5421889Z 2025-09-07T08:23:26.5422503Z inductor/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_utils_1.1_28a694b31ea90035_.log 2025-09-07T08:23:26.5423619Z Running 7 items in this shard: test/inductor/test_utils.py::TestUtilsCUDA::testSympySubs_cuda, test/inductor/test_utils.py::TestUtilsCUDA::test_flops_fx_cuda, test/inductor/test_utils.py::TestUtilsCUDA::test_get_device_tflops_cuda_bfloat16, test/inductor/test_utils.py::TestUtilsCUDA::test_get_device_tflops_cuda_float16, test/inductor/test_utils.py::TestUtilsCUDA::test_get_device_tflops_cuda_float32, test/inductor/test_utils.py::TestUtilsCUDA::test_sympy_str_cuda, test/inductor/test_utils.py::TestUtilsCUDA::test_zip_schema_cuda 2025-09-07T08:23:26.5424387Z 2025-09-07T08:23:26.5426266Z Running lazy/test_bindings 1/1 ... [2025-09-07 08:23:26.542223] 2025-09-07T08:23:26.5426451Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:26.5428377Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'lazy/test_bindings.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:26.542530] 2025-09-07T08:23:29.0137545Z 2025-09-07T08:23:29.0138978Z lazy/test_bindings 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_bindings_1.1_110937390164a6eb_.log 2025-09-07T08:23:29.0139364Z Running 1 items in this shard: test/lazy/test_bindings.py::test_metrics 2025-09-07T08:23:29.0139516Z 2025-09-07T08:23:29.0140013Z Running lazy/test_debug_util 1/1 ... [2025-09-07 08:23:29.013715] 2025-09-07T08:23:29.0140174Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:29.0152588Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'lazy/test_debug_util.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:29.013945] 2025-09-07T08:23:32.2353636Z 2025-09-07T08:23:32.2374225Z lazy/test_debug_util 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_debug_util_1.1_6ef3abcbb2dc41c5_.log 2025-09-07T08:23:32.2385355Z Running 1 items in this shard: test/lazy/test_debug_util.py::DebugUtilTest::test_get_python_frames 2025-09-07T08:23:32.2386153Z 2025-09-07T08:23:32.2386277Z Running lazy/test_functionalization 1/1 ... [2025-09-07 08:23:32.232612] 2025-09-07T08:23:32.2386492Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:32.2387216Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'lazy/test_functionalization.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:32.232825] 2025-09-07T08:23:34.9667416Z 2025-09-07T08:23:34.9668510Z lazy/test_functionalization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_functionalization_1.1_6f8e4abb0919fda2_.log 2025-09-07T08:23:34.9669389Z Running 2 items in this shard: test/lazy/test_functionalization.py::LazyFuncionalizationTest::test_data_assign, test/lazy/test_functionalization.py::LazyFuncionalizationTest::test_lazy_init_with_view 2025-09-07T08:23:34.9669845Z 2025-09-07T08:23:34.9670173Z Running lazy/test_generator 1/1 ... [2025-09-07 08:23:34.966785] 2025-09-07T08:23:34.9670501Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:34.9704215Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'lazy/test_generator.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:34.967186] 2025-09-07T08:23:37.2958062Z 2025-09-07T08:23:37.2959459Z lazy/test_generator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_generator_1.1_eade5ed967ffd115_.log 2025-09-07T08:23:37.2959999Z Running 2 items in this shard: test/lazy/test_generator.py::LazyGeneratorTest::test_generator, test/lazy/test_generator.py::LazyGeneratorTest::test_generator_causes_multiple_compiles 2025-09-07T08:23:37.2960270Z 2025-09-07T08:23:37.2961268Z Running lazy/test_reuse_ir 1/1 ... [2025-09-07 08:23:37.295824] 2025-09-07T08:23:37.2962698Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:37.2970584Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'lazy/test_reuse_ir.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:37.296059] 2025-09-07T08:23:45.8804204Z 2025-09-07T08:23:45.8805193Z lazy/test_reuse_ir 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_reuse_ir_1.1_9d2d0b8a3362201b_.log 2025-09-07T08:23:45.8805928Z Running 4 items in this shard: test/lazy/test_reuse_ir.py::TestLazyReuseIr::testAdd, test/lazy/test_reuse_ir.py::TestLazyReuseIr::testAddSub, test/lazy/test_reuse_ir.py::TestLazyReuseIr::testAddSubFallback, test/lazy/test_reuse_ir.py::TestLazyReuseIr::testBatchNorm 2025-09-07T08:23:45.8806485Z 2025-09-07T08:23:45.8827445Z Running lazy/test_step_closures 1/1 ... [2025-09-07 08:23:45.880481] 2025-09-07T08:23:45.8827646Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:45.8828087Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'lazy/test_step_closures.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:45.880758] 2025-09-07T08:23:50.6267473Z 2025-09-07T08:23:50.6268154Z lazy/test_step_closures 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_step_closures_1.1_ebc77865834fcc71_.log 2025-09-07T08:23:50.6269329Z Running 4 items in this shard: test/lazy/test_step_closures.py::ClosuresTest::test_asynchronous, test/lazy/test_step_closures.py::ClosuresTest::test_asynchronous_exception, test/lazy/test_step_closures.py::ClosuresTest::test_synchronous, test/lazy/test_step_closures.py::ClosuresTest::test_synchronous_exception 2025-09-07T08:23:50.6269900Z 2025-09-07T08:23:50.6271666Z Running lazy/test_ts_opinfo 1/1 ... [2025-09-07 08:23:50.626826] 2025-09-07T08:23:50.6271852Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:50.6275054Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'lazy/test_ts_opinfo.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:50.627074] 2025-09-07T08:23:54.7559377Z 2025-09-07T08:23:54.7560435Z lazy/test_ts_opinfo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/lazy.test_ts_opinfo_1.1_86f5301eba21dbbd_.log 2025-09-07T08:23:54.7569035Z Running 5 items in this shard: test/lazy/test_ts_opinfo.py::TestLazyTensor::testConvolutionBackward, test/lazy/test_ts_opinfo.py::TestLazyTensor::test_tensor_ctr, test/lazy/test_ts_opinfo.py::TestLazyTensor::test_view_mark_step_preserved, test/lazy/test_ts_opinfo.py::TestLazyDynamicOps::test_adaptiveavgpool3d_dynamic, test/lazy/test_ts_opinfo.py::TestLazyDynamicOps::test_nonzero_dynamic 2025-09-07T08:23:54.7569943Z 2025-09-07T08:23:54.7570249Z Running nn/test_convolution 1/1 ... [2025-09-07 08:23:54.755969] 2025-09-07T08:23:54.7570600Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:23:54.7571760Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'nn/test_convolution.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:23:54.756215] 2025-09-07T08:42:35.5515505Z 2025-09-07T08:42:35.5517049Z nn/test_convolution 1/1 was successful, full logs can be found in artifacts with path test/test-reports/nn.test_convolution_1.1_7e383cff0425c33e_.log 2025-09-07T08:42:35.5636606Z Running 606 items in this shard: test/nn/test_convolution.py::TestConvolutionNN::test_Conv1d_module_same_padding, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_1x1, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_OneDNN, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_backward_twice, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_groups_nobias, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_groups_nobias_v2, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_inconsistent_types, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_inconsistent_types_on_GPU_with_cudnn, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_inconsistent_types_on_GPU_without_cudnn, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_missing_argument, test/nn/test_convolution.py::TestConvolutionNN::test_Conv2d_module_same_padding, test/nn/test_convolution.py::TestConvolutionNN::test_Conv3d_groups_nobias, test/nn/test_convolution.py::TestConvolutionNN::test_Conv3d_groups_wbias, test/nn/test_convolution.py::TestConvolutionNN::test_Conv3d_module_same_padding, test/nn/test_convolution.py::TestConvolutionNN::test_ConvTranspose2d_half_cublas_gemm, test/nn/test_convolution.py::TestConvolutionNN::test_ConvTranspose2d_output_size, test/nn/test_convolution.py::TestConvolutionNN::test_ConvTranspose2d_output_size_downsample_upsample, test/nn/test_convolution.py::TestConvolutionNN::test_ConvTranspose3d_correct_output_size, test/nn/test_convolution.py::TestConvolutionNN::test_conv1d_issue_120547, test/nn/test_convolution.py::TestConvolutionNN::test_conv2d_discontiguous_weight, test/nn/test_convolution.py::TestConvolutionNN::test_conv3d_issue_120406, test/nn/test_convolution.py::TestConvolutionNN::test_conv_backcompat, test/nn/test_convolution.py::TestConvolutionNN::test_conv_cudnn_memory_layout_dominance, test/nn/test_convolution.py::TestConvolutionNN::test_conv_invalid_groups, test/nn/test_convolution.py::TestConvolutionNN::test_conv_modules_raise_error_on_incorrect_input_size, test/nn/test_convolution.py::TestConvolutionNN::test_conv_padding_mode, test/nn/test_convolution.py::TestConvolutionNN::test_conv_shapecheck, test/nn/test_convolution.py::TestConvolutionNN::test_conv_tbc, test/nn/test_convolution.py::TestConvolutionNN::test_cudnn_non_contiguous, test/nn/test_convolution.py::TestConvolutionNN::test_cudnn_noncontiguous_weight, test/nn/test_convolution.py::TestConvolutionNN::test_cudnn_not_mutate_stride, test/nn/test_convolution.py::TestConvolutionNN::test_functional_grad_conv, test/nn/test_convolution.py::TestConvolutionNN::test_functional_grad_conv2d, test/nn/test_convolution.py::TestConvolutionNN::test_grad_conv1d_input, test/nn/test_convolution.py::TestConvolutionNN::test_grad_conv1d_weight, test/nn/test_convolution.py::TestConvolutionNN::test_grad_conv2d_input, test/nn/test_convolution.py::TestConvolutionNN::test_grad_conv2d_weight, test/nn/test_convolution.py::TestConvolutionNN::test_grad_conv3d_input, test/nn/test_convolution.py::TestConvolutionNN::test_grad_conv3d_weight, test/nn/test_convolution.py::TestConvolutionNN::test_grouped_conv_cudnn_nhwc_support, test/nn/test_convolution.py::TestConvolutionNN::test_invalid_conv1d, test/nn/test_convolution.py::TestConvolutionNN::test_invalid_conv2d, test/nn/test_convolution.py::TestConvolutionNN::test_invalid_conv3d, test/nn/test_convolution.py::TestConvolutionNN::test_mismatch_shape_conv2d, test/nn/test_convolution.py::TestConvolutionNN::test_nnpack_conv, test/nn/test_convolution.py::TestConvolutionNN::test_permute_conv2d_issue_120211, test/nn/test_convolution.py::TestConvolutionNN::test_thnn_conv_strided_padded_dilated, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_backward_depthwise_cuda_complex128, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_backward_depthwise_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_depthwise_naive_groups_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_depthwise_naive_groups_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_depthwise_naive_groups_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_1_cuda_bfloat16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_1_cuda_complex128, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_1_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_1_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_1_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_1_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_2_cuda_bfloat16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_2_cuda_complex128, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_2_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_2_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_2_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_2_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_3_cuda_bfloat16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_3_cuda_complex128, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_3_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_3_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_3_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_deterministic_cudnn_dilation_3_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_large_workspace_cuda_bfloat16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_large_workspace_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_large_workspace_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_large_workspace_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_naive_groups_cuda_bfloat16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_naive_groups_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_naive_groups_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_naive_groups_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv2d_size_1_kernel_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv3d_depthwise_naive_groups_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv3d_depthwise_naive_groups_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_Conv3d_depthwise_naive_groups_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_ConvTranspose2d_large_output_padding_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_ConvTranspose2d_large_output_padding_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_ConvTranspose2d_size_1_kernel_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_ConvTranspose3d_size_1_kernel_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_contig_wrong_stride_cudnn_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_same_padding_backward_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_same_padding_backward_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_same_padding_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_same_padding_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_valid_padding_backward_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_valid_padding_backward_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_valid_padding_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_valid_padding_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_vs_scipy_mode_same_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_vs_scipy_mode_same_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_vs_scipy_mode_valid_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv1d_vs_scipy_mode_valid_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_no_grad_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_same_padding_backward_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_same_padding_backward_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_same_padding_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_same_padding_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_valid_padding_backward_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_valid_padding_backward_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_valid_padding_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_valid_padding_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_vs_scipy_mode_same_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_vs_scipy_mode_same_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_vs_scipy_mode_valid_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv2d_vs_scipy_mode_valid_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_64bit_indexing_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_same_padding_backward_cuda_complex128, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_same_padding_backward_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_same_padding_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_same_padding_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_valid_padding_backward_cuda_complex128, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_valid_padding_backward_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_valid_padding_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_valid_padding_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_vs_scipy_mode_same_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_vs_scipy_mode_same_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_vs_scipy_mode_valid_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv3d_vs_scipy_mode_valid_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_convTranspose_empty_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cuda_depthwise3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn1d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn2d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_cudnn3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_batch_channel3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_empty_channel3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen1d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen2d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen3d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_miopen_depthwise3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow1d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow2d_transposed_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cpu_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_cuda_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_False_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_False_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_False_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_False_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_True_strided_False_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_True_strided_False_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_True_strided_True_contiguous_False_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_backend_slow3d_dilated_has_bias_True_strided_True_contiguous_True_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_contiguous_for_oneDNN_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_mismatch_memory_format_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_ndhwc_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_ndhwc_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_nhwc_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_nhwc_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_nhwc_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_nhwc_support_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_cudnn_nhwc_support_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_double_backward_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_double_backward_groups_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_double_backward_no_bias_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_double_backward_stride_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_double_backward_strided_with_3D_input_and_weight_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_empty_channel_cuda_complex64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_empty_channel_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_ic1_channels_last_for_oneDNN_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_large_batch_1_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_large_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_large_nosplit_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_noncontig_weights_and_bias_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_noncontig_weights_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_thnn_nhwc_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_thnn_nhwc_cuda_float64, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_transpose_with_output_size_and_no_batch_dim_ConvTranspose2d_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_transpose_with_output_size_and_no_batch_dim_ConvTranspose3d_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_conv_transposed_large_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_convert_conv2d_weight_memory_format_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_convert_conv3d_weight_memory_format_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_cudnn_convolution_add_relu_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_cudnn_convolution_add_relu_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_cudnn_convolution_relu_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_cudnn_convolution_relu_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_depthwise_conv_64bit_indexing_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_group_convTranspose_empty_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_group_conv_empty_cuda, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_noncontig_conv_grad_cuda_bfloat16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_noncontig_conv_grad_cuda_float16, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_noncontig_conv_grad_cuda_float32, test/nn/test_convolution.py::TestConvolutionNNDeviceTypeCUDA::test_noncontig_conv_grad_cuda_float64 2025-09-07T08:42:35.5748353Z 2025-09-07T08:42:35.5748470Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T08:42:35.5748652Z Uploading artifacts took 0.00 seconds 2025-09-07T08:42:35.5748807Z Running test_autoload_disable 1/1 ... [2025-09-07 08:42:35.553528] 2025-09-07T08:42:35.6973367Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions 2025-09-07T08:42:37.7194958Z Preparing metadata (setup.py) ... [?25l- \ done 2025-09-07T08:42:37.7219117Z [?25hBuilding wheels for collected packages: torch_test_cpp_extension 2025-09-07T08:42:37.7226634Z  DEPRECATION: Building 'torch_test_cpp_extension' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'torch_test_cpp_extension'. Discussion can be found at https://github.com/pypa/pip/issues/6334 2025-09-07T08:44:26.8450859Z  Building wheel for torch_test_cpp_extension (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ done 2025-09-07T08:44:26.8531055Z [?25h Created wheel for torch_test_cpp_extension: filename=torch_test_cpp_extension-0.0.0-cp312-cp312-linux_x86_64.whl size=13035534 sha256=f9271b748b0304c9ac02de1a283492a485abe2f180a41b7a40bcc39e9a1c22ba 2025-09-07T08:44:26.8539535Z Stored in directory: /tmp/pip-ephem-wheel-cache-4_sm31ur/wheels/fc/3b/ed/ea7c0cea7dc731e18eb485707930be2a5fbc6e49db88cadb75 2025-09-07T08:44:26.8547773Z Successfully built torch_test_cpp_extension 2025-09-07T08:44:26.9388801Z Installing collected packages: torch_test_cpp_extension 2025-09-07T08:44:27.0545777Z Successfully installed torch_test_cpp_extension-0.0.0 2025-09-07T08:44:28.3571367Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T08:44:28.3573056Z import pkg_resources 2025-09-07T08:44:28.3707478Z 2025-09-07T08:44:28.3707893Z Running tests... 2025-09-07T08:44:28.3708837Z ---------------------------------------------------------------------- 2025-09-07T08:44:28.5385892Z . 2025-09-07T08:44:28.5396186Z ---------------------------------------------------------------------- 2025-09-07T08:44:28.5396814Z Ran 1 test in 0.168s 2025-09-07T08:44:28.5397006Z 2025-09-07T08:44:28.5397107Z OK 2025-09-07T08:44:28.5397218Z 2025-09-07T08:44:28.5397338Z Generating XML reports... 2025-09-07T08:44:28.9900349Z Running test_decomp 5/12 ... [2025-09-07 08:44:28.989565] 2025-09-07T08:44:28.9900826Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:44:28.9902841Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_decomp.py', '--shard-id=5', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:44:28.989936] 2025-09-07T08:55:47.0030217Z 2025-09-07T08:55:47.0031374Z test_decomp 5/12 was successful, full logs can be found in artifacts with path test/test-reports/test_decomp_5.12_b9375dcf468941a3_.log 2025-09-07T08:55:47.0122180Z Running 800 items in this shard: test/test_decomp.py::TestDecompCUDA::test_comprehensive_T_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rand___cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rdiv___cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rdiv___cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rmod___cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rmul___cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rmul___cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rpow___cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rpow___cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rpow___cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive__chunk_cat_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive__segment_reduce_lengths_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive__unsafe_masked_index_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive__unsafe_masked_index_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_acos_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_acos_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_add_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_add_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addbmm_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addcdiv_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addmm_decomposed_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addr_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addr_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addr_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_alias_copy_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_all_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_all_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_amax_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_amax_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_aminmax_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_any_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_any_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_argmin_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_argsort_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_argsort_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_as_strided_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_as_strided_copy_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_as_strided_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_as_strided_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_as_strided_partial_views_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_as_strided_scatter_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_asin_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_asin_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atan2_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atan_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atanh_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atanh_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_1d_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_1d_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_1d_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_2d_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_2d_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_2d_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bincount_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_and_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_and_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_left_shift_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_or_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_or_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_right_shift_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_xor_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_block_diag_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bmm_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bool_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_broadcast_shapes_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_broadcast_to_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_broadcast_to_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_broadcast_to_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_broadcast_to_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_byte_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_byte_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_byte_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cat_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ceil_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_chalf_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_char_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_char_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clamp_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clamp_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clamp_max_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clone_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clone_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clone_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clone_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_column_stack_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_column_stack_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_column_stack_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_combinations_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_combinations_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_combinations_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_conj_physical_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_conj_physical_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_contiguous_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_contiguous_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_copysign_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cos_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cos_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cosh_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cosh_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_count_nonzero_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_count_nonzero_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_count_nonzero_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cov_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cummax_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cummin_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cummin_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cumprod_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cumprod_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cumulative_trapezoid_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_deg2rad_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_deg2rad_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diag_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diag_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diag_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diag_embed_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diag_embed_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagflat_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_copy_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_copy_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_scatter_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_scatter_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_scatter_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_dist_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_div_no_rounding_mode_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_div_no_rounding_mode_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_dot_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_dot_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_einsum_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_empty_permuted_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_eq_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_eq_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_equal_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_erf_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_erf_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_erfc_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_exp_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_exp_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_expand_as_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_expand_as_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_expand_copy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_eye_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_fft2_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_fft_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_fftn_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_fftn_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_hfftn_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifft_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifftn_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ihfft2_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ihfft_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_irfft2_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_irfft_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_irfftn_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_irfftn_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_rfft_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_rfftn_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fill_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_flatten_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_flip_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_flip_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fliplr_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fliplr_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_float_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fmax_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_frexp_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_full_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_full_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_full_like_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_full_like_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_full_like_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_geqrf_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_gt_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_half_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_half_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_half_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_hash_tensor_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_hash_tensor_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_i0_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_add_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_put_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_put_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_reduce_amax_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_reduce_amax_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_reduce_mean_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_reduce_mean_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_reduce_prod_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isclose_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isfinite_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isinf_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isinf_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isinf_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isnan_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isneginf_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isreal_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_istft_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_item_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_item_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_4inputs_with_extra_args_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_4inputs_with_extra_args_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_binary_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_binary_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_binary_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_binary_return_by_ref_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_binary_return_by_ref_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_unary_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_unary_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_kthvalue_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_kthvalue_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ldexp_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_le_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_le_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_lerp_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_lgamma_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_cholesky_ex_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_cross_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_diagonal_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_eigh_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_eigh_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_eigvalsh_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_inv_ex_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_ldl_factor_ex_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_lu_factor_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_matrix_rank_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_multi_dot_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_norm_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_norm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_pinv_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_pinv_singular_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_slogdet_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_solve_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vander_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vander_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vecdot_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vector_norm_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vector_norm_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linspace_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linspace_tensor_overload_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_log10_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_log1p_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_log1p_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logdet_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logical_or_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logical_or_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logit_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logspace_tensor_overload_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_long_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_long_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_lt_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_lt_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mH_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mH_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mT_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mT_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_amax_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_amax_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_argmax_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_argmax_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_cumprod_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_fill_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_logsumexp_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_logsumexp_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_mean_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_prod_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_prod_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_scatter_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_select_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_softmin_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_std_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_sum_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_sum_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_matrix_exp_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_max_pool2d_with_indices_backward_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_max_reduction_no_dim_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_max_reduction_no_dim_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_max_reduction_no_dim_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_max_reduction_with_dim_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_max_reduction_with_dim_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_maximum_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_median_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_median_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_meshgrid_variadic_tensors_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_min_binary_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_min_reduction_with_dim_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_minimum_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_minimum_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mode_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_movedim_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_msort_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_msort_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mul_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mul_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mul_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mvlgamma_mvlgamma_p_1_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mvlgamma_mvlgamma_p_1_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mvlgamma_mvlgamma_p_5_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nanquantile_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nansum_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_narrow_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_narrow_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_narrow_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_narrow_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_neg_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_neg_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_empty_strided_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_full_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_full_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_ones_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_zeros_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_zeros_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_zeros_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_adaptive_avg_pool2d_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_avg_pool1d_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_batch_norm_without_cudnn_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_binary_cross_entropy_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_celu_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_channel_shuffle_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_conv1d_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_conv2d_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_cosine_embedding_loss_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_cosine_embedding_loss_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_cosine_similarity_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_feature_alpha_dropout_without_train_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_feature_alpha_dropout_without_train_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_gaussian_nll_loss_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_gaussian_nll_loss_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_grid_sample_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_hardsigmoid_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_hardswish_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_hardswish_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_instance_norm_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_interpolate_area_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_interpolate_area_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_interpolate_bicubic_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_interpolate_bilinear_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_interpolate_nearest-exact_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_l1_loss_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_margin_ranking_loss_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_max_pool1d_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_max_pool2d_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_max_unpool2d_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_max_unpool3d_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_max_unpool3d_grad_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_mish_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_circular_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_circular_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_constant_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_constant_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_replicate_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pairwise_distance_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_prelu_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_relu6_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_relu_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_rms_norm_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_rms_norm_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softmin_with_dtype_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softmin_with_dtype_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softmin_with_dtype_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softplus_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softsign_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softsign_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_threshold_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_threshold_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_threshold_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_triplet_margin_loss_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_norm_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_norm_fro_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_norm_inf_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_outer_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_permute_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_permute_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_permute_copy_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_permute_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_permute_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_0_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_positive_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_pow_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_prod_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_qr_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_quantile_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rand_like_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_randint_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_real_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_remainder_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_renorm_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_repeat_interleave_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_reshape_as_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_reshape_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_reshape_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_reshape_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resize__cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resize_as__cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_conj_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_conj_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_conj_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_neg_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_roll_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_roll_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rot90_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_round_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_round_decimals_0_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsqrt_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsqrt_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsub_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_reduce_amin_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_reduce_mean_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_reduce_prod_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_reduce_sum_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_reduce_sum_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_select_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_select_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sgn_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sigmoid_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sigmoid_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_signbit_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_signbit_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sin_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sin_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sinc_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sinc_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_slice_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_slice_scatter_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sort_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sparse_mm_reduce_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_airy_ai_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_bessel_j1_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_bessel_j1_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_bessel_y0_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_bessel_y1_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_chebyshev_polynomial_t_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_chebyshev_polynomial_v_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_chebyshev_polynomial_v_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_chebyshev_polynomial_w_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_entr_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_entr_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_hermite_polynomial_he_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_i1_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_i1_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_i1e_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_legendre_polynomial_p_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_log_ndtr_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_modified_bessel_i0_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_modified_bessel_i0_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_modified_bessel_i1_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_modified_bessel_k0_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_modified_bessel_k0_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_t_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_u_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_w_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_zeta_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_list_args_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_with_sizes_copy_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_square_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_squeeze_copy_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_squeeze_copy_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_squeeze_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_squeeze_multiple_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_squeeze_multiple_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_stack_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_stack_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_std_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_std_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_std_unbiased_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_stft_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sum_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sum_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sum_to_size_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_svd_lowrank_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_t_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_t_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_take_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_take_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_take_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tanh_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tanh_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tanh_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tensor_split_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tensor_split_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tile_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_to_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_to_sparse_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_to_sparse_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_to_sparse_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_to_sparse_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_torch_ops_aten__safe_softmax_default_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trace_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_transpose_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_transpose_copy_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_transpose_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_transpose_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trapz_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trapz_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tril_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_triu_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_true_divide_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trunc_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unbind_copy_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unbind_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unflatten_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unflatten_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unfold_copy_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unfold_copy_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unfold_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unique_consecutive_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unique_consecutive_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unique_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unsafe_split_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unsafe_split_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unsqueeze_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unsqueeze_copy_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unsqueeze_copy_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_var_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_var_mean_unbiased_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_var_unbiased_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_view_as_complex_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_view_as_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_view_as_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_view_copy_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_where_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_zero__cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_zeros_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_zeros_like_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_zeros_like_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick__batch_norm_with_update_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick__chunk_cat_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick__softmax_backward_data_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick__unsafe_masked_index_put_accumulate_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_acos_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_acos_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_acosh_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_add_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_add_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_addcdiv_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_addcmul_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_addmv_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_addr_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_addr_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_alias_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_amin_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_aminmax_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_as_strided_scatter_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_as_strided_scatter_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_atan_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_atanh_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_atanh_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_atanh_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_bernoulli_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_bernoulli_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_or_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_bucketize_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_ceil_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_clamp_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_clamp_max_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_clamp_max_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_clone_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_conj_physical_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_constant_pad_nd_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_constant_pad_nd_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_copysign_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_block_diag_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_index_copy_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_logaddexp2_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_logaddexp_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_native_dropout_backward_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_nn_functional_hardshrink_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_renorm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_special_xlog1py_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_t_copy_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_vdot_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_zero__cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_count_nonzero_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_cumprod_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_cumprod_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_deg2rad_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_deg2rad_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_diag_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_diag_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_diag_embed_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_scatter_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_digamma_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_dist_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_div_floor_rounding_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_div_floor_rounding_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_div_trunc_rounding_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_dot_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_dot_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_empty_like_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_empty_strided_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_empty_strided_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_erf_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_erf_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_erfc_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_erfc_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_erfinv_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_erfinv_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_exp2_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_exp_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_exp_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_exp_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_expand_copy_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_expand_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_expand_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_exponential_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_eye_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_eye_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_fft2_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_fft_fftn_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft2_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifft2_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifft2_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifft_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifft_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifftn_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifftn_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ihfft_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ihfft_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_irfft_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_irfft_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_fft_irfftn_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfft2_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfft2_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfft_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfft_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfftn_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fill_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_floor_divide_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_fmod_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_ge_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_geometric_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_geometric_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_geometric_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_gt_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_i0_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_i0_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_index_add_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_index_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_index_fill_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_index_fill_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_index_select_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_index_select_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_index_select_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_isinf_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_isnan_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_isnan_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_isposinf_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_isposinf_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_lcm_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_lerp_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_lerp_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_lgamma_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_linalg_cross_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_linalg_vector_norm_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_linspace_tensor_overload_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_log10_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_log2_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_log_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_log_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_log_normal_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_log_softmax_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_logaddexp2_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_logical_and_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_logical_not_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_logical_or_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_logical_xor_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_logit_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_logsumexp_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_lt_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_masked_fill_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_masked_fill_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_meshgrid_variadic_tensors_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_meshgrid_variadic_tensors_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_minimum_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_minimum_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_minimum_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_mul_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_mul_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_mv_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_mvlgamma_mvlgamma_p_1_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_mvlgamma_mvlgamma_p_3_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_nan_to_num_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_nan_to_num_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_narrow_copy_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_native_layer_norm_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_ne_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_new_empty_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_new_empty_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_new_full_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_new_full_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_binary_cross_entropy_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_binary_cross_entropy_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_glu_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_hardshrink_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_hardshrink_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_hardtanh_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_max_unpool3d_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_mish_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_mse_loss_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_pad_constant_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_pad_constant_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_prelu_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_silu_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_unfold_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_norm_nuc_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_normal_in_place_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_ones_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_ones_like_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_permute_copy_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_permute_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_permute_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_polar_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_prod_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_prod_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_rad2deg_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_reciprocal_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_reciprocal_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_remainder_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_renorm_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_repeat_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_roll_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_rot90_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_rot90_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_round_decimals_neg_3_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_rsub_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_select_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_select_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_sgn_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_sgn_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_sin_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_sinh_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_sinh_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_sinh_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_slice_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_slice_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_slice_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_special_erfcx_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_special_log_ndtr_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_special_log_ndtr_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_special_ndtri_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_special_ndtri_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_special_xlog1py_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_special_xlog1py_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_special_xlog1py_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_special_xlog1py_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_special_zeta_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_split_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_split_list_args_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_split_with_sizes_copy_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_split_with_sizes_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_split_with_sizes_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_split_with_sizes_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_sqrt_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_sqrt_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_squeeze_multiple_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_std_mean_unbiased_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_sum_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_sum_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_t_copy_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_t_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_t_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_t_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_take_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_take_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_tanh_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_trace_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_transpose_copy_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_triu_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_triu_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_triu_indices_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_trunc_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_unbind_copy_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_unbind_copy_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_unbind_copy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_unbind_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_unfold_copy_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_unfold_copy_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_unfold_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_unfold_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_unsafe_split_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_unsqueeze_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_unsqueeze_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_unsqueeze_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_unsqueeze_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_var_mean_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_var_mean_unbiased_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_where_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_xlogy_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_zero__cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_zero__cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_zeros_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_zeros_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_rnn_decomp_module_nn_RNN_train_mode_cuda_float64, test/test_decomp.py::DecompOneOffTestsCUDA::test_contiguous_log_softmax_cuda 2025-09-07T08:55:47.0200848Z 2025-09-07T08:55:47.0200925Z Running test_decomp 11/12 ... [2025-09-07 08:55:47.003786] 2025-09-07T08:55:47.0201077Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T08:55:47.0201459Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_decomp.py', '--shard-id=11', '--num-shards=12', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 08:55:47.004061] 2025-09-07T09:05:34.6971602Z 2025-09-07T09:05:34.6981485Z test_decomp 11/12 was successful, full logs can be found in artifacts with path test/test-reports/test_decomp_11.12_19cbacc9351f1b64_.log 2025-09-07T09:05:34.7056962Z Running 709 items in this shard: test/test_decomp.py::TestDecompCUDA::test_cat_single_input_cuda, test/test_decomp.py::TestDecompCUDA::test_comprehensive_T_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive___getitem___cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive___radd___cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive___radd___cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rand___cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rdiv___cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rdiv___cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rpow___cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rsub___cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rsub___cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rxor___cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive___rxor___cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive__native_batch_norm_legit_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive__segment_reduce_offsets_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive__unsafe_masked_index_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive__unsafe_masked_index_put_accumulate_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive__unsafe_masked_index_put_accumulate_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_abs_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_acos_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_acosh_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_acosh_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_acosh_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_acosh_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_add_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addbmm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addcmul_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_addr_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_alias_copy_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_argmax_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_argsort_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_as_strided_copy_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_asin_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_asinh_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atan_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atan_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atanh_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atanh_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_1d_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_1d_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_2d_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_2d_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_2d_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_atleast_2d_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bfloat16_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bfloat16_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_xor_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_bitwise_xor_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_block_diag_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cat_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cdist_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cdist_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cfloat_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_char_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_char_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cholesky_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clamp_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clamp_max_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clamp_min_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_clone_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_conj_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_conj_physical_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_corrcoef_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cos_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cos_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_count_nonzero_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_count_nonzero_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cov_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cummax_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cumprod_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cumprod_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cumsum_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_cumulative_trapezoid_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diag_embed_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diag_embed_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagflat_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_copy_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diagonal_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_diff_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_digamma_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_dist_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_div_floor_rounding_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_div_no_rounding_mode_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_double_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_dstack_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_einsum_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_empty_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_empty_permuted_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_empty_permuted_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_eq_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_eq_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_equal_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_erfc_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_erfc_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_erfinv_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_exp2_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_exp2_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_exp2_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_exp_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_exp_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_expand_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_expand_copy_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_expm1_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_expm1_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_hfft_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_hfftn_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_hfftn_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_hfftn_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_hfftn_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifft2_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifft_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifftn_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifftn_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifftshift_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ifftshift_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ihfft2_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ihfft_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_ihfft_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_irfft2_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_irfft_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_rfft_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_rfftn_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fft_rfftn_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fill_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fill_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_flip_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_flip_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_fliplr_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_float_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_float_power_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_floor_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_floor_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_full_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_full_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_grid_sampler_2d_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_grid_sampler_2d_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_hash_tensor_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_heaviside_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_histc_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_hsplit_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_i0_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_fill_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_fill_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_fill_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_reduce_amax_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_select_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_select_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_index_select_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_inner_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_int_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isclose_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isfinite_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isfinite_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isin_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isinf_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isposinf_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isposinf_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_isreal_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_2inputs_2outputs_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_2inputs_2outputs_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_4inputs_with_extra_args_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_jiterator_binary_return_by_ref_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ldexp_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ldexp_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ldexp_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_cross_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_diagonal_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_ldl_factor_ex_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_lstsq_grad_oriented_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_lu_factor_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_lu_factor_ex_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_matrix_rank_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_matrix_rank_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_multi_dot_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_norm_subgradients_at_zero_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_qr_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_solve_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_solve_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_solve_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_solve_ex_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_svdvals_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_svdvals_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vander_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vecdot_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vector_norm_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linalg_vector_norm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linspace_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_linspace_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_log10_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_log_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_log_normal_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logaddexp2_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logaddexp_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logical_and_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logical_and_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logical_not_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logical_not_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_logit_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_long_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_lu_unpack_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mH_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_amax_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_amin_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_cumsum_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_log_softmax_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_logaddexp_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_logaddexp_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_logsumexp_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_logsumexp_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_mean_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_median_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_normalize_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_prod_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_scatter_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_softmax_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_std_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_sum_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_sum_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_sum_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_masked_var_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_max_binary_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_maximum_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_meshgrid_list_of_tensors_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_meshgrid_variadic_tensors_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_min_binary_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_min_reduction_with_dim_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mode_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_movedim_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_movedim_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mul_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mul_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mv_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_mvlgamma_mvlgamma_p_5_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nan_to_num_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nanmean_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nanmedian_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nansum_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_narrow_copy_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_native_layer_norm_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_native_layer_norm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ne_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_empty_strided_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_full_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_new_ones_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nextafter_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_adaptive_avg_pool1d_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_adaptive_max_pool1d_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_adaptive_max_pool1d_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_channel_shuffle_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_conv1d_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_conv_transpose2d_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_conv_transpose2d_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_conv_transpose3d_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_conv_transpose3d_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_dropout3d_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_fractional_max_pool2d_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_grid_sample_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_group_norm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_hardtanh_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_hardtanh_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_hinge_embedding_loss_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_interpolate_nearest_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_kl_div_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_l1_loss_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_layer_norm_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_leaky_relu_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_margin_ranking_loss_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_margin_ranking_loss_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_max_unpool1d_grad_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_max_unpool3d_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_normalize_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_circular_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_constant_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_constant_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pad_replicate_negative_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pairwise_distance_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pdist_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pixel_unshuffle_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_pixel_unshuffle_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_relu6_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_relu_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_relu_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_rms_norm_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_rms_norm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_rrelu_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_silu_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_soft_margin_loss_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_soft_margin_loss_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softmin_with_dtype_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softmin_with_dtype_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softmin_with_dtype_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softshrink_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_softsign_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_tanhshrink_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_triplet_margin_loss_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_unfold_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nn_functional_unfold_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nonzero_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nonzero_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_nonzero_static_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_norm_inf_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_norm_nuc_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_norm_nuc_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_normal_in_place_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_normal_number_mean_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_outer_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polar_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_0_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_0_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_1_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_1_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_1_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_2_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_2_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_3_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_4_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_polygamma_polygamma_n_4_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_pow_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_pow_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_pow_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_prod_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_prod_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_qr_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rad2deg_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_randint_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_randn_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ravel_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ravel_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_ravel_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_reciprocal_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_repeat_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_repeat_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_repeat_interleave_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_reshape_as_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_reshape_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resize__cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resize__cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_conj_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_conj_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_neg_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_resolve_neg_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rot90_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsqrt_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsqrt_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsqrt_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsub_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_rsub_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scalar_tensor_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scalar_tensor_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_add_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_reduce_amin_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_scatter_reduce_sum_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sigmoid_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sign_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_signal_windows_blackman_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_signal_windows_cosine_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_signal_windows_exponential_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_signal_windows_kaiser_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_signbit_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sinc_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sinh_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sinh_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_slice_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_softmax_with_dtype_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sparse_sampled_addmm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_airy_ai_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_airy_ai_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_bessel_j1_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_bessel_y1_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_chebyshev_polynomial_t_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_chebyshev_polynomial_t_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_chebyshev_polynomial_u_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_entr_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_entr_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_erfcx_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_hermite_polynomial_he_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_i1_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_i1e_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_i1e_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_i1e_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_laguerre_polynomial_l_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_log_ndtr_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_modified_bessel_k1_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_ndtr_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_ndtri_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_scaled_modified_bessel_k0_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_scaled_modified_bessel_k1_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_scaled_modified_bessel_k1_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_t_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_u_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_special_shifted_chebyshev_polynomial_w_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_list_args_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_list_args_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_list_args_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_with_sizes_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_with_sizes_copy_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_with_sizes_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_split_with_sizes_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_squeeze_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_squeeze_multiple_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_stack_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_stack_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_std_mean_unbiased_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_stft_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sub_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_sum_to_size_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_t_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_t_copy_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_take_along_dim_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_take_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_take_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tan_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tan_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tanh_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tensor_split_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tensordot_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tile_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_to_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_to_sparse_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_torch__scaled_mm_cuda_float8_e4m3fn, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trace_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_comprehensive_transpose_copy_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trapezoid_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trapezoid_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_triangular_solve_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tril_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_tril_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_true_divide_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_trunc_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unbind_copy_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unfold_copy_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unfold_copy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unfold_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unique_consecutive_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unsafe_split_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_unsafe_split_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_vdot_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_view_copy_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_view_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_comprehensive_view_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_vsplit_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_comprehensive_vsplit_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_vstack_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_vstack_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_comprehensive_where_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_comprehensive_where_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_comprehensive_zeros_like_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick__native_batch_norm_legit_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick__unsafe_masked_index_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_abs_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_acos_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_acos_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_acosh_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_acosh_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_add_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_addmm_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_alias_copy_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_alias_copy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_all_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_all_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_amax_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_any_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_any_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_any_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_as_strided_copy_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_asin_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_atan2_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_atanh_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_baddbmm_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_and_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_not_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_or_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_right_shift_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_xor_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_xor_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_bitwise_xor_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_block_diag_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_bucketize_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_bucketize_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_bucketize_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_clamp_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_clamp_min_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_clamp_min_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_clone_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_conj_physical_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_constant_pad_nd_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward__softmax_backward_data_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward__unsafe_masked_index_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_index_add_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_nn_functional_max_unpool2d_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_std_mean_unbiased_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_core_backward_t_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_cosh_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_cumprod_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_diag_embed_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_copy_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_copy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_diagonal_scatter_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_div_floor_rounding_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_div_floor_rounding_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_div_no_rounding_mode_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_erfc_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_erfinv_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_exp2_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_exp2_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_expand_copy_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_expand_copy_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_expand_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_expand_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_expm1_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_expm1_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_expm1_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_eye_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_fft2_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_fft_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_fftn_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft2_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft2_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft2_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfft_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_fft_hfftn_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifft2_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifft2_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ifftn_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ihfft2_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ihfft_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ihfft_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_ihfftn_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_irfft2_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_fft_irfft_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_irfftn_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfft2_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfft_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_fft_rfftn_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_flip_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_floor_divide_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_fmin_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_fmod_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_full_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_ge_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_geometric_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_heaviside_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_igammac_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_index_add_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_index_copy_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_index_fill_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_index_fill_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_isin_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_isinf_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_isinf_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_isinf_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_isnan_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_isneginf_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_isneginf_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_isposinf_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_linalg_cross_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_linalg_diagonal_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_linalg_diagonal_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_log2_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_log_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_logical_and_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_logical_or_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_logical_xor_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_logical_xor_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_logit_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_logspace_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_logspace_tensor_overload_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_lt_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_masked_fill_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_masked_fill_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_maximum_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_meshgrid_list_of_tensors_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_meshgrid_variadic_tensors_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_minimum_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_mvlgamma_mvlgamma_p_1_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_mvlgamma_mvlgamma_p_1_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_mvlgamma_mvlgamma_p_5_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_mvlgamma_mvlgamma_p_5_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_mvlgamma_mvlgamma_p_5_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_nan_to_num_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_nan_to_num_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_nan_to_num_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_narrow_copy_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_narrow_copy_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_neg_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_new_empty_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_new_empty_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_new_empty_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_new_empty_strided_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_new_full_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_new_full_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_new_zeros_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nextafter_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_nextafter_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_elu_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_gelu_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_hardsigmoid_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_hardtanh_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_huber_loss_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_huber_loss_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_leaky_relu_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_max_unpool2d_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_rrelu_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_silu_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_softplus_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_nn_functional_unfold_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_norm_inf_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_norm_inf_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_normal_number_mean_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_ones_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_permute_copy_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_permute_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_pow_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_pow_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_randn_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_randn_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_randn_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_reciprocal_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_renorm_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_repeat_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_repeat_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_round_decimals_neg_3_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_rsqrt_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_rsqrt_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_select_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_select_scatter_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_sgn_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_sgn_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_sgn_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_sigmoid_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_sigmoid_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_sign_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_signbit_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_sin_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_sinc_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_sinh_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_slice_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_slice_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_softmax_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_special_entr_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_special_entr_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_special_erfcx_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_special_i0e_cuda_int16, test/test_decomp.py::TestDecompCUDA::test_quick_special_i0e_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_special_i1_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_special_i1_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_special_i1e_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_special_i1e_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_special_ndtri_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_split_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_split_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_split_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_split_list_args_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_split_list_args_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_split_with_sizes_copy_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_split_with_sizes_copy_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_split_with_sizes_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_sqrt_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_squeeze_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_squeeze_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_squeeze_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_squeeze_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_stack_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_std_mean_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_sub_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_sub_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_sub_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_sum_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_t_copy_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_t_copy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_t_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_t_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_take_cuda_uint8, test/test_decomp.py::TestDecompCUDA::test_quick_tan_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_tanh_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_trace_cuda_bool, test/test_decomp.py::TestDecompCUDA::test_quick_transpose_copy_cuda_complex64, test/test_decomp.py::TestDecompCUDA::test_quick_transpose_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_tril_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_triu_cuda_complex32, test/test_decomp.py::TestDecompCUDA::test_quick_trunc_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_unbind_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_unbind_cuda_int64, test/test_decomp.py::TestDecompCUDA::test_quick_unbind_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_unfold_copy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_unsqueeze_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_unsqueeze_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_unsqueeze_cuda_int32, test/test_decomp.py::TestDecompCUDA::test_quick_var_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_quick_var_cuda_float64, test/test_decomp.py::TestDecompCUDA::test_quick_var_mean_cuda_complex128, test/test_decomp.py::TestDecompCUDA::test_quick_var_mean_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_view_copy_cuda_float16, test/test_decomp.py::TestDecompCUDA::test_quick_view_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_xlogy_cuda_float32, test/test_decomp.py::TestDecompCUDA::test_quick_xlogy_cuda_int8, test/test_decomp.py::TestDecompCUDA::test_quick_zeros_like_cuda_bfloat16, test/test_decomp.py::TestDecompCUDA::test_rnn_decomp_module_nn_LSTM_eval_mode_cuda_float64, test/test_decomp.py::HasDecompTest::test_aten_core_operators 2025-09-07T09:05:34.7127208Z 2025-09-07T09:05:34.7127308Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T09:05:34.7127484Z Uploading artifacts took 0.00 seconds 2025-09-07T09:05:34.7127635Z Running test_fx_experimental 1/1 ... [2025-09-07 09:05:34.698051] 2025-09-07T09:05:34.7127790Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:05:34.7128163Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_fx_experimental.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:05:34.698482] 2025-09-07T09:07:18.8611600Z 2025-09-07T09:07:18.8613550Z test_fx_experimental 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_fx_experimental_1.1_2bde2867e5709c36_.log 2025-09-07T09:07:18.8765954Z Running 724 items in this shard: test/test_fx_experimental.py::TestFXExperimental::test_annotate_getitem_node, test/test_fx_experimental.py::TestFXExperimental::test_annotate_returns_with_schema, test/test_fx_experimental.py::TestFXExperimental::test_aot_based_partition, test/test_fx_experimental.py::TestFXExperimental::test_call_to_assert_no_msg, test/test_fx_experimental.py::TestFXExperimental::test_call_to_assert_with_empty_msg, test/test_fx_experimental.py::TestFXExperimental::test_call_to_assert_with_msg, test/test_fx_experimental.py::TestFXExperimental::test_call_to_assert_with_multiline_message, test/test_fx_experimental.py::TestFXExperimental::test_conv_bn_fusion, test/test_fx_experimental.py::TestFXExperimental::test_conv_bn_fusion_mixed_dtype, test/test_fx_experimental.py::TestFXExperimental::test_conv_bn_fusion_not_running_state, test/test_fx_experimental.py::TestFXExperimental::test_cost_aware_partition, test/test_fx_experimental.py::TestFXExperimental::test_fetch, test/test_fx_experimental.py::TestFXExperimental::test_find_single_partition, test/test_fx_experimental.py::TestFXExperimental::test_lack_of_devices, test/test_fx_experimental.py::TestFXExperimental::test_large_node_error, test/test_fx_experimental.py::TestFXExperimental::test_merge_matmuls, test/test_fx_experimental.py::TestFXExperimental::test_meta_tracer, test/test_fx_experimental.py::TestFXExperimental::test_normalize_args, test/test_fx_experimental.py::TestFXExperimental::test_normalize_args_perserve_type, test/test_fx_experimental.py::TestFXExperimental::test_normalize_args_preserve_meta, test/test_fx_experimental.py::TestFXExperimental::test_normalize_binary_operators, test/test_fx_experimental.py::TestFXExperimental::test_normalize_modules_exhaustive, test/test_fx_experimental.py::TestFXExperimental::test_optimize_for_inference_cpu, test/test_fx_experimental.py::TestFXExperimental::test_optimize_for_inference_cpu_torchvision, test/test_fx_experimental.py::TestFXExperimental::test_partition_device_mapping, test/test_fx_experimental.py::TestFXExperimental::test_partition_latency, test/test_fx_experimental.py::TestFXExperimental::test_partition_node_manipulation, test/test_fx_experimental.py::TestFXExperimental::test_replace_target_nodes_with, test/test_fx_experimental.py::TestFXExperimental::test_saturate_host, test/test_fx_experimental.py::TestFXExperimental::test_size_based_partition, test/test_fx_experimental.py::TestFXExperimental::test_sparse_nn_partition, test/test_fx_experimental.py::TestFXExperimental::test_split_module_dead_code, test/test_fx_experimental.py::TestFXExperimental::test_split_module_default_arg, test/test_fx_experimental.py::TestFXExperimental::test_split_module_input_names, test/test_fx_experimental.py::TestFXExperimental::test_split_module_keep_original_order_and_noop_graph, test/test_fx_experimental.py::TestFXExperimental::test_split_module_kwargs_expansion, test/test_fx_experimental.py::TestFXExperimental::test_split_module_return_node, test/test_fx_experimental.py::TestFXExperimental::test_split_module_symint_dependency_handling, test/test_fx_experimental.py::TestFXExperimental::test_split_qualname_mapping, test/test_fx_experimental.py::TestFXExperimental::test_subgraph_creation, test/test_fx_experimental.py::TestFXExperimental::test_subgraph_trivial_resnet, test/test_fx_experimental.py::TestFXExperimental::test_subgraph_uniquename, test/test_fx_experimental.py::TestFXExperimental::test_to_folder, test/test_fx_experimental.py::TestFXExperimental::test_traceable_function_with_nonstandard_name, test/test_fx_experimental.py::TestFXExperimental::test_type_matches, test/test_fx_experimental.py::TestTranslationValidation::test_sat, test/test_fx_experimental.py::TestTranslationValidation::test_sat_bitwise, test/test_fx_experimental.py::TestTranslationValidation::test_sympy_to_z3, test/test_fx_experimental.py::TestTranslationValidation::test_unsat, test/test_fx_experimental.py::TestTranslationValidation::test_z3str, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_args_op_overload_cuda, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_H_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_T_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___getitem___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___radd___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___rdiv___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___rmatmul___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___rmod___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___rmul___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___rpow___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive___rsub___cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__batch_norm_with_update_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__chunk_cat_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__native_batch_norm_legit_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__segment_reduce_lengths_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__segment_reduce_offsets_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__softmax_backward_data_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__unsafe_masked_index_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__unsafe_masked_index_put_accumulate_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive__upsample_bilinear2d_aa_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_abs_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_acos_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_acosh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_add_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_addbmm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_addcdiv_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_addcmul_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_addmm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_addmm_decomposed_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_addmv_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_addr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_alias_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_all_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_allclose_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_amax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_amin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_aminmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_angle_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_any_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_arange_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_argmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_argmin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_argsort_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_argwhere_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_as_strided_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_as_strided_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_as_strided_partial_views_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_as_strided_scatter_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_asin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_asinh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_atan2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_atan_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_atanh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_atleast_1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_atleast_2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_atleast_3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_baddbmm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_bernoulli_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_bfloat16_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_block_diag_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_bmm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_bool_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_broadcast_shapes_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_broadcast_tensors_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_broadcast_to_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_bucketize_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_byte_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cartesian_prod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cat_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cauchy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cdist_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cdouble_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ceil_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cfloat_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_chalf_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_char_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cholesky_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cholesky_inverse_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cholesky_solve_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_chunk_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_clamp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_clamp_max_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_clamp_min_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_clone_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_column_stack_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_combinations_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_complex_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_conj_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_conj_physical_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_constant_pad_nd_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_contiguous_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_copysign_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_corrcoef_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cos_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cosh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_count_nonzero_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cov_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cross_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cummax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cummin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cumprod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cumsum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_cumulative_trapezoid_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_deg2rad_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_diag_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_diag_embed_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_diagflat_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_diagonal_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_diagonal_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_diagonal_scatter_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_diff_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_digamma_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_dist_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_div_floor_rounding_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_div_no_rounding_mode_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_div_trunc_rounding_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_dot_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_double_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_dsplit_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_dstack_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_einsum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_empty_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_empty_like_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_empty_permuted_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_empty_strided_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_eq_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_equal_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_erf_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_erfc_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_erfinv_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_exp2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_exp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_expand_as_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_expand_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_expand_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_expm1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_exponential_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_eye_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_fft2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_fft_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_fftn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_fftshift_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_hfft2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_hfft_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_hfftn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_ifft2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_ifft_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_ifftn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_ifftshift_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_ihfft2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_ihfft_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_ihfftn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_irfft2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_irfft_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_irfftn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_rfft2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_rfft_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fft_rfftn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fill_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_flatten_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_flip_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fliplr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_flipud_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_float_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_float_power_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_floor_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_floor_divide_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fmin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_fmod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_frac_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_frexp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_full_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_full_like_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_gather_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ge_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_geometric_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_geqrf_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_gradient_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_grid_sampler_2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_grid_sampler_3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_gt_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_half_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_hash_tensor_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_heaviside_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_histc_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_hsplit_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_hstack_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_hypot_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_i0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_igamma_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_igammac_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_add_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_fill_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_put_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_reduce_amax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_reduce_amin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_reduce_mean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_reduce_prod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_index_select_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_inner_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_int_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isclose_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isfinite_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isinf_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isnan_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isneginf_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isposinf_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_isreal_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_item_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_jiterator_2inputs_2outputs_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_jiterator_4inputs_with_extra_args_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_jiterator_binary_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_jiterator_binary_return_by_ref_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_jiterator_unary_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_kron_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_kthvalue_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ldexp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_le_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_lerp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_lgamma_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_cholesky_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_cholesky_ex_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_cond_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_cross_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_det_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_diagonal_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_eig_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_eigh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_eigvals_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_eigvalsh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_householder_product_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_inv_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_inv_ex_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_ldl_factor_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_ldl_factor_ex_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_ldl_solve_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_lstsq_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_lstsq_grad_oriented_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_lu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_lu_factor_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_lu_factor_ex_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_lu_solve_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_matrix_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_matrix_power_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_matrix_rank_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_matrix_rank_hermitian_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_multi_dot_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_norm_subgradients_at_zero_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_pinv_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_pinv_hermitian_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_pinv_singular_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_qr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_slogdet_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_solve_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_solve_ex_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_solve_triangular_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_svd_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_svdvals_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_tensorinv_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_tensorsolve_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_vander_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_vecdot_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linalg_vector_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linspace_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_linspace_tensor_overload_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_log10_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_log1p_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_log2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_log_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_log_normal_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_log_softmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_log_softmax_with_dtype_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logaddexp2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logaddexp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logcumsumexp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logdet_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logical_and_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logical_not_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logical_or_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logical_xor_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logit_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logspace_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logspace_tensor_overload_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_logsumexp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_long_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_lt_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_lu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_lu_solve_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_lu_unpack_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mH_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mT_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_amax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_amin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_argmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_argmin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_cumprod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_cumsum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_fill_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_log_softmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_logaddexp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_logsumexp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_mean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_median_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_normalize_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_prod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_scatter_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_select_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_softmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_softmin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_std_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_sum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_masked_var_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_matmul_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_matrix_exp_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_max_binary_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_max_pool2d_with_indices_backward_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_max_reduction_no_dim_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_max_reduction_with_dim_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_maximum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_median_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_meshgrid_list_of_tensors_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_meshgrid_variadic_tensors_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_min_binary_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_min_reduction_no_dim_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_min_reduction_with_dim_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_minimum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mode_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_movedim_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_msort_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mul_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_multinomial_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mv_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nan_to_num_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nanmean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nanmedian_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nanquantile_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nansum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_narrow_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_narrow_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_native_batch_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_native_dropout_backward_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_native_layer_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ne_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_neg_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_new_empty_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_new_empty_strided_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_new_full_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_new_ones_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_new_zeros_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nextafter_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_adaptive_avg_pool1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_adaptive_avg_pool2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_adaptive_max_pool1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_adaptive_max_pool2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_adaptive_max_pool3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_alpha_dropout_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_avg_pool1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_avg_pool2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_avg_pool3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_batch_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_bilinear_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_binary_cross_entropy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_binary_cross_entropy_with_logits_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_celu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_channel_shuffle_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_conv1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_conv2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_conv3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_conv_transpose1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_conv_transpose2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_conv_transpose3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_cosine_embedding_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_cosine_similarity_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_cross_entropy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_ctc_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_dropout2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_dropout3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_dropout_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_elu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_embedding_bag_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_embedding_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_feature_alpha_dropout_without_train_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_fractional_max_pool2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_fractional_max_pool3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_gaussian_nll_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_gelu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_glu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_grid_sample_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_group_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_hardshrink_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_hardsigmoid_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_hardswish_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_hardtanh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_hinge_embedding_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_huber_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_instance_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_interpolate_area_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_interpolate_bicubic_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_interpolate_bilinear_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_interpolate_linear_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_interpolate_nearest-exact_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_interpolate_nearest_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_interpolate_trilinear_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_kl_div_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_l1_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_layer_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_leaky_relu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_linear_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_local_response_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_logsigmoid_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_margin_ranking_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_pool1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_pool2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_pool3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_unpool1d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_unpool1d_grad_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_unpool2d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_unpool2d_grad_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_unpool3d_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_max_unpool3d_grad_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_mish_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_mse_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_multi_head_attention_forward_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_multi_margin_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_multilabel_margin_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_nll_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_normalize_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pad_circular_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pad_constant_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pad_reflect_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pad_replicate_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pad_replicate_negative_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pairwise_distance_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pdist_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pixel_shuffle_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_pixel_unshuffle_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_poisson_nll_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_prelu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_relu6_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_relu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_rms_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_rrelu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_scaled_dot_product_attention_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_selu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_silu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_smooth_l1_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_soft_margin_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_softmin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_softmin_with_dtype_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_softplus_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_softshrink_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_softsign_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_tanhshrink_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_threshold_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_triplet_margin_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_unfold_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_upsample_bilinear_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nn_functional_upsample_nearest_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nonzero_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_nonzero_static_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_norm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_norm_fro_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_norm_inf_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_norm_nuc_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_normal_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_normal_in_place_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_normal_number_mean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ones_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ones_like_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ormqr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_outer_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_pca_lowrank_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_permute_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_permute_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_pinverse_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_polar_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_polygamma_polygamma_n_0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_polygamma_polygamma_n_1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_polygamma_polygamma_n_2_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_polygamma_polygamma_n_3_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_polygamma_polygamma_n_4_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_positive_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_pow_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_prod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_put_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_qr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_quantile_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_rad2deg_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_rand_like_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_randint_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_randint_like_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_randn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_randn_like_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_ravel_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_real_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_reciprocal_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_remainder_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_renorm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_repeat_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_repeat_interleave_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_reshape_as_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_reshape_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_resize__cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_resize_as__cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_resolve_conj_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_resolve_neg_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_roll_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_rot90_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_round_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_round_decimals_0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_round_decimals_3_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_round_decimals_neg_3_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_rsqrt_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_rsub_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scalar_tensor_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scatter_add_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scatter_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scatter_reduce_amax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scatter_reduce_amin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scatter_reduce_mean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scatter_reduce_prod_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_scatter_reduce_sum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_searchsorted_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_select_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_select_scatter_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sgn_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_short_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sigmoid_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sign_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_bartlett_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_blackman_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_cosine_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_exponential_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_gaussian_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_general_cosine_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_general_hamming_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_hamming_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_hann_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_kaiser_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signal_windows_nuttall_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_signbit_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sin_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sinc_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sinh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_slice_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_slice_scatter_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_softmax_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_softmax_with_dtype_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sort_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sparse_mm_reduce_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sparse_sampled_addmm_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_airy_ai_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_bessel_j0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_bessel_j1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_bessel_y0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_bessel_y1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_chebyshev_polynomial_t_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_chebyshev_polynomial_u_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_chebyshev_polynomial_v_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_chebyshev_polynomial_w_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_entr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_erfcx_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_hermite_polynomial_h_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_hermite_polynomial_he_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_i0e_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_i1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_i1e_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_laguerre_polynomial_l_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_legendre_polynomial_p_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_log_ndtr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_modified_bessel_i0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_modified_bessel_i1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_modified_bessel_k0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_modified_bessel_k1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_ndtr_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_ndtri_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_scaled_modified_bessel_k0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_scaled_modified_bessel_k1_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_shifted_chebyshev_polynomial_u_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_shifted_chebyshev_polynomial_v_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_shifted_chebyshev_polynomial_w_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_spherical_bessel_j0_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_xlog1py_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_special_zeta_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_split_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_split_list_args_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_split_with_sizes_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_split_with_sizes_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sqrt_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_square_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_squeeze_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_squeeze_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_squeeze_multiple_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_stack_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_std_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_std_mean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_std_mean_unbiased_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_std_unbiased_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_stft_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sub_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sum_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_sum_to_size_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_svd_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_svd_lowrank_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_t_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_t_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_take_along_dim_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_take_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_tan_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_tanh_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_tensor_split_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_tensordot_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_tile_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_to_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_to_sparse_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_topk_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_torch_ops_aten__efficient_attention_forward_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_torch_ops_aten__safe_softmax_default_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_trace_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_transpose_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_transpose_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_trapezoid_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_trapz_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_triangular_solve_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_tril_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_triu_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_true_divide_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_trunc_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unbind_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unbind_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unflatten_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unfold_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unfold_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_uniform_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unique_consecutive_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unique_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unsafe_chunk_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unsafe_split_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unsqueeze_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_unsqueeze_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_var_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_var_mean_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_var_mean_unbiased_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_var_unbiased_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_vdot_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_view_as_complex_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_view_as_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_view_copy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_view_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_vsplit_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_vstack_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_where_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_xlogy_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_zero__cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_zeros_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_operator_exhaustive_zeros_like_cuda_float32, test/test_fx_experimental.py::TestNormalizeOperatorsCUDA::test_normalize_quantized_eb_cuda 2025-09-07T09:07:18.8917969Z 2025-09-07T09:07:18.8918088Z Running test_jit_llga_fuser 1/1 ... [2025-09-07 09:07:18.861892] 2025-09-07T09:07:18.8918324Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:07:18.8925322Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_jit_llga_fuser.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:07:18.862092] 2025-09-07T09:08:02.3161578Z 2025-09-07T09:08:02.3162378Z test_jit_llga_fuser 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_jit_llga_fuser_1.1_3c10c6b38b709736_.log 2025-09-07T09:08:02.3175469Z Running 107 items in this shard: test/test_jit_llga_fuser.py::TestEnableDisableLlgaFuser::test_context_manager, test/test_jit_llga_fuser.py::TestDynamoAOT::test_dynamo_aot_ts_onednn, test/test_jit_llga_fuser.py::TestModel::test_vision_alexnet_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_alexnet_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet121_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet121_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet161_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet161_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet169_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet169_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet201_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_densenet201_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b0_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b0_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b1_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b1_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b2_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b2_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b3_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b3_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b4_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b4_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b5_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b5_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b6_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b6_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b7_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_efficientnet_b7_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_googlenet_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_googlenet_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_mnasnet1_0_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_mnasnet1_0_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_mobilenet_v2_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_mobilenet_v2_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_mobilenet_v3_large_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_mobilenet_v3_large_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_regnet_y_400mf_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_regnet_y_400mf_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_resnet50_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_resnet50_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_resnext101_32x8d_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_resnext101_32x8d_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_resnext50_32x4d_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_resnext50_32x4d_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_shufflenet_v2_x1_0_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_shufflenet_v2_x1_0_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_squeezenet1_0_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_squeezenet1_0_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_vgg16_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_vgg16_float32, test/test_jit_llga_fuser.py::TestModel::test_vision_wide_resnet50_2_bfloat16, test/test_jit_llga_fuser.py::TestModel::test_vision_wide_resnet50_2_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_bn2d_eltwise_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_bn2d_eltwise_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_bn_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_bn_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_bn_relu_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_bn_relu_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_clamp_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_clamp_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_eltwise_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_eltwise_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_silu_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_silu_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_sum_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_conv2d_sum_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_ensure_tensor_is_rewrapped_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_ensure_tensor_is_rewrapped_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_linear_eltwise_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_linear_eltwise_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_rewrap_tensor_input_to_pytorch_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_rewrap_tensor_input_to_pytorch_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_wildcard_cuda_bfloat16, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_wildcard_cuda_float32, test/test_jit_llga_fuser.py::TestFusionPatternCUDA::test_wildcard_unsupported_dtype_cuda_int32, test/test_jit_llga_fuser.py::TestOpCUDA::test_add_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_add_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_add_scalar_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_add_scalar_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_addmm_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_addmm_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_avg_pool2d_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_avg_pool2d_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_bn2d_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_bn2d_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_cat_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_cat_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_conv2d_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_conv2d_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_eltwise_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_eltwise_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_identity_binary_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_identity_binary_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_layer_norm_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_layer_norm_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_linear_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_linear_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_max_pool2d_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_max_pool2d_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_mul_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_mul_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_softmax_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_softmax_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_typecheck_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_typecheck_cuda_float32, test/test_jit_llga_fuser.py::TestOpCUDA::test_variable_kernel_avg_pool2d_cuda_bfloat16, test/test_jit_llga_fuser.py::TestOpCUDA::test_variable_kernel_avg_pool2d_cuda_float32 2025-09-07T09:08:02.3191365Z 2025-09-07T09:08:02.3191500Z Running test_jiterator 1/1 ... [2025-09-07 09:08:02.316129] 2025-09-07T09:08:02.3191679Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:08:02.3192050Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_jiterator.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:08:02.316344] 2025-09-07T09:08:12.7518568Z 2025-09-07T09:08:12.7529281Z test_jiterator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_jiterator_1.1_b5fd6e3154b4a105_.log 2025-09-07T09:08:12.7576512Z Running 289 items in this shard: test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_bfloat16_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex128_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_complex64_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float16_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float32_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_float64_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int16_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int32_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int64_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_int8_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_contiguous_shape_strides0_cuda_uint8_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_bfloat16_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex128_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_complex64_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float16_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float32_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_float64_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int16_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int32_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int64_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_int8_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_complex128, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_complex64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_int16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_int32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_int64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_int8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_all_dtype_noncontiguous_shape_strides0_cuda_uint8_uint8, test/test_jiterator.py::TestPythonJiteratorCUDA::test_bool_extra_args_is_train_False_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_bool_extra_args_is_train_True_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta2_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta2_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta2_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta2_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_-4_2_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_-4_2_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_-4_2_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_-4_2_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_3_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_3_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_3_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha2_beta_3_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta2_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta2_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta2_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta2_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_-4_2_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_-4_2_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_-4_2_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_-4_2_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_3_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_3_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_3_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_-1_beta_3_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta2_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta2_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta2_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta2_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_-4_2_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_-4_2_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_-4_2_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_-4_2_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_3_cuda_bfloat16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_3_cuda_float16, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_3_cuda_float32, test/test_jiterator.py::TestPythonJiteratorCUDA::test_extra_args_alpha_2_0_beta_3_cuda_float64, test/test_jiterator.py::TestPythonJiteratorCUDA::test_invalid_function_name_code_string_template T my _kernel(T x) { return x; }_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_invalid_function_name_code_string_template Tmy_kernel(T x) { return x; }_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_multiple_functors_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_various_num_inputs_num_inputs_1_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_various_num_inputs_num_inputs_5_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_various_num_inputs_num_inputs_8_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_various_num_outputs_num_outputs_1_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_various_num_outputs_num_outputs_4_cuda, test/test_jiterator.py::TestPythonJiteratorCUDA::test_various_num_outputs_num_outputs_8_cuda 2025-09-07T09:08:12.7617769Z 2025-09-07T09:08:12.7617851Z Running test_legacy_vmap 1/1 ... [2025-09-07 09:08:12.752259] 2025-09-07T09:08:12.7618017Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:08:12.7618429Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_legacy_vmap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:08:12.752509] 2025-09-07T09:11:32.9228297Z 2025-09-07T09:11:32.9230327Z test_legacy_vmap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_legacy_vmap_1.1_fcf4dc8e48286f86_.log 2025-09-07T09:11:32.9243468Z Running 124 items in this shard: test/test_legacy_vmap.py::TestVmapAPILegacy::test_accepts_nested_inputs, test/test_legacy_vmap.py::TestVmapAPILegacy::test_backward_unsupported_interaction, test/test_legacy_vmap.py::TestVmapAPILegacy::test_batched_gradient_basic, test/test_legacy_vmap.py::TestVmapAPILegacy::test_constant_function, test/test_legacy_vmap.py::TestVmapAPILegacy::test_different_map_dim_size_raises, test/test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_atan2, test/test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_does_not_warn_by_default, test/test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_masked_fill, test/test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_multiple_returns, test/test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_warns_when_warnings_are_enabled, test/test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_with_undefined_grad, test/test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_zero_dim, test/test_legacy_vmap.py::TestVmapAPILegacy::test_func_with_no_inputs, test/test_legacy_vmap.py::TestVmapAPILegacy::test_functools_partial, test/test_legacy_vmap.py::TestVmapAPILegacy::test_grad_unsupported_interaction, test/test_legacy_vmap.py::TestVmapAPILegacy::test_in_dim_not_in_tensor_err_msg, test/test_legacy_vmap.py::TestVmapAPILegacy::test_in_dims_wrong_type_err_msg, test/test_legacy_vmap.py::TestVmapAPILegacy::test_inplace_fallback_nary_different_levels, test/test_legacy_vmap.py::TestVmapAPILegacy::test_inplace_fallback_nary_same_levels, test/test_legacy_vmap.py::TestVmapAPILegacy::test_inplace_fallback_unary, test/test_legacy_vmap.py::TestVmapAPILegacy::test_integer_in_dim_but_not_tensor_input_err_msg, test/test_legacy_vmap.py::TestVmapAPILegacy::test_multiple_inputs, test/test_legacy_vmap.py::TestVmapAPILegacy::test_multiple_out_dims, test/test_legacy_vmap.py::TestVmapAPILegacy::test_multiple_outputs, test/test_legacy_vmap.py::TestVmapAPILegacy::test_multiple_outputs_error_cases, test/test_legacy_vmap.py::TestVmapAPILegacy::test_nested_non_default_in_dims, test/test_legacy_vmap.py::TestVmapAPILegacy::test_nested_out_dims, test/test_legacy_vmap.py::TestVmapAPILegacy::test_nested_with_different_map_dim, test/test_legacy_vmap.py::TestVmapAPILegacy::test_nested_with_same_map_dim, test/test_legacy_vmap.py::TestVmapAPILegacy::test_nn_module, test/test_legacy_vmap.py::TestVmapAPILegacy::test_non_default_in_dims_out_dims, test/test_legacy_vmap.py::TestVmapAPILegacy::test_non_tensor_output_raises, test/test_legacy_vmap.py::TestVmapAPILegacy::test_non_zero_in_dims, test/test_legacy_vmap.py::TestVmapAPILegacy::test_none_in_dims, test/test_legacy_vmap.py::TestVmapAPILegacy::test_nonzero_out_dims, test/test_legacy_vmap.py::TestVmapAPILegacy::test_noop_in_inner_vmap, test/test_legacy_vmap.py::TestVmapAPILegacy::test_not_enough_in_dims_err_msg, test/test_legacy_vmap.py::TestVmapAPILegacy::test_out_dim_out_of_bounds_err_msg, test/test_legacy_vmap.py::TestVmapAPILegacy::test_out_dims_and_num_outputs_mismatch_err_msg, test/test_legacy_vmap.py::TestVmapAPILegacy::test_out_dims_edge_case, test/test_legacy_vmap.py::TestVmapAPILegacy::test_out_dims_must_be_int_or_tuple_of_int_err_msg, test/test_legacy_vmap.py::TestVmapAPILegacy::test_single_input, test/test_legacy_vmap.py::TestVmapAPILegacy::test_unsupported_op_err_msg, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_T_numpy, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_as_strided, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_binary_pointwise_ops, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_bmm, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_cat, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_chunk, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_clamp, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_clone, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_comparison_ops, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_conj, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_contiguous, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_diagonal, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_dot, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_expand_as, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_fill_and_zero_inplace, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_imag, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_is_complex, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_is_contiguous, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_is_floating_point, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_mm, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_movedim, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_mv, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_narrow, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_new_empty, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_new_empty_strided, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_new_zeros, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_no_random_op_support, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_real, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_reshape, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_reshape_as, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_result_type, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_select, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_slice, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_split, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_squeeze, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_stack, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_stride, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_sum_dim, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_t, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_tensor_split, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_to, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_trace, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_transpose, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_unary_pointwise_ops, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_unbind, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_unfold, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_view, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_view_as, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_view_as_complex, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_view_as_real, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_vmap_fallback_check, test/test_legacy_vmap.py::TestVmapOperatorsLegacy::test_vmap_fallback_check_ok, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_add_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_binary_cross_entropy_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_diagonal_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_div_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_expand_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_index_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_inplace_manyview_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_inplace_on_view_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_lgamma_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_log1p_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_log_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_logsumexp_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_max_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_median_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_min_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_mul_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_permute_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_reshape_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_select_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_sigmoid_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_slice_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_stack_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_sub_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_threshold_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_trace_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_unrelated_output_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_unrelated_output_multiple_grad_cuda, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_vmap_fallback_check, test/test_legacy_vmap.py::TestVmapBatchedGradientLegacyCUDA::test_vmap_fallback_check_ok 2025-09-07T09:11:32.9263219Z 2025-09-07T09:11:32.9263296Z Running test_license 1/1 ... [2025-09-07 09:11:32.919164] 2025-09-07T09:11:32.9263467Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:11:32.9263847Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_license.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:11:32.919397] 2025-09-07T09:11:35.1864369Z 2025-09-07T09:11:35.1874129Z test_license 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_license_1.1_fb57cb588a6cfa80_.log 2025-09-07T09:11:35.1874781Z Running 2 items in this shard: test/test_license.py::TestLicense::test_distinfo_license, test/test_license.py::TestLicense::test_license_for_wheel 2025-09-07T09:11:35.1875085Z 2025-09-07T09:11:35.1875528Z Running test_linalg 1/1 ... [2025-09-07 09:11:35.186430] 2025-09-07T09:11:35.1875766Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:11:35.1882841Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_linalg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:11:35.186616] 2025-09-07T09:16:52.0613595Z 2025-09-07T09:16:52.0614993Z test_linalg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_linalg_1.1_ffda4a31102a80c1_.log 2025-09-07T09:16:52.0767884Z Running 1233 items in this shard: test/test_linalg.py::TestLinalgCUDA::test_1_sized_with_0_strided_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_1_sized_with_0_strided_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_1_k_128_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_1_k_128_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_1_k_64_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_1_k_64_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_32_k_128_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_32_k_128_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_32_k_64_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_matmul_4bit_m_32_k_64_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_256_n_128_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_256_n_32_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_256_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_256_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_64_n_128_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_64_n_32_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_64_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test__dyn_quant_pack_4bit_weight_k_64_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_32_k_32_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_32_k_32_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_32_k_64_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_32_k_64_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_64_k_32_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_64_k_32_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_64_k_64_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test__int4_mm_m_64_k_64_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_large_shape_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_48_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_48_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_48_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_48_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_64_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_64_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_64_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_32_n_64_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_48_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_48_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_48_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_48_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_64_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_64_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_64_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_32_k_64_n_64_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_48_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_48_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_48_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_48_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_64_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_64_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_64_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_32_n_64_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_48_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_48_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_48_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_48_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_64_compile_False_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_64_compile_False_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_64_compile_True_slice_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int8_mm_m_64_k_64_n_64_compile_True_slice_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_0_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_17_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_0_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_16_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_16_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_False_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_False_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_True_use_transpose_b_False_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_0_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_1_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_cpu_m_8_k_32_n_32_use_transpose_a_True_use_transpose_b_True_non_contig_type_2_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_errors_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_16_use_transpose_a_False_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_16_use_transpose_a_False_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_16_use_transpose_a_True_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_16_use_transpose_a_True_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_32_use_transpose_a_False_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_32_use_transpose_a_False_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_32_use_transpose_a_True_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_16_n_32_use_transpose_a_True_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_16_use_transpose_a_False_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_16_use_transpose_a_False_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_16_use_transpose_a_True_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_16_use_transpose_a_True_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_32_use_transpose_a_False_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_32_use_transpose_a_False_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_32_use_transpose_a_True_use_transpose_b_False_cuda, test/test_linalg.py::TestLinalgCUDA::test__int_mm_k_32_n_32_use_transpose_a_True_use_transpose_b_True_cuda, test/test_linalg.py::TestLinalgCUDA::test_addbmm_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addbmm_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_addbmm_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_addbmm_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addbmm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addbmm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addmm_baddbmm_overflow_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_addmm_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_addmm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addmm_gelu_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_gelu_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_gelu_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_gelu_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_0_2_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_False_alpha_1_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_0_2_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_False_transpose_b_True_alpha_1_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_0_2_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_False_alpha_1_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_0_2_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_0_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_0_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_0_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_0_5_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_0_5_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_0_5_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_1_0_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_1_0_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_mv_transpose_a_True_transpose_b_True_alpha_1_0_beta_1_0_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_tunableop_rocm_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_tunableop_rocm_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_tunableop_rocm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_relu_tunableop_rocm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addmm_sizes_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_addmm_sizes_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_addmm_sizes_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmm_sizes_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addmv_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmv_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_addmv_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_addmv_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addmv_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmv_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addmv_rowmajor_colmajor_incx_incy_lda_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addmv_rowmajor_colmajor_incx_incy_lda_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addmv_rowmajor_colmajor_incx_incy_lda_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addr_bool_cuda_bool, test/test_linalg.py::TestLinalgCUDA::test_addr_float_and_complex_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_addr_float_and_complex_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_addr_float_and_complex_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_addr_float_and_complex_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_addr_float_and_complex_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_addr_float_and_complex_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_addr_integral_cuda_int16, test/test_linalg.py::TestLinalgCUDA::test_addr_integral_cuda_int32, test/test_linalg.py::TestLinalgCUDA::test_addr_integral_cuda_int64, test/test_linalg.py::TestLinalgCUDA::test_addr_integral_cuda_int8, test/test_linalg.py::TestLinalgCUDA::test_addr_integral_cuda_uint8, test/test_linalg.py::TestLinalgCUDA::test_addr_type_promotion_cuda, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_input_dtypes_compatibility_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_input_dtypes_compatibility_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_input_dtypes_compatibility_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_input_dtypes_compatibility_cuda_int16, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_input_dtypes_compatibility_cuda_int32, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_input_dtypes_compatibility_cuda_int64, test/test_linalg.py::TestLinalgCUDA::test_baddbmm_nan_input_with_zero_beta_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_blas_alpha_beta_empty_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_blas_alpha_beta_empty_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_blas_alpha_beta_empty_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_blas_alpha_beta_empty_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_blas_alpha_beta_empty_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_blas_alpha_beta_empty_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_blas_empty_cuda, test/test_linalg.py::TestLinalgCUDA::test_blas_mv_large_input_cuda, test/test_linalg.py::TestLinalgCUDA::test_blas_nan_out_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_blas_nan_out_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_blas_nan_out_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_blas_nan_out_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_blas_nan_out_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_blas_nan_out_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_blaslog_tunableop_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_bmm_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_bmm_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_bmm_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_bmm_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_bmm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_bmm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_bmm_tunableop_rocm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_broadcast_batched_matmul_cuda, test/test_linalg.py::TestLinalgCUDA::test_broadcast_fused_matmul_cuda, test/test_linalg.py::TestLinalgCUDA::test_call_count_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_chain_matmul_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_non_pd_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_non_pd_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_non_pd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_ex_non_pd_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_inverse_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_backward_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_broadcasting_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_broadcasting_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_broadcasting_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_broadcasting_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_many_batches_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_many_batches_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_many_batches_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_batched_many_batches_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_out_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_out_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_out_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cholesky_solve_out_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_ck_blas_library_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_1_k_128_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_1_k_128_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_1_k_64_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_1_k_64_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_32_k_128_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_32_k_128_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_32_k_64_n_11008_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_dyn_quant_matmul_4bit_m_32_k_64_n_4096_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_32_k_32_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_32_k_32_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_32_k_64_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_32_k_64_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_64_k_32_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_64_k_32_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_64_k_64_n_48_cuda, test/test_linalg.py::TestLinalgCUDA::test_compile_int4_mm_m_64_k_64_n_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_cond_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cond_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cond_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cond_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cond_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_cond_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cond_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cond_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_corner_cases_of_cublasltmatmul_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_corner_cases_of_cublasltmatmul_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_corner_cases_of_cublasltmatmul_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_corner_cases_of_cublasltmatmul_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_corner_cases_of_cublasltmatmul_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_corner_cases_of_cublasltmatmul_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_cross_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cross_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_cross_error_cuda, test/test_linalg.py::TestLinalgCUDA::test_cross_with_and_without_dim_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_cross_with_and_without_dim_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_det_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_det_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_det_logdet_slogdet_batched_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_det_logdet_slogdet_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_disable_tuning_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_dot_invalid_args_cuda, test/test_linalg.py::TestLinalgCUDA::test_dot_vs_numpy_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_dot_vs_numpy_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_dump_results_on_exit_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eig_check_magma_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eig_compare_backends_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eig_compare_backends_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eig_compare_backends_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eig_compare_backends_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eig_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eig_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eig_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eig_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eig_numpy_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eig_numpy_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eig_removed_error_cuda, test/test_linalg.py::TestLinalgCUDA::test_eig_with_nan_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eig_with_nan_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eig_with_nan_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eig_with_nan_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigh_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigh_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigh_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigh_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigh_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigh_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigh_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigh_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigh_lower_uplo_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigh_lower_uplo_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigh_lower_uplo_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigh_lower_uplo_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigh_lwork_lapack_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigh_lwork_lapack_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigh_lwork_lapack_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigh_lwork_lapack_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigh_svd_illcondition_matrix_input_should_not_crash_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigh_svd_illcondition_matrix_input_should_not_crash_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigvals_compare_backends_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigvals_compare_backends_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigvals_compare_backends_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigvals_compare_backends_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigvals_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigvals_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigvals_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigvals_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigvals_numpy_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigvals_numpy_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_eigvalsh_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_einsum_corner_cases_cuda, test/test_linalg.py::TestLinalgCUDA::test_einsum_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_einsum_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_einsum_error_cases_cuda, test/test_linalg.py::TestLinalgCUDA::test_einsum_output_layout_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_einsum_random_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_einsum_random_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_einsum_sublist_format_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_einsum_sublist_format_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_32_k_32_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_32_k_35_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_32_k_36_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_32_k_40_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_32_k_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_35_k_32_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_35_k_35_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_35_k_36_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_35_k_40_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_35_k_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_36_k_32_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_36_k_35_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_36_k_36_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_36_k_40_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_36_k_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_40_k_32_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_40_k_35_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_40_k_36_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_40_k_40_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_40_k_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_64_k_32_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_64_k_35_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_64_k_36_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_64_k_40_cuda, test/test_linalg.py::TestLinalgCUDA::test_fp16_mv_transposed_first_argument_arm_cpu_m_64_k_64_cuda, test/test_linalg.py::TestLinalgCUDA::test_gemm_bias_offline_tunableop_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_gemm_bias_tunableop_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_geqrf_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_geqrf_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_geqrf_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_geqrf_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_householder_product_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_householder_product_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_householder_product_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_householder_product_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_householder_product_errors_and_warnings_cuda, test/test_linalg.py::TestLinalgCUDA::test_inner_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inner_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inv_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inv_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inv_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inv_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_info_device_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_info_device_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_info_device_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_info_device_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_singular_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_singular_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_singular_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inv_ex_singular_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_invariance_error_spectral_decompositions_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inverse_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inverse_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inverse_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inverse_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_large_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_large_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_large_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inverse_errors_large_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_inverse_many_batches_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_inverse_many_batches_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_inverse_many_batches_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_inverse_many_batches_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_kron_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_kron_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_kron_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_kron_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_kron_empty_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_kron_empty_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_kron_empty_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_kron_empty_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_kron_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_kron_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_kron_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_kron_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lapack_empty_cuda, test/test_linalg.py::TestLinalgCUDA::test_large_bmm_backward_cuda, test/test_linalg.py::TestLinalgCUDA::test_large_bmm_mm_backward_cuda, test/test_linalg.py::TestLinalgCUDA::test_ldl_factor_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_ldl_factor_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_ldl_factor_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_ldl_factor_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_ldl_solve_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_ldl_solve_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_ldl_solve_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_ldl_solve_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_cross_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_cross_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_cross_with_and_without_dim_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_cross_with_and_without_dim_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_batch_broadcasting_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_batch_broadcasting_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_batch_broadcasting_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_batch_broadcasting_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_input_checks_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_input_checks_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_input_checks_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_lstsq_input_checks_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_cpu_errors_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_cpu_errors_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_cpu_errors_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_cpu_errors_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_family_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_family_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_family_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_family_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_solve_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_solve_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_solve_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_lu_solve_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_analytic_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_analytic_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_analytic_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_analytic_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_batch_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_batch_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_boundary_cases_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_boundary_cases_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_boundary_cases_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_boundary_cases_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_compare_with_taylor_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_compare_with_taylor_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_compare_with_taylor_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_compare_with_taylor_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_no_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_perverse_nan_values_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_perverse_nan_values_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_perverse_nan_values_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_perverse_nan_values_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_utils_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_matrix_exp_utils_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_qr_autograd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_broadcasting_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_broadcasting_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_broadcasting_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_broadcasting_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_large_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_large_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_large_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_linalg_solve_triangular_large_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_linear_algebra_scalar_raises_cuda, test/test_linalg.py::TestLinalgCUDA::test_lobpcg_basic_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lobpcg_ortho_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lobpcg_scipy_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lobpcg_torchscript_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lower_precision_accumulation_with_ref_path_cuda, test/test_linalg.py::TestLinalgCUDA::test_lstsq_removed_error_cuda, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_broadcasting_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_broadcasting_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_broadcasting_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_broadcasting_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_many_batches_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_many_batches_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_many_batches_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_batched_many_batches_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_large_matrices_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_large_matrices_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_large_matrices_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_lu_solve_large_matrices_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_lu_unpack_check_input_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matmul_45724_cuda, test/test_linalg.py::TestLinalgCUDA::test_matmul_check_entries_tunableop_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_matmul_mv_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_matmul_mv_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_matmul_mv_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matmul_offline_mgpu_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matmul_offline_tunableop_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_matmul_out_kernel_errors_with_autograd_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matmul_out_kernel_errors_with_autograd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_1d_Nd_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_1d_Nd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_2d_Nd_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_2d_Nd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_3d_Nd_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_3d_Nd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_tunableop_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matmul_small_brute_force_tunableop_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_norm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matrix_norm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_power_negative_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_matrix_power_negative_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_power_non_negative_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_matrix_power_non_negative_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_atol_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_atol_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_atol_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_atol_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_atol_rtol_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_basic_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_basic_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_basic_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_basic_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_empty_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_empty_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_empty_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_empty_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_out_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_out_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_out_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_out_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_matrix_rank_removed_error_cuda, test/test_linalg.py::TestLinalgCUDA::test_minimum_tuning_iteration_tunableop_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_mm_bmm_non_memory_dense_cuda, test/test_linalg.py::TestLinalgCUDA::test_mm_conjtranspose_cuda, test/test_linalg.py::TestLinalgCUDA::test_mm_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_mm_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_mm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_mm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_mm_empty_inputs_mixed_dtype_errors_cuda, test/test_linalg.py::TestLinalgCUDA::test_mm_submatrix_offline_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_multi_dot_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_multi_dot_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_multi_dot_errors_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_bfloat16_and_half_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_norm_bfloat16_and_half_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_norm_complex_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_norm_complex_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_norm_complex_old_cuda, test/test_linalg.py::TestLinalgCUDA::test_norm_complexhalf_cuda, test/test_linalg.py::TestLinalgCUDA::test_norm_dtype_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_norm_dtype_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_norm_dtype_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_norm_dtype_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_norm_dtype_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_dtype_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_norm_errors_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_errors_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_norm_extreme_values_cuda, test/test_linalg.py::TestLinalgCUDA::test_norm_fastpaths_cuda, test/test_linalg.py::TestLinalgCUDA::test_norm_fro_2_equivalence_old_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_fused_type_promotion_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_norm_fused_type_promotion_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_norm_matrix_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_matrix_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_norm_matrix_degenerate_shapes_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_norm_matrix_degenerate_shapes_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_norm_matrix_degenerate_shapes_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_matrix_degenerate_shapes_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_norm_old_cuda, test/test_linalg.py::TestLinalgCUDA::test_norm_old_nan_propagation_cuda, test/test_linalg.py::TestLinalgCUDA::test_norm_vector_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_vector_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_norm_vector_degenerate_shapes_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_norm_vector_degenerate_shapes_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_norm_vector_degenerate_shapes_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_norm_vector_degenerate_shapes_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_nuclear_norm_axes_small_brute_force_old_cuda, test/test_linalg.py::TestLinalgCUDA::test_nuclear_norm_exceptions_old_cuda, test/test_linalg.py::TestLinalgCUDA::test_nuclear_norm_out_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_nuclear_norm_out_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_numeric_check_leak_tunableop_rocm_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_many_batches_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_upper_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_upper_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_upper_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_batched_upper_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_empty_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_empty_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_empty_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_old_cholesky_empty_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_ormqr_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_ormqr_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_ormqr_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_ormqr_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_ormqr_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_ormqr_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_ormqr_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_ormqr_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_cuda_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_ger_addr_legacy_tests_cuda, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bfloat16_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_bool_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex128_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_complex64_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float16_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float32_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_float64_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int16_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int32_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int64_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_int8_uint8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_bool, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_complex128, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_complex64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_float16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_float32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_float64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_int16, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_int32, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_int64, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_int8, test/test_linalg.py::TestLinalgCUDA::test_outer_type_promotion_cuda_uint8_uint8, test/test_linalg.py::TestLinalgCUDA::test_pca_lowrank_cuda, test/test_linalg.py::TestLinalgCUDA::test_permute_matmul_cuda, test/test_linalg.py::TestLinalgCUDA::test_pinv_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_pinv_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_pinv_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_pinv_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_pinv_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_pinv_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_pinv_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_pinv_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_pinverse_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_pinverse_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_pinverse_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_pinverse_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_preferred_blas_library_cuda, test/test_linalg.py::TestLinalgCUDA::test_preferred_linalg_library_cuda, test/test_linalg.py::TestLinalgCUDA::test_qr_batched_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_qr_batched_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_qr_batched_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_qr_batched_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_qr_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_qr_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_qr_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_qr_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_qr_error_cases_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_qr_vs_numpy_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_qr_vs_numpy_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_qr_vs_numpy_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_qr_vs_numpy_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_renorm_cuda, test/test_linalg.py::TestLinalgCUDA::test_renorm_ps_cuda, test/test_linalg.py::TestLinalgCUDA::test_rotating_buffer_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_rowwise_scaled_gemm_numerics_tunableop_cuda_float8_e4m3fnuz, test/test_linalg.py::TestLinalgCUDA::test_scaled_gemm_offline_tunableop_cuda_float8_e4m3fnuz, test/test_linalg.py::TestLinalgCUDA::test_scaled_gemm_offline_tunableop_cuda_float8_e5m2fnuz, test/test_linalg.py::TestLinalgCUDA::test_scaled_gemm_tunableop_cuda_float8_e4m3fnuz, test/test_linalg.py::TestLinalgCUDA::test_scaled_gemm_tunableop_cuda_float8_e5m2fnuz, test/test_linalg.py::TestLinalgCUDA::test_slogdet_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_slogdet_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_slogdet_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_slogdet_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_slogdet_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_slogdet_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_slogdet_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_slogdet_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_solve_batched_broadcasting_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_solve_batched_broadcasting_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_solve_batched_broadcasting_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_solve_batched_broadcasting_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_solve_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_solve_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_solve_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_solve_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_solve_removed_error_cuda, test/test_linalg.py::TestLinalgCUDA::test_strided_mm_bmm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_strided_mm_bmm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_svd_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_svd_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_svd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_svd_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_svd_lowrank_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_svd_lowrank_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_svd_memory_allocation_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_svd_memory_allocation_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_svd_memory_allocation_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_svd_memory_allocation_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_symeig_removed_error_cuda, test/test_linalg.py::TestLinalgCUDA::test_tensordot_cuda, test/test_linalg.py::TestLinalgCUDA::test_tensordot_out_kernel_errors_with_autograd_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_tensordot_out_kernel_errors_with_autograd_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_empty_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_empty_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_empty_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_empty_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_singular_input_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_singular_input_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_singular_input_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tensorinv_singular_input_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_empty_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_empty_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_empty_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_empty_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_tensorsolve_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tf32_offline_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_tf32_tunableop_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_broadcasting_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_broadcasting_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_broadcasting_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_broadcasting_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_many_batches_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_many_batches_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_many_batches_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_batched_many_batches_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_large_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_out_errors_and_warnings_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_out_errors_and_warnings_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_out_errors_and_warnings_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_triangular_solve_out_errors_and_warnings_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_validator_tunableop_rocm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_vdot_invalid_args_cuda, test/test_linalg.py::TestLinalgCUDA::test_vdot_vs_numpy_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_vdot_vs_numpy_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_cuda_bfloat16, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_cuda_float16, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_cuda_float64, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_decom_unbacked_checks_cuda, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_dim_tuple_arg_cuda, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_extreme_values_cuda, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_reduce_over_1D_vector_cuda_complex128, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_reduce_over_1D_vector_cuda_complex64, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_reduce_over_1D_vector_cuda_float32, test/test_linalg.py::TestLinalgCUDA::test_vector_norm_reduce_over_1D_vector_cuda_float64 2025-09-07T09:16:52.0917006Z 2025-09-07T09:16:52.0917099Z Running test_namedtensor 1/1 ... [2025-09-07 09:16:52.062424] 2025-09-07T09:16:52.0917275Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:16:52.0917679Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_namedtensor.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:16:52.062688] 2025-09-07T09:16:55.3908338Z 2025-09-07T09:16:55.3909808Z test_namedtensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_namedtensor_1.1_258ff8b7c02bf8f2_.log 2025-09-07T09:16:55.3921560Z Running 88 items in this shard: test/test_namedtensor.py::TestNamedTensor::test_aaa_must_run_first_check_experimental_warning, test/test_namedtensor.py::TestNamedTensor::test_addcmul_addcdiv, test/test_namedtensor.py::TestNamedTensor::test_addmm, test/test_namedtensor.py::TestNamedTensor::test_addmv, test/test_namedtensor.py::TestNamedTensor::test_align_as, test/test_namedtensor.py::TestNamedTensor::test_align_tensors, test/test_namedtensor.py::TestNamedTensor::test_align_tensors_two_inputs, test/test_namedtensor.py::TestNamedTensor::test_align_to, test/test_namedtensor.py::TestNamedTensor::test_align_to_ellipsis, test/test_namedtensor.py::TestNamedTensor::test_any_all, test/test_namedtensor.py::TestNamedTensor::test_as_strided, test/test_namedtensor.py::TestNamedTensor::test_as_strided_cuda, test/test_namedtensor.py::TestNamedTensor::test_autograd_ignores_names, test/test_namedtensor.py::TestNamedTensor::test_autograd_smoke, test/test_namedtensor.py::TestNamedTensor::test_autograd_warns_named_grad, test/test_namedtensor.py::TestNamedTensor::test_bernoulli, test/test_namedtensor.py::TestNamedTensor::test_big_tensor_repr_has_names, test/test_namedtensor.py::TestNamedTensor::test_binary_ops, test/test_namedtensor.py::TestNamedTensor::test_bitwise_not, test/test_namedtensor.py::TestNamedTensor::test_bmm, test/test_namedtensor.py::TestNamedTensor::test_cat, test/test_namedtensor.py::TestNamedTensor::test_cdist, test/test_namedtensor.py::TestNamedTensor::test_comparison_ops, test/test_namedtensor.py::TestNamedTensor::test_copy_transpose, test/test_namedtensor.py::TestNamedTensor::test_cummax_cummin, test/test_namedtensor.py::TestNamedTensor::test_detach, test/test_namedtensor.py::TestNamedTensor::test_diagonal, test/test_namedtensor.py::TestNamedTensor::test_dot, test/test_namedtensor.py::TestNamedTensor::test_equal, test/test_namedtensor.py::TestNamedTensor::test_expand, test/test_namedtensor.py::TestNamedTensor::test_factory_coverage, test/test_namedtensor.py::TestNamedTensor::test_factory_edge_cases, test/test_namedtensor.py::TestNamedTensor::test_flatten, test/test_namedtensor.py::TestNamedTensor::test_flatten_index_error, test/test_namedtensor.py::TestNamedTensor::test_flatten_nodims, test/test_namedtensor.py::TestNamedTensor::test_has_names, test/test_namedtensor.py::TestNamedTensor::test_index_fill, test/test_namedtensor.py::TestNamedTensor::test_info_smoke, test/test_namedtensor.py::TestNamedTensor::test_logcumsumexp, test/test_namedtensor.py::TestNamedTensor::test_logical_not, test/test_namedtensor.py::TestNamedTensor::test_logical_ops, test/test_namedtensor.py::TestNamedTensor::test_masked_fill, test/test_namedtensor.py::TestNamedTensor::test_masked_select, test/test_namedtensor.py::TestNamedTensor::test_matmul, test/test_namedtensor.py::TestNamedTensor::test_max_pooling, test/test_namedtensor.py::TestNamedTensor::test_max_pooling_without_names_does_not_warn, test/test_namedtensor.py::TestNamedTensor::test_mm, test/test_namedtensor.py::TestNamedTensor::test_mv, test/test_namedtensor.py::TestNamedTensor::test_no_jit_script_support, test/test_namedtensor.py::TestNamedTensor::test_no_jit_tracer_support, test/test_namedtensor.py::TestNamedTensor::test_no_multiprocessing_support, test/test_namedtensor.py::TestNamedTensor::test_no_pickle_support, test/test_namedtensor.py::TestNamedTensor::test_no_save_support, test/test_namedtensor.py::TestNamedTensor::test_noncontig_contiguous, test/test_namedtensor.py::TestNamedTensor::test_none_names_refcount, test/test_namedtensor.py::TestNamedTensor::test_nyi_dimname_overload_msg, test/test_namedtensor.py::TestNamedTensor::test_out_fn_semantics, test/test_namedtensor.py::TestNamedTensor::test_pow_special, test/test_namedtensor.py::TestNamedTensor::test_py3_ellipsis, test/test_namedtensor.py::TestNamedTensor::test_reduction_fns, test/test_namedtensor.py::TestNamedTensor::test_refine_names, test/test_namedtensor.py::TestNamedTensor::test_rename, test/test_namedtensor.py::TestNamedTensor::test_rename_, test/test_namedtensor.py::TestNamedTensor::test_rename_globber, test/test_namedtensor.py::TestNamedTensor::test_rename_rename_map, test/test_namedtensor.py::TestNamedTensor::test_repr, test/test_namedtensor.py::TestNamedTensor::test_resize, test/test_namedtensor.py::TestNamedTensor::test_select, test/test_namedtensor.py::TestNamedTensor::test_select_cuda, test/test_namedtensor.py::TestNamedTensor::test_set_names_property, test/test_namedtensor.py::TestNamedTensor::test_size, test/test_namedtensor.py::TestNamedTensor::test_split_fns_propagates_names, test/test_namedtensor.py::TestNamedTensor::test_squeeze, test/test_namedtensor.py::TestNamedTensor::test_stride, test/test_namedtensor.py::TestNamedTensor::test_support_device_named_grad, test/test_namedtensor.py::TestNamedTensor::test_tensor_from_lists, test/test_namedtensor.py::TestNamedTensor::test_tensor_from_named_tensor, test/test_namedtensor.py::TestNamedTensor::test_tensor_from_numpy, test/test_namedtensor.py::TestNamedTensor::test_tensor_from_tensor, test/test_namedtensor.py::TestNamedTensor::test_tensor_grad_is_unnamed, test/test_namedtensor.py::TestNamedTensor::test_transpose_variants, test/test_namedtensor.py::TestNamedTensor::test_trivial, test/test_namedtensor.py::TestNamedTensor::test_unary_propagate_names_fns, test/test_namedtensor.py::TestNamedTensor::test_unflatten, test/test_namedtensor.py::TestNamedTensor::test_unsupported_op_error_msg, test/test_namedtensor.py::TestNamedTensor::test_using_seen_interned_string_doesnt_bump_refcount, test/test_namedtensor.py::TestNamedTensor::test_using_unseen_interned_string_bumps_refcount_permanently, test/test_namedtensor.py::TestNamedTensor::test_using_unseen_uninterned_string_refcounts 2025-09-07T09:16:55.3930497Z 2025-09-07T09:16:55.3930594Z Running test_namedtuple_return_api 1/1 ... [2025-09-07 09:16:55.390821] 2025-09-07T09:16:55.3930770Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:16:55.3931161Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_namedtuple_return_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:16:55.391013] 2025-09-07T09:16:58.0634806Z 2025-09-07T09:16:58.0636844Z test_namedtuple_return_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_namedtuple_return_api_1.1_747864a6aa79edfa_.log 2025-09-07T09:16:58.0639021Z Running 3 items in this shard: test/test_namedtuple_return_api.py::TestNamedTupleAPI::test_import_return_types, test/test_namedtuple_return_api.py::TestNamedTupleAPI::test_namedtuple_return, test/test_namedtuple_return_api.py::TestNamedTupleAPI::test_native_functions_yaml 2025-09-07T09:16:58.0640093Z 2025-09-07T09:16:58.0640334Z Running test_native_functions 1/1 ... [2025-09-07 09:16:58.063573] 2025-09-07T09:16:58.0640789Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:16:58.0641819Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_native_functions.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:16:58.063800] 2025-09-07T09:17:00.0823737Z 2025-09-07T09:17:00.0824988Z test_native_functions 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_native_functions_1.1_fec15b303333f8cb_.log 2025-09-07T09:17:00.0829061Z Running 11 items in this shard: test/test_native_functions.py::TestNativeFunctions::test_intlist_error_with_overload, test/test_native_functions.py::TestNativeFunctions::test_optional_filled_intlist, test/test_native_functions.py::TestNativeFunctions::test_optional_floatlist, test/test_native_functions.py::TestNativeFunctions::test_optional_floatlist_invalid, test/test_native_functions.py::TestNativeFunctions::test_optional_intlist, test/test_native_functions.py::TestNativeFunctions::test_optional_intlist_invalid, test/test_native_functions.py::TestNativeFunctions::test_string_defaults, test/test_native_functions.py::TestNativeFunctions::test_symintlist_error, test/test_native_functions.py::TestNativeFunctions::test_symintlist_error_with_overload, test/test_native_functions.py::TestNativeFunctions::test_symintlist_error_with_overload_but_is_unique, test/test_native_functions.py::TestNativeFunctions::test_vararg_symintlist_error 2025-09-07T09:17:00.0839981Z 2025-09-07T09:17:00.0840108Z Running test_native_mha 1/1 ... [2025-09-07 09:17:00.082403] 2025-09-07T09:17:00.0840317Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:17:00.0841129Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_native_mha.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:17:00.082667] 2025-09-07T09:17:05.7089661Z 2025-09-07T09:17:05.7091687Z test_native_mha 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_native_mha_1.1_0096b31e99f0547f_.log 2025-09-07T09:17:05.7117019Z Running 54 items in this shard: test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_attention_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_attention_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_encoder_decoder_attention_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_encoder_decoder_attention_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_False_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_False_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_False_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_False_need_weights_False_average_attn_weights_True_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_False_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_False_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_False_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_True_cuda_float16, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_native_multihead_self_attention_use_nt_True_use_padding_True_pad_all_True_need_weights_False_average_attn_weights_True_fused_True_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_transform_bias_rescale_qkv_cuda_float32, test/test_native_mha.py::TestMHADeviceTypeCUDA::test_transform_bias_rescale_qkv_nested_cuda_float32 2025-09-07T09:17:05.7136860Z 2025-09-07T09:17:05.7136948Z Running test_nestedtensor 1/2 ... [2025-09-07 09:17:05.708792] 2025-09-07T09:17:05.7137106Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:17:05.7137481Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_nestedtensor.py', '--shard-id=1', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:17:05.709021] 2025-09-07T09:23:38.0394113Z 2025-09-07T09:23:38.0395037Z test_nestedtensor 1/2 was successful, full logs can be found in artifacts with path test/test-reports/test_nestedtensor_1.2_ad4b6ec0b1bed00e_.log 2025-09-07T09:23:38.0523253Z Running 782 items in this shard: test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_2d_nested_tensor_batch_size_2_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_2_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_batch_size_4_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_3_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_2_max_seq_len_3_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_5_vocab_size_10, test/test_nestedtensor.py::TestNestedTensor::test_3d_nested_tensor_float_batch_size_4_max_seq_len_5_vocab_size_20, test/test_nestedtensor.py::TestNestedTensor::test_cat, test/test_nestedtensor.py::TestNestedTensor::test_copy_, test/test_nestedtensor.py::TestNestedTensor::test_is_contiguous, test/test_nestedtensor.py::TestNestedTensor::test_like_functions_randn_like, test/test_nestedtensor.py::TestNestedTensor::test_like_functions_zeros_like, test/test_nestedtensor.py::TestNestedTensor::test_nested_tensor, test/test_nestedtensor.py::TestNestedTensor::test_size_dim, test/test_nestedtensor.py::TestNestedTensor::test_unbind_3, test/test_nestedtensor.py::TestNestedTensor::test_unbind_4, test/test_nestedtensor.py::TestNestedInt::test_comparisons, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_binary_ops_with_scalar_eq_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_binary_ops_with_scalar_ge_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_bmm_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_clone_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_contiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_detach_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_jagged_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_jagged_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_dropout_strided_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_embedding_jagged_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_empty_like_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_breaking_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_breaking_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_layer_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_linear_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_masked_fill_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_with_bmm_path_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_matmul_with_bmm_path_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_narrow_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_masked_select_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_add_transpose_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_chunk_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_256_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_384_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_384_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_8_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_dense_elementwise_embedding_dim_8_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_div_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_indexing_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_mul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_split_with_sizes_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_nested_tensor_sub_transpose_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_reshape_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_scaled_dot_product_attention_input_dim_4_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_False_weights_only_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_serialization_requires_grad_True_weights_only_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_softmax_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_squeeze_unsqueeze_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim2_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_dim4_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_to_padded_tensor_zero_numel_errors_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float32, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_transpose_inference_mode_interaction_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_cos_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_gelu_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_isposinf_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_logical_not_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_neg_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_relu_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sgn_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_sqrt_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unary_funcs_tanh_cuda, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_unbind_noncontiguous_cuda_float64, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float16, test/test_nestedtensor.py::TestNestedTensorDeviceTypeCUDA::test_view_inference_mode_interaction_cuda_float32, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_for_add_op_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_for_sub_op_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_backward_sub_strided_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_dropout_backward_jagged_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_dropout_backward_strided_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_indexing_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_2_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_5d_size_32_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_edge_case_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_1023_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_layer_norm_backward_size_2_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_bmm_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_mask_and_to_padded_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_from_padded_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_generates_leaf_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_linear_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_matmul_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_reshape_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_squeeze_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_squeeze_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_to_padded_tensor_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_transpose_gradcheck_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_nested_tensor_unsqueeze_backward_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_set_requires_grad_from_list_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_set_requires_grad_from_mask_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_to_buffer_series_ops_grad_with_broadcast_cuda, test/test_nestedtensor.py::TestNestedTensorAutogradCUDA::test_unbind_flow_through_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_jagged_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_0_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_False_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_jagged_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_1_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_False_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_2_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_jagged_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_3_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_jagged_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_False_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_as_nested_tensor_from_tensor_dim_4_layout_strided_requires_grad_True_contiguous_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_autograd_function_with_None_grad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_broadcasting_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_binary_pointwise_with_nested_int_second_arg_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_chunk_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_padded_dense_conversion_preserves_metadata_cache_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_compile_with_propagated_dynamic_max_seq_len_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_composite_op_in_inference_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_construction_from_list_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_copy__cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flatten_decomp_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_False_cross_attention_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_False_cross_attention_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_flex_attention_noncontig_with_holes_True_cross_attention_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_index_put_error_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_is_contiguous_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_as_nested_tensor_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_False_components_require_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_layout_construction_nested_tensor_requires_grad_True_components_require_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_op_different_output_shape_dim_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_padded_dense_conversion_kernels_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_False_values_is_view_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_jagged_view_from_values_offsets_requires_grad_True_values_is_view_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_2d_input_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_operate_on_batch_dim_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_reduce_ragged_idx_1_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_layer_norm_with_lengths_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_like_value_full_like_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_3_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_4_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_linear_nt_dim_5_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_narrow_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_nested_tensor_from_jagged_pass_min_max_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_transposed_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_with_holes_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_noncontiguous_to_noncontig_with_holes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_batch_only_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_1_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_1_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_mean_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_1_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_reduce_ragged_idx_greater_than_1_different_output_shape_sum_transpose_offset_2_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_transpose_non_ragged_dim_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_mean_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_op_dim_with_lengths_different_output_shape_sum_keepdim_True_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_profiler_sequence_nr_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_record_stream_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_reshape_decomp_requires_grad_True_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_autocast_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_backwards_cuda_bfloat16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_backwards_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_compile_cuda_bfloat16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_compile_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_constant_sequence_length_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_packed_in_proj_cuda_bfloat16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sdpa_with_packed_in_proj_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_contig_weights_only_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_contig_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_noncontig_transposed_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_serialization_noncontig_with_holes_weights_only_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_1_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_1_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_2_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_reduce_ragged_idx_greater_than_1_same_output_shape_transpose_offset_2_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_False_components_require_grad_False_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_False_components_require_grad_True_log_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_True_components_require_grad_False_log_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_requires_grad_True_components_require_grad_False_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_transpose_non_ragged_dim_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_dim_with_lengths_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_False_components_require_grad_True_log_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_False_components_require_grad_True_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_True_components_require_grad_False_log_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_softmax_reduce_batch_dim_requires_grad_True_components_require_grad_True_softmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_specialize_dynamic_shape_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_specialize_dynamic_shape_recompile_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_split_with_sizes_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_squeeze_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_False_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_True_components_require_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_batch_and_non_batch_keepdim_True_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_False_requires_grad_True_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_sum_dim_reduce_ragged_and_non_batch_keepdim_True_requires_grad_False_components_require_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_2_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_3_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_False_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_compile_nt_dim_4_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_True_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_True_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_2_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_False_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_3_requires_grad_True_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_False_cuda_bool, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_False_cuda_float32, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_False_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_to_padded_tensor_nt_dim_4_requires_grad_True_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unary_pointwise_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_backward_cuda_float16, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_backward_cuda_float64, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_lengths_ragged_idx_1_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_transpose_ragged_idx_3_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_unbind_transpose_ragged_idx_last_dim_cuda, test/test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_view_ragged_idx_not_one_cuda, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___radd___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rdiv___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rmod___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rmul___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward___rpow___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_abs_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_acos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_atan2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_bmm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_cfloat_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_chalf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_clamp_min_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_complex_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_conj_physical_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_cosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_deg2rad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_digamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_div_no_rounding_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_double_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_erfc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_erfinv_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_exp2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_exp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_float_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_fmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_fmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_frexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_half_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_ldexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_log10_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_log2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_log_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_logaddexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_logit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_logsumexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_masked_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_max_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_min_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_min_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_minimum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_elu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_embedding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_hardshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_hardtanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_relu6_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_relu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_rms_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_silu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_softplus_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_nn_functional_threshold_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_polygamma_polygamma_n_4_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_rad2deg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_real_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_remainder_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_round_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_round_decimals_neg_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_rsub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sgn_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_erfcx_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_ndtri_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_special_xlog1py_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_split_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_square_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_std_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_sub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_tan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_tanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_to_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_backward_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rmul___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rpow___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward___rsub___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_abs_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_acos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_acosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_add_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_atanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_bfloat16_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_bmm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_ceil_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_chalf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_clamp_min_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_complex_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_conj_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_copysign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_cos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_cosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_div_no_rounding_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_erfinv_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_exp2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_float_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_float_power_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_floor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_fmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_fmod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_frexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_half_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_hypot_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_lgamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_log2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_masked_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_max_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_maximum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_min_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_minimum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_mul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nansum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_elu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_embedding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_hardshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_mish_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_prelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_relu6_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_rms_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_rrelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_selu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_silu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_softplus_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_nn_functional_threshold_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polar_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_positive_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_round_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_round_decimals_neg_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sinc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_sinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_erfcx_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_i0e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_ndtri_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_special_xlog1py_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_to_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_backward_xlogy_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___radd___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward___rdiv___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_asin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_asinh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_byte_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_char_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_clamp_max_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_copysign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_cos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_cosh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_deg2rad_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_digamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_div_floor_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_double_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_erf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_erfc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_erfinv_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_expm1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_fill_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_float_power_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_floor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_floor_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_fmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_half_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_igammac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isinf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isneginf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isposinf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_isreal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_jiterator_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_jiterator_binary_return_by_ref_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_jiterator_unary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_linalg_vector_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logaddexp_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logical_not_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logical_or_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_logical_xor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_argmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_argmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_prod_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_masked_sum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_max_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_mean_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_min_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nansum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_narrow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nextafter_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_celu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_hardsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_hardtanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_linear_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_mish_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_rrelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_silu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_rad2deg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_reciprocal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_round_decimals_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_round_decimals_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_rsqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_rsub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sgn_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_short_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_signbit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_sin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_airy_ai_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_bessel_j0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_bessel_j1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_bessel_y1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_chebyshev_polynomial_t_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_chebyshev_polynomial_w_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_entr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_hermite_polynomial_h_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_hermite_polynomial_he_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_i0e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_legendre_polynomial_p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_modified_bessel_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_scaled_modified_bessel_k1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_shifted_chebyshev_polynomial_v_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_shifted_chebyshev_polynomial_w_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_xlog1py_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_special_zeta_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_split_with_sizes_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_tan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_true_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_trunc_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_unsqueeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_var_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_compile_forward_xlogy_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rmul___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rpow___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward___rsub___cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_abs_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_acos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_add_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_argmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_argmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_atan_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_bfloat16_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_bmm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_cdouble_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_ceil_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_chalf_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_chunk_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_clamp_max_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_clone_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_complex_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_conj_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_copysign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_cos_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_count_nonzero_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_div_floor_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_div_no_rounding_mode_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_div_trunc_rounding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_exp2_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_float_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_float_power_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_floor_divide_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_frac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_hash_tensor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_hypot_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_igamma_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_igammac_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_index_put_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isclose_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_isreal_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_jiterator_binary_return_by_ref_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_linalg_vector_norm_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logical_and_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logical_not_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logical_xor_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_logit_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_long_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_lt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_amax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_amin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_argmax_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_argmin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_masked_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_matmul_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_max_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_maximum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_min_binary_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_min_reduction_with_dim_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_minimum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nansum_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_neg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nextafter_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_embedding_bag_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_embedding_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_hardsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_hardtanh_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_logsigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_mish_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_prelu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_relu_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_softsign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_nn_functional_tanhshrink_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_3_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_polygamma_polygamma_n_4_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_pow_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_rad2deg_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_round_decimals_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_rsqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_rsub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_select_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sgn_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sigmoid_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sign_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sin_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_bessel_j0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_bessel_y1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_chebyshev_polynomial_v_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_entr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_erfcx_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_i0e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_i1e_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_laguerre_polynomial_l_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_legendre_polynomial_p_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_log_ndtr_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_modified_bessel_i0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_modified_bessel_i1_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_scaled_modified_bessel_k0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_special_spherical_bessel_j0_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_split_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sqrt_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_square_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_squeeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_std_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_std_unbiased_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_sub_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_to_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_unflatten_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_unsqueeze_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_var_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_forward_xlogy_cuda_float32, test/test_nestedtensor.py::TestNestedTensorOpInfoCUDA::test_nested_tensor_input_mutation_backward_cuda 2025-09-07T09:23:38.0641200Z 2025-09-07T09:23:38.0646875Z Running test_ops 3/4 ... [2025-09-07 09:23:38.040071] 2025-09-07T09:23:38.0647039Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:23:38.0647398Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '--shard-id=3', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:23:38.040270] 2025-09-07T09:32:54.2592856Z 2025-09-07T09:32:54.2594219Z test_ops 3/4 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_3.4_5bb2bf023d957559_.log 2025-09-07T09:32:54.3579806Z Running 8583 items in this shard: test/test_ops.py::TestCommonCUDA::test_compare_cpu___rdiv___cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs__conversions_cdouble_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs__conversions_char_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs__conversions_double_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs__conversions_short_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_addcmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_arange_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_as_strided_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_atan2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_block_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_bucketize_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_cauchy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_cumprod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_diag_embed_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_diagonal_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_empty_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_expand_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_eye_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_fmin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_hypot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_igamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_igammac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_index_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_index_select_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_logaddexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_logspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_masked_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_mul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_new_empty_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_new_empty_strided_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_new_ones_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_nn_functional_dropout_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_nn_functional_glu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_nn_functional_hinge_embedding_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_nn_functional_pixel_unshuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_normal__in_place_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_normal_number_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_ones_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_reshape_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_rsub_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_softmax_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_special_softmax_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_special_xlog1py_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_special_zeta_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_split_with_sizes_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_stft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_unsqueeze_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_unsqueeze_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_vdot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__refs_zeros_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu__unsafe_masked_index_put_accumulate_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_addcdiv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_addcmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_addmm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_addmv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_addr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_alias_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_as_strided_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_as_strided_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_atan2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_bernoulli_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_bitwise_left_shift_cuda_int64, test/test_ops.py::TestCommonCUDA::test_compare_cpu_bucketize_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_cdouble_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_constant_pad_nd_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_cov_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_cummax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_diag_embed_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_diagonal_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_div_floor_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_expand_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_fliplr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_fmin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_gather_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_geometric_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_gradient_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_half_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_igamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_igammac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_index_reduce_amax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_index_reduce_amin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_index_select_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_inner_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_kthvalue_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_cholesky_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_eigvals_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_eigvalsh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_lu_factor_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_matrix_power_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_norm_subgradients_at_zero_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_qr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_solve_triangular_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_linalg_svdvals_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_log_normal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_logsumexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_long_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_lu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_lu_unpack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_mT_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_masked_cumprod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_matmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_max_pool2d_with_indices_backward_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_max_reduction_no_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_meshgrid_list_of_tensors_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_mm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_msort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_mul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nanquantile_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_adaptive_avg_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_adaptive_max_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_avg_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_cosine_embedding_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_cross_entropy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_feature_alpha_dropout_without_train_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_fractional_max_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_gaussian_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_interpolate_area_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_interpolate_bilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_interpolate_linear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_kl_div_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_margin_ranking_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_max_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_max_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_max_unpool2d_grad_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_poisson_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_relu6_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_rrelu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_softshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_nn_functional_upsample_nearest_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_put_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_randint_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_randn_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_resolve_conj_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_rot90_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_scatter_reduce_amin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_select_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_slice_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_sort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_special_chebyshev_polynomial_u_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_special_laguerre_polynomial_l_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_special_legendre_polynomial_p_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_special_shifted_chebyshev_polynomial_u_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_special_xlog1py_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_special_zeta_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_std_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_sum_to_size_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_svd_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_t_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_to_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_torch_ops_aten__safe_softmax_default_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_trace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_trapezoid_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_tril_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_true_divide_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_uniform_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_unsafe_chunk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_var_unbiased_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_vdot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_compare_cpu_view_as_real_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_compare_cpu_zeros_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_T_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_angle_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_as_strided_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_atanh_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_char_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_conj_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_double_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_dstack_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_empty_like_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_exp_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_fft_hfft_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_fft_ifftshift_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_fill_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_flatten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_float_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_full_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_hsplit_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_index_add_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_index_fill_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_isinf_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_nn_functional_conv1d_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_nn_functional_conv2d_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_randn_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_ravel_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_roll_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_select_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_sgn_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_sin_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_stack_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_sum_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_unbind_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_unflatten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_complex_half_reference_testing_unsqueeze_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_dtypes___getitem___cuda, test/test_ops.py::TestCommonCUDA::test_dtypes___rmul___cuda, test/test_ops.py::TestCommonCUDA::test_dtypes___ror___cuda, test/test_ops.py::TestCommonCUDA::test_dtypes___rsub___cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__native_batch_norm_legit_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_T_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs__conversions_float_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs__conversions_half_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs__conversions_polar_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_acos_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_add_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_addr_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_all_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_amax_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_as_strided_copy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_atan2_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_atleast_2d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_bitwise_and_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_bitwise_left_shift_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_bitwise_not_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_bitwise_right_shift_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_broadcast_shapes_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_bucketize_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_chunk_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_clamp_max_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_conj_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_diag_embed_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_div_floor_rounding_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_dstack_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_empty_strided_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fft_fft_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fft_ifft_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fft_ihfft_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fft_irfft_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fft_rfft2_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fill_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fliplr_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_floor_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fmin_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_fmod_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_frac_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_gcd_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_gt_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_hsplit_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_index_copy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_index_fill_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_index_select_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_isfinite_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_isreal_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_le_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_lerp_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_linalg_matrix_norm_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_linalg_svd_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_linalg_vector_norm_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_linspace_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_log2_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_log_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_log_normal_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_masked_fill_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_channel_shuffle_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_dropout_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_group_norm_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_huber_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_layer_norm_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_leaky_relu_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_pairwise_distance_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_relu_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_smooth_l1_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_nn_functional_triplet_margin_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_normal_number_mean_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_ones_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_ravel_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_remainder_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_repeat_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_reshape_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_select_scatter_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_signbit_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_sinh_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_special_bessel_j1_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_special_i0e_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_special_logit_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_special_xlog1py_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_split_with_sizes_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_sqrt_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_squeeze_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_squeeze_multiple_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_stack_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_std_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_sub_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_t_copy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_tanh_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_transpose_copy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_transpose_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_trunc_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_unflatten_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_unfold_copy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_unfold_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_view_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes__refs_where_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_acosh_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_addmv_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_all_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_aminmax_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_any_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_as_strided_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_as_strided_scatter_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_atleast_1d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_bernoulli_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_bfloat16_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_bitwise_left_shift_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_bitwise_right_shift_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_bmm_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_broadcast_to_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_byte_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cat_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cauchy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cdist_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_chalf_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_char_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cholesky_inverse_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_clamp_min_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_clone_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_copysign_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cosh_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cov_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cumprod_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_cumulative_trapezoid_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_diag_embed_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_diagonal_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_digamma_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_dsplit_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_empty_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_erf_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_fft_ifftn_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_fft_ihfftn_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_fft_irfftn_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_flatten_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_fliplr_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_float_power_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_fmax_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_grid_sampler_2d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_gt_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_histogram_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_hstack_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_hypot_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_i0_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_index_add_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_index_reduce_prod_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_int_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_isinf_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_isreal_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_ldexp_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_lerp_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_lgamma_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_cross_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_lu_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_lu_factor_ex_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_matrix_power_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_matrix_rank_hermitian_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_solve_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_solve_triangular_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_svd_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_svdvals_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_linalg_tensorinv_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_logdet_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_logical_and_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_logical_not_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_logsumexp_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_long_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_lt_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_lu_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_masked_fill_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_masked_logaddexp_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_masked_median_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_masked_softmax_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_masked_std_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_masked_sum_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_masked_var_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_max_reduction_no_dim_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_min_reduction_no_dim_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_minimum_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_movedim_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_mvlgamma_mvlgamma_p_5_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_narrow_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_native_dropout_backward_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_new_empty_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_new_ones_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nextafter_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_adaptive_avg_pool1d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_adaptive_max_pool3d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_bilinear_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_conv3d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_ctc_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_dropout3d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_embedding_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_gaussian_nll_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_gelu_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_glu_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_hinge_embedding_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_instance_norm_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_interpolate_area_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_interpolate_nearest-exact_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_l1_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_margin_ranking_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_max_pool2d_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_max_unpool2d_grad_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_multilabel_margin_loss_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_pad_circular_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_softplus_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_nn_functional_threshold_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_normal_number_mean_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_polygamma_polygamma_n_4_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_rad2deg_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_rand_like_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_randint_like_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_real_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_reciprocal_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_repeat_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_resize__cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_resolve_neg_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_roll_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_rot90_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_round_decimals_3_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_scatter_add_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_scatter_reduce_prod_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_scatter_reduce_sum_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_searchsorted_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_sigmoid_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_sinc_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_sinh_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_slice_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_chebyshev_polynomial_u_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_i0e_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_i1_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_legendre_polynomial_p_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_ndtr_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_scaled_modified_bessel_k1_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_shifted_chebyshev_polynomial_v_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_special_xlog1py_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_split_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_std_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_sub_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_svd_lowrank_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_tanh_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_tensordot_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_torch_ops_aten__efficient_attention_forward_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_torch_ops_aten__flash_attention_forward_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_transpose_copy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_transpose_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_triangular_solve_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_triu_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_unfold_copy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_unique_consecutive_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_view_as_real_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_vstack_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_xlogy_cuda, test/test_ops.py::TestCommonCUDA::test_dtypes_zeros_like_cuda, test/test_ops.py::TestCommonCUDA::test_errors___rpow___cuda, test/test_ops.py::TestCommonCUDA::test_errors_amax_cuda, test/test_ops.py::TestCommonCUDA::test_errors_amin_cuda, test/test_ops.py::TestCommonCUDA::test_errors_atan2_cuda, test/test_ops.py::TestCommonCUDA::test_errors_bitwise_or_cuda, test/test_ops.py::TestCommonCUDA::test_errors_bitwise_right_shift_cuda, test/test_ops.py::TestCommonCUDA::test_errors_copysign_cuda, test/test_ops.py::TestCommonCUDA::test_errors_cov_cuda, test/test_ops.py::TestCommonCUDA::test_errors_diag_cuda, test/test_ops.py::TestCommonCUDA::test_errors_div_no_rounding_mode_cuda, test/test_ops.py::TestCommonCUDA::test_errors_dstack_cuda, test/test_ops.py::TestCommonCUDA::test_errors_eq_cuda, test/test_ops.py::TestCommonCUDA::test_errors_fft_hfftn_cuda, test/test_ops.py::TestCommonCUDA::test_errors_fft_irfft_cuda, test/test_ops.py::TestCommonCUDA::test_errors_histogramdd_cuda, test/test_ops.py::TestCommonCUDA::test_errors_hsplit_cuda, test/test_ops.py::TestCommonCUDA::test_errors_hypot_cuda, test/test_ops.py::TestCommonCUDA::test_errors_jiterator_binary_cuda, test/test_ops.py::TestCommonCUDA::test_errors_ldexp_cuda, test/test_ops.py::TestCommonCUDA::test_errors_le_cuda, test/test_ops.py::TestCommonCUDA::test_errors_linalg_cross_cuda, test/test_ops.py::TestCommonCUDA::test_errors_linspace_cuda, test/test_ops.py::TestCommonCUDA::test_errors_linspace_tensor_overload_cuda, test/test_ops.py::TestCommonCUDA::test_errors_logcumsumexp_cuda, test/test_ops.py::TestCommonCUDA::test_errors_logspace_tensor_overload_cuda, test/test_ops.py::TestCommonCUDA::test_errors_max_binary_cuda, test/test_ops.py::TestCommonCUDA::test_errors_min_binary_cuda, test/test_ops.py::TestCommonCUDA::test_errors_minimum_cuda, test/test_ops.py::TestCommonCUDA::test_errors_movedim_cuda, test/test_ops.py::TestCommonCUDA::test_errors_mul_cuda, test/test_ops.py::TestCommonCUDA::test_errors_native_layer_norm_cuda, test/test_ops.py::TestCommonCUDA::test_errors_ne_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_adaptive_avg_pool1d_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_adaptive_avg_pool2d_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_avg_pool2d_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_embedding_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_gelu_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_group_norm_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_hardtanh_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_max_pool1d_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_max_pool2d_cuda, test/test_ops.py::TestCommonCUDA::test_errors_nn_functional_multi_margin_loss_cuda, test/test_ops.py::TestCommonCUDA::test_errors_ormqr_cuda, test/test_ops.py::TestCommonCUDA::test_errors_reshape_as_cuda, test/test_ops.py::TestCommonCUDA::test_errors_roll_cuda, test/test_ops.py::TestCommonCUDA::test_errors_signal_windows_cosine_cuda, test/test_ops.py::TestCommonCUDA::test_errors_signal_windows_gaussian_cuda, test/test_ops.py::TestCommonCUDA::test_errors_signal_windows_general_cosine_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sparse_mul_layout0_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sparse_mul_layout4_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sparse_randn_like_layout0_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sparse_randn_like_layout3_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sparse_sum_layout0_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sparse_zeros_like_layout0_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sparse_zeros_like_layout2_cuda, test/test_ops.py::TestCommonCUDA::test_errors_special_hermite_polynomial_h_cuda, test/test_ops.py::TestCommonCUDA::test_errors_sub_cuda, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_abs_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_addcmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_all_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_argmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_asinh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_ceil_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_cholesky_inverse_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_clamp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_clamp_min_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_conj_physical_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_cross_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_diagonal_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_digamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_dot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_equal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_erf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_fft_ifft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_fft_ihfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_fft_irfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_fft_rfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_fft_rfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_igammac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_kthvalue_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_lgamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_cross_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_eigh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_eigvals_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_inv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_ldl_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_lstsq_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_multi_dot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_pinv_hermitian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linalg_vecdot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_linspace_tensor_overload_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_log10_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_logical_or_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_logspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_logsumexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_lu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_lu_unpack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_min_reduction_no_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_msort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_nansum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_neg_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_nonzero_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_norm_fro_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_qr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_round_decimals_3_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_round_decimals_neg_3_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_scatter_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_scatter_reduce_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_scatter_reduce_sum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_searchsorted_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_sin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_softmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_bessel_y1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_chebyshev_polynomial_v_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_erfcx_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_i0e_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_laguerre_polynomial_l_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_legendre_polynomial_p_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_modified_bessel_k0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_ndtr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_scaled_modified_bessel_k1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_special_zeta_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_sqrt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_square_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_std_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_take_along_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_take_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_tensordot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_transpose_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_unbind_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_unfold_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_where_cuda_float32, test/test_ops.py::TestCommonCUDA::test_meta_consistency_out_dtype_mismatch_xlogy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_H_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_T_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices___radd___cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices___radd___cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices___rdiv___cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices___rmul___cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices___rsub___cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices__unsafe_masked_index_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_abs_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_addmm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_addr_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_all_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_amax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_amin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_aminmax_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_angle_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_as_strided_partial_views_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_as_strided_partial_views_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_atan2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_atleast_1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_atleast_1d_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_atleast_2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_atleast_3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_atleast_3d_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_block_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_block_diag_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_bool_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_broadcast_tensors_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_broadcast_to_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_broadcast_to_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_cauchy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_ceil_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_ceil_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_cfloat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_clamp_min_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_column_stack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_conj_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_conj_physical_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_corrcoef_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_corrcoef_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_cos_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_cosh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_cummax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_cummax_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_diag_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_diagonal_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_double_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_double_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_dsplit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_dsplit_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_empty_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_empty_permuted_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_empty_strided_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_equal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_erf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_erf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_exp_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_expand_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_expand_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_expand_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_expand_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_expm1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_eye_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_fft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_fft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_fftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_fftshift_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_hfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_ifft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_ifftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_ifftshift_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_ihfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_irfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_rfft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_fft_rfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_flipud_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_floor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_full_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_grid_sampler_2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_gt_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_half_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_heaviside_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_histc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_i0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_index_fill_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_index_put_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_index_reduce_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_index_reduce_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_inner_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_isneginf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_isneginf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_isreal_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_item_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_jiterator_4inputs_with_extra_args_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_jiterator_binary_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_jiterator_binary_return_by_ref_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_jiterator_unary_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_kthvalue_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_ldexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_le_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_cholesky_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_diagonal_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_ldl_factor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_lu_factor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_matrix_rank_hermitian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_qr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_slogdet_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_solve_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_vander_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_vecdot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_linalg_vector_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_log1p_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_log2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_log_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_logical_or_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_logical_xor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_logit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_logspace_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_mH_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_amax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_amin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_argmax_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_argmin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_cumsum_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_normalize_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_prod_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_masked_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_maximum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_meshgrid_list_of_tensors_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_meshgrid_variadic_tensors_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_mode_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_movedim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_mv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_mvlgamma_mvlgamma_p_3_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nanmedian_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nansum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_native_batch_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_new_empty_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_new_ones_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_new_ones_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_new_zeros_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_adaptive_max_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_avg_pool1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_avg_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_batch_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_bilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_channel_shuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_cosine_similarity_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_ctc_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_elu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_feature_alpha_dropout_without_train_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_interpolate_linear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_interpolate_trilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_linear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_local_response_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_margin_ranking_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_max_pool1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_max_unpool2d_grad_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_pad_reflect_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_pad_replicate_negative_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_pairwise_distance_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_pairwise_distance_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_pixel_unshuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_relu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_rrelu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_selu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_smooth_l1_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_softmin_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_softsign_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_tanhshrink_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_threshold_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_unfold_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nn_functional_upsample_bilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nonzero_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nonzero_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_nonzero_static_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_norm_fro_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_ormqr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_pinverse_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_polygamma_polygamma_n_0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_polygamma_polygamma_n_1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_polygamma_polygamma_n_2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_polygamma_polygamma_n_4_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_put_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_randn_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_real_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_repeat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_repeat_interleave_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_reshape_as_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_resize__cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_resize_as__cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_resize_as__cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_resolve_conj_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_resolve_neg_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_roll_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_rot90_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_rot90_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_rsub_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_scalar_tensor_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_scatter_reduce_amin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_select_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_select_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sigmoid_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sigmoid_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sign_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_signal_windows_exponential_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_signal_windows_general_cosine_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_signal_windows_hamming_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_signal_windows_hann_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_signal_windows_nuttall_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_slice_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_softmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sort_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_airy_ai_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_bessel_j0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_bessel_y0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_bessel_y1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_chebyshev_polynomial_t_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_chebyshev_polynomial_v_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_log_ndtr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_ndtri_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_scaled_modified_bessel_k0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_shifted_chebyshev_polynomial_t_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_shifted_chebyshev_polynomial_v_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_special_xlog1py_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_split_list_args_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_squeeze_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_squeeze_multiple_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_stack_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_std_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_std_unbiased_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sub_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_sum_to_size_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_t_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_t_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_take_along_dim_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_tan_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_tanh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_tanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_tensor_split_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_tensordot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_trace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_transpose_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_transpose_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_trapezoid_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_trapz_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_triangular_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_tril_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_true_divide_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unbind_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unbind_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unflatten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unfold_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unique_consecutive_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unique_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unsafe_split_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_unsqueeze_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_var_mean_unbiased_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_view_as_complex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_view_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_view_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_vsplit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_multiple_devices_vsplit_cuda_int64, test/test_ops.py::TestCommonCUDA::test_multiple_devices_xlogy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values___rmul___cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_abs_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_acos_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_add_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_angle_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_as_strided_partial_views_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_as_strided_scatter_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_atan2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_atan_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_atleast_2d_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_bfloat16_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_bitwise_and_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_bitwise_xor_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_block_diag_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_broadcast_to_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_byte_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_clamp_min_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_clone_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_constant_pad_nd_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_contiguous_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_count_nonzero_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_deg2rad_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_diagonal_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_diff_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_dsplit_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_empty_like_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_eq_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_equal_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_exp_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_eye_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_fft_ifftn_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_fft_rfftn_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_fliplr_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_fmin_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_full_like_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_gt_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_hstack_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_jiterator_binary_return_by_ref_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_jiterator_unary_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_masked_prod_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_masked_scatter_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_masked_select_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_max_reduction_no_dim_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_meshgrid_list_of_tensors_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_nan_to_num_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_nn_functional_pixel_unshuffle_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_nonzero_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_polygamma_polygamma_n_0_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_prod_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_repeat_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_repeat_interleave_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_reshape_as_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_reshape_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_rot90_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_rsqrt_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_scatter_add_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_scatter_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_short_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_sin_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_slice_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_bessel_y0_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_chebyshev_polynomial_v_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_laguerre_polynomial_l_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_legendre_polynomial_p_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_modified_bessel_i0_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_modified_bessel_k1_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_ndtri_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_scaled_modified_bessel_k0_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_special_shifted_chebyshev_polynomial_v_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_split_with_sizes_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_squeeze_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_stack_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_true_divide_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_unbind_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_unsafe_split_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_view_as_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_view_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_zero__cuda_bool, test/test_ops.py::TestCommonCUDA::test_non_standard_bool_values_zeros_like_cuda_bool, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_H_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_T_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples___getitem___cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples___radd___cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples___rmod___cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples___ror___cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples___rsub___cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples___rxor___cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples__native_batch_norm_legit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_addbmm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_addbmm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_addmm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_addmm_decomposed_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_addmv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_addr_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_addr_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_all_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_any_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_any_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_argmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_argmin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_argwhere_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_as_strided_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_as_strided_partial_views_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_as_strided_partial_views_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_as_strided_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_asin_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_asin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_asinh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_asinh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_atan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_atan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_atanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_atleast_1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_atleast_2d_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_atleast_2d_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_baddbmm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_bfloat16_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_bincount_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_bitwise_and_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_bmm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_bmm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_bool_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_bucketize_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cartesian_prod_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cdouble_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cdouble_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_ceil_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_ceil_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_chalf_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_chalf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cholesky_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cholesky_inverse_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_chunk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_chunk_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_clamp_max_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_conj_physical_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_constant_pad_nd_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_constant_pad_nd_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_contiguous_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_contiguous_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_contiguous_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cosh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_count_nonzero_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cov_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cross_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cumprod_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_cumprod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_diag_embed_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_diagonal_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_diagonal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_diff_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_div_trunc_rounding_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_double_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_empty_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_empty_like_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_empty_permuted_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_empty_strided_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_eq_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_equal_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_exp2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_expand_as_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_expand_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_expand_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_expand_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_eye_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_eye_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_fft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_fft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_hfft2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_hfft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_hfft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_hfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_hfftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_ifft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_ifftshift_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_ihfftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_irfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_irfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_irfftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_rfft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_rfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fft_rfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fliplr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_flipud_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_flipud_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_flipud_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_float_power_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_fmod_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_frac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_frexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_full_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_full_like_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_full_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_ge_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_ge_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_gradient_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_heaviside_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_hsplit_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_hstack_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_i0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_igammac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_imag_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_add_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_reduce_amax_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_reduce_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_reduce_prod_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_index_select_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_int_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_isinf_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_isnan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_isneginf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_isreal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_jiterator_2inputs_2outputs_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_jiterator_4inputs_with_extra_args_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_jiterator_binary_return_by_ref_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_jiterator_unary_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_ldexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_lgamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_cholesky_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_cholesky_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_cholesky_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_cond_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_det_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_diagonal_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_eigh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_eigh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_eigvals_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_eigvalsh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_eigvalsh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_ldl_solve_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_lstsq_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_lstsq_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_lstsq_grad_oriented_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_lu_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_lu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_lu_factor_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_matrix_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_matrix_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_matrix_power_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_matrix_rank_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_norm_subgradients_at_zero_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_pinv_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_solve_ex_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_svdvals_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_svdvals_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_tensorsolve_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_tensorsolve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linalg_vander_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linspace_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_linspace_tensor_overload_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_log2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_log_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_log_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_logdet_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_logical_and_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_logical_xor_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_logspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_logsumexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_mH_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_amin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_argmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_cumsum_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_fill_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_logsumexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_select_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_select_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_softmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_sum_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_var_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_masked_var_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_matmul_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_matmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_matrix_exp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_max_binary_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_max_pool2d_with_indices_backward_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_max_reduction_no_dim_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_max_reduction_with_dim_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_maximum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_median_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_median_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_meshgrid_list_of_tensors_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_meshgrid_variadic_tensors_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_min_reduction_no_dim_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_min_reduction_with_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_minimum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_minimum_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_mode_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_msort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_mv_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_mvlgamma_mvlgamma_p_5_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nanmean_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nanquantile_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_narrow_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_narrow_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_narrow_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_narrow_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_native_batch_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_native_dropout_backward_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_new_full_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_new_ones_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_new_zeros_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_adaptive_avg_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_adaptive_max_pool1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_adaptive_max_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_batch_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_bilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_binary_cross_entropy_with_logits_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_channel_shuffle_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_conv1d_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_conv1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_conv_transpose1d_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_conv_transpose3d_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_cosine_similarity_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_cross_entropy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_ctc_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_dropout2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_dropout3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_feature_alpha_dropout_without_train_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_fractional_max_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_gaussian_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_gelu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_hardswish_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_hardtanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_huber_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_instance_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_interpolate_trilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_linear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_local_response_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_max_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_multilabel_margin_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_pad_circular_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_pad_constant_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_pad_constant_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_pad_replicate_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_pixel_unshuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_poisson_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_poisson_nll_loss_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_rms_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_smooth_l1_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_softmin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_tanhshrink_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_unfold_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nn_functional_unfold_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_nonzero_static_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_norm_fro_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_norm_fro_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_norm_inf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_normal_in_place_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_ones_like_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_outer_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_permute_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_polygamma_polygamma_n_3_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_polygamma_polygamma_n_3_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_polygamma_polygamma_n_4_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_positive_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_positive_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_pow_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_put_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_put_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_quantile_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_rad2deg_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_rand_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_randint_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_randn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_ravel_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_reciprocal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_repeat_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_repeat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_repeat_interleave_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_reshape_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_reshape_as_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_reshape_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_rot90_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_round_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_round_decimals_0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_round_decimals_3_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_rsqrt_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_rsub_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_scalar_tensor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_scalar_tensor_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_scatter_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_scatter_reduce_amin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_scatter_reduce_prod_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_select_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_sgn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_short_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_signal_windows_gaussian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_signal_windows_kaiser_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_signal_windows_nuttall_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_signbit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_sinc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_sinc_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_slice_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_slice_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_sort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_bessel_y1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_chebyshev_polynomial_u_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_chebyshev_polynomial_v_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_chebyshev_polynomial_v_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_hermite_polynomial_he_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_hermite_polynomial_he_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_i1e_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_modified_bessel_k0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_ndtr_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_shifted_chebyshev_polynomial_t_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_shifted_chebyshev_polynomial_u_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_shifted_chebyshev_polynomial_u_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_spherical_bessel_j0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_special_spherical_bessel_j0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_split_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_split_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_split_list_args_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_split_with_sizes_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_split_with_sizes_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_square_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_square_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_square_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_squeeze_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_stack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_std_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_sum_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_sum_to_size_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_sum_to_size_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_svd_lowrank_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_t_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_t_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_t_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_t_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_take_along_dim_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_tan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_tanh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_tensordot_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_transpose_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_trapezoid_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_trapezoid_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_trunc_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_unbind_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_unsafe_split_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_var_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_var_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_var_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_var_unbiased_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_vdot_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_view_as_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_view_cuda_int64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_vstack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_where_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_zero__cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_zeros_cuda_float32, test/test_ops.py::TestCommonCUDA::test_noncontiguous_samples_zeros_like_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_allclose_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_argwhere_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_cat_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_clone_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_diag_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_diagflat_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_diagflat_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_diff_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_diff_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_equal_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_flatten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_item_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_jiterator_2inputs_2outputs_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_jiterator_4inputs_with_extra_args_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_jiterator_4inputs_with_extra_args_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_linalg_vander_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_linalg_vander_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_native_layer_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_nn_functional_conv_transpose1d_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_nn_functional_group_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_nn_functional_pdist_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_nn_functional_rms_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_nn_functional_smooth_l1_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_permute_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_permute_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_ravel_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_roll_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_signal_windows_blackman_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_signal_windows_general_cosine_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_signal_windows_hamming_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_squeeze_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_squeeze_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_squeeze_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_squeeze_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_squeeze_multiple_cuda_float64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_tensor_split_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_tensor_split_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_triu_indices_cuda_int64, test/test_ops.py::TestCommonCUDA::test_numpy_ref_unbind_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_numpy_ref_view_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_out___rand___cuda_int64, test/test_ops.py::TestCommonCUDA::test_out___rdiv___cuda_float32, test/test_ops.py::TestCommonCUDA::test_out___ror___cuda_int64, test/test_ops.py::TestCommonCUDA::test_out__refs__conversions_bfloat16_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs__conversions_cdouble_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs__conversions_cfloat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs__conversions_char_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs__conversions_complex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs__conversions_float_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_abs_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_asinh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_atan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_atleast_3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_bitwise_and_cuda_int64, test/test_ops.py::TestCommonCUDA::test_out__refs_bitwise_left_shift_cuda_int64, test/test_ops.py::TestCommonCUDA::test_out__refs_block_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_chunk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_clamp_max_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_column_stack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_count_nonzero_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_diagonal_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_digamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_dot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_dstack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_equal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_erf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_expand_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_eye_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_fft_fft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_fft_fftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_fft_ihfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_fft_irfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_fft_irfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_fft_rfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_flipud_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_floor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_fmin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_gt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_imag_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out__refs_isneginf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_linalg_diagonal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_linalg_vector_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_linspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_logical_not_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_lt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_meshgrid_list_of_tensors_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_minimum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_mul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_new_ones_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_channel_shuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_huber_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_l1_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_layer_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_mish_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_mse_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_prelu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_smooth_l1_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_softmax_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_softplus_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_tanhshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_nn_functional_triplet_margin_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_normal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_permute_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_real_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_remainder_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_reshape_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_reshape_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_rot90_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_sin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_special_i0e_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_special_i1e_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_special_multigammaln_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_special_spherical_bessel_j0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_special_xlog1py_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_special_zeta_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_squeeze_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_take_along_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_tensor_split_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_transpose_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_tril_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_unbind_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__refs_view_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out__unsafe_masked_index_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_any_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_argwhere_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_atan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_bitwise_and_cuda_int64, test/test_ops.py::TestCommonCUDA::test_out_bitwise_right_shift_cuda_int64, test/test_ops.py::TestCommonCUDA::test_out_bitwise_xor_cuda_int64, test/test_ops.py::TestCommonCUDA::test_out_block_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_bmm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_broadcast_to_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_cartesian_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_cdouble_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_chalf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_cholesky_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_cholesky_inverse_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_clamp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_clamp_max_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_clamp_min_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_combinations_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_constant_pad_nd_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_cos_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_cummin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_cumsum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_diagonal_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_diff_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_dist_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_dot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_empty_permuted_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_empty_strided_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_eye_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_fft_hfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_fft_ifft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_fft_ifft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_fft_ihfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_flipud_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_float_power_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_geqrf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_grid_sampler_3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_heaviside_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_histc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_hstack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_hypot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_index_reduce_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_integral_dtype__refs_prod_cuda_int16, test/test_ops.py::TestCommonCUDA::test_out_isnan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_jiterator_2inputs_2outputs_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_jiterator_4inputs_with_extra_args_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_jiterator_binary_return_by_ref_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_jiterator_unary_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_le_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_cholesky_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_cross_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_det_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_lu_factor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_matrix_rank_hermitian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_multi_dot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_pinv_hermitian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_pinv_singular_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_qr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_linalg_tensorinv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_log_normal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_logical_xor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_logit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_logspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_masked_cumsum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_masked_log_softmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_masked_normalize_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_masked_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_masked_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_max_binary_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_max_reduction_no_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_max_reduction_with_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_maximum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_median_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_min_reduction_no_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_minimum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_msort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nanmedian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nansum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_neg_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_alpha_dropout_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_batch_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_bilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_celu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_cosine_similarity_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_dropout2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_fractional_max_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_grid_sample_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_hardswish_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_interpolate_nearest-exact_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_l1_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_max_pool1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_max_unpool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_multi_head_attention_forward_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_pixel_shuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_relu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_silu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_softmin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_softmin_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_softshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_nn_functional_softsign_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_norm_inf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_normal_in_place_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_normal_number_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_ones_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_outer_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_permute_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_polygamma_polygamma_n_0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_polygamma_polygamma_n_1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_qr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_quantile_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_randn_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_real_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_reciprocal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_renorm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_repeat_interleave_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_abs_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_acos_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_acos_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_add_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_addcmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_addmm_decomposed_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_addmv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_asin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_atanh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_atanh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_cholesky_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_column_stack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_copysign_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_cos_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_cross_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_cumsum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_diag_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_diagonal_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_erf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_erfc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_exp2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_exp_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_expand_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_expand_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_fft2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_fft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_fftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_hfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_hfft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_hfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_ifft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_ifftn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_fft_irfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_full_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_i0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_index_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_inner_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_ldexp_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_cholesky_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_cholesky_ex_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_cholesky_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_eigh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_eigvals_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_householder_product_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_lu_factor_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_lu_factor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_lu_solve_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_matrix_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_norm_subgradients_at_zero_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_pinv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linalg_solve_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_linspace_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_log_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_log_softmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_log_softmax_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_logcumsumexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_logspace_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_matmul_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_maximum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_min_binary_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_msort_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_mv_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_nanmean_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_nanmean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_neg_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_nn_functional_avg_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_nn_functional_avg_pool3d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_nn_functional_linear_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_nn_functional_logsigmoid_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_norm_fro_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_norm_nuc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_ones_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_ones_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_ormqr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_outer_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_outer_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_permute_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_polygamma_polygamma_n_0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_polygamma_polygamma_n_1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_pow_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_qr_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_reciprocal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_remainder_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_rsqrt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_scatter_reduce_amin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_scatter_reduce_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_sgn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_sin_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_sparse_sampled_addmm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_special_entr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_special_erfcx_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_special_ndtri_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_split_with_sizes_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_split_with_sizes_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_sqrt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_std_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_sub_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_svd_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_tan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_tensordot_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_tensordot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_topk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_tril_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_triu_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_true_divide_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_true_divide_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_unfold_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_unsqueeze_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_var_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_vdot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_view_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_vstack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_vstack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_requires_grad_error_zeros_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_out_resize__cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_round_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_rsqrt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_scatter_reduce_amax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_searchsorted_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_short_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_signal_windows_kaiser_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_signbit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_sinc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_airy_ai_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_bessel_j1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_entr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_laguerre_polynomial_l_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_modified_bessel_k1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_scaled_modified_bessel_k1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_special_zeta_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_sqrt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_square_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_stack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_std_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_svd_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_tensordot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_topk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_trace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_trapezoid_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_triangular_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_triu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_unfold_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_unique_consecutive_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_var_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_var_unbiased_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_view_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_warning___rand___cuda, test/test_ops.py::TestCommonCUDA::test_out_warning___rmatmul___cuda, test/test_ops.py::TestCommonCUDA::test_out_warning___ror___cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__batch_norm_with_update_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__native_batch_norm_legit_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs__conversions_cdouble_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs__conversions_chalf_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs__conversions_float_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs__conversions_int_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs__conversions_long_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs__conversions_polar_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs__conversions_short_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_abs_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_addr_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_allclose_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_any_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_arange_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_as_strided_scatter_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_atleast_1d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_atleast_2d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_bitwise_right_shift_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_broadcast_tensors_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_conj_physical_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_constant_pad_nd_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_cumsum_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_dstack_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_eq_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_equal_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_erf_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_exp2_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_eye_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_fft_fft_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_fft_fftn_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_fft_fftshift_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_fft_hfft_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_fft_irfft_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_fft_rfft_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_flatten_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_flip_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_fmod_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_ge_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_geometric_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_hsplit_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_hstack_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_igamma_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_igammac_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_isfinite_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_isneginf_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_isposinf_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_lcm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_linalg_matrix_norm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_meshgrid_list_of_tensors_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_meshgrid_variadic_tensors_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_minimum_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_new_ones_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nextafter_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_alpha_dropout_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_dropout_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_elu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_glu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_hardshrink_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_leaky_relu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_nll_loss_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_relu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_softshrink_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_nn_functional_threshold_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_norm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_positive_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_prod_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_rad2deg_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_randn_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_real_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_rot90_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_select_scatter_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_signbit_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_special_entr_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_special_erfcx_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_special_i1e_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_special_logit_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_special_multigammaln_mvlgamma_p_5_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_sqrt_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_square_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_stack_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_std_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_sub_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_t_copy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_tan_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_tanh_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_transpose_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_unbind_copy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_unbind_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_unfold_copy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_view_as_complex_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_view_as_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_view_copy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_vsplit_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_where_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_xlogy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__refs_zeros_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__segment_reduce_lengths_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning__unsafe_masked_index_put_accumulate_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_acos_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_addmm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_allclose_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_argmax_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_argsort_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_as_strided_partial_views_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_asinh_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_baddbmm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_bfloat16_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_bitwise_right_shift_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_bmm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_broadcast_to_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_bucketize_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_char_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_cholesky_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_cholesky_inverse_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_clamp_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_clamp_min_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_column_stack_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_combinations_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_complex_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_conj_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_cosh_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_cross_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_cumsum_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_cumulative_trapezoid_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_diag_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_diag_embed_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_diagonal_copy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_digamma_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_dist_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_div_no_rounding_mode_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_dstack_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_einsum_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_empty_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_erfc_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_expand_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_fft_ifft2_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_fft_ihfft2_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_fft_irfft_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_fmax_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_full_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_gather_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_ge_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_grid_sampler_2d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_grid_sampler_3d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_histogramdd_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_hypot_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_igamma_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_imag_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_index_copy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_index_reduce_amax_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_index_select_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_inner_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_int_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_isposinf_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_istft_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_jiterator_unary_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_kron_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_kthvalue_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_ldexp_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_lerp_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_lgamma_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_linalg_cond_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_linalg_eigh_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_linalg_inv_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_linalg_ldl_factor_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_linalg_pinv_singular_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_linalg_tensorinv_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_linalg_vander_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_log1p_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_logdet_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_masked_argmin_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_masked_fill_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_matrix_exp_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_max_reduction_no_dim_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_min_binary_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_minimum_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_mm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nanmedian_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_ne_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_new_empty_strided_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_new_full_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_new_ones_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_adaptive_avg_pool1d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_alpha_dropout_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_celu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_conv1d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_conv_transpose2d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_conv_transpose3d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_cosine_similarity_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_elu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_feature_alpha_dropout_with_train_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_hardswish_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_interpolate_nearest-exact_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_interpolate_nearest_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_local_response_norm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_margin_ranking_loss_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_max_unpool1d_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_max_unpool1d_grad_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_multi_head_attention_forward_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_pairwise_distance_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_prelu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_silu_complex_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_silu_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_softplus_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_softshrink_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nn_functional_threshold_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_nonzero_static_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_norm_fro_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_normal_number_mean_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_ones_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_ones_like_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_permute_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_polygamma_polygamma_n_1_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_polygamma_polygamma_n_3_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_positive_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_prod_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_rad2deg_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_rand_like_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_randint_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_randint_like_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_reciprocal_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_renorm_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_repeat_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_reshape_as_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_resolve_conj_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_round_decimals_neg_3_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_scalar_tensor_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_scatter_add_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_scatter_reduce_mean_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_searchsorted_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_sgn_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_sign_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_signal_windows_general_cosine_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_signbit_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_sinh_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_softmax_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_bessel_y1_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_i1_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_legendre_polynomial_p_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_modified_bessel_i1_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_modified_bessel_k1_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_ndtri_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_polygamma_special_polygamma_n_0_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_scaled_modified_bessel_k1_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_special_spherical_bessel_j0_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_stack_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_std_mean_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_std_unbiased_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_stft_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_svd_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_tensordot_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_topk_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_torch_ops_aten__safe_softmax_default_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_transpose_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_triu_indices_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_trunc_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_unfold_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_unique_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_unsafe_chunk_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_unsafe_split_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_unsqueeze_copy_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_vdot_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_view_cuda, test/test_ops.py::TestCommonCUDA::test_out_warning_vsplit_cuda, test/test_ops.py::TestCommonCUDA::test_out_xlogy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_out_zeros_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_pointwise_tag_coverage_cuda, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float___rdiv___cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_acos_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_acos_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_acos_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_acosh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_acosh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_asin_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_asin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_asinh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atan2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atan2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atan2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atan_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atan_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atan_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_atanh_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_copysign_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_cos_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_cos_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_cosh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_deg2rad_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_digamma_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_digamma_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_div_no_rounding_mode_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_div_no_rounding_mode_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_erf_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_erf_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_exp2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_exp_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_exp_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_expm1_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_expm1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_expm1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_float_power_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_i0_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_i0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_i0_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_ldexp_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_ldexp_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_ldexp_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_ldexp_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_lgamma_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_log1p_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_log2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_log2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_log_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_logit_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_mvlgamma_mvlgamma_p_1_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_mvlgamma_mvlgamma_p_1_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_mvlgamma_mvlgamma_p_3_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_mvlgamma_mvlgamma_p_5_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_mvlgamma_mvlgamma_p_5_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_mvlgamma_mvlgamma_p_5_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_0_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_1_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_1_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_2_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_3_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_4_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_polygamma_polygamma_n_4_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_rad2deg_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_rsqrt_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_sigmoid_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_sin_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_sin_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_sinc_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_sinh_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_chebyshev_polynomial_t_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_chebyshev_polynomial_u_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_chebyshev_polynomial_v_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_chebyshev_polynomial_w_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_chebyshev_polynomial_w_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_hermite_polynomial_h_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_hermite_polynomial_h_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_hermite_polynomial_he_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_hermite_polynomial_he_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_legendre_polynomial_p_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_shifted_chebyshev_polynomial_t_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_shifted_chebyshev_polynomial_u_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_shifted_chebyshev_polynomial_v_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_shifted_chebyshev_polynomial_v_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_shifted_chebyshev_polynomial_v_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_shifted_chebyshev_polynomial_w_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_xlog1py_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_xlog1py_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_zeta_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_zeta_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_special_zeta_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_sqrt_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_sqrt_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_tan_cuda_bool, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_tan_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_tan_cuda_int32, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_tan_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_tanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_tanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_tanh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_true_divide_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_promotes_int_to_float_xlogy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_T_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_T_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_T_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_T_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_bfloat16_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_bfloat16_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_bfloat16_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_bool_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_bool_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_bool_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_byte_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_byte_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_byte_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_cdouble_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_cdouble_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_chalf_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_chalf_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_chalf_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_chalf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_chalf_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_char_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_char_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_char_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_complex_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_complex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_double_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_float_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_float_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_float_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_half_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_half_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_half_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_int_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_int_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_long_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_long_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_polar_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs__conversions_short_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_abs_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_abs_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_acos_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_acos_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_acos_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_acosh_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addcdiv_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addcdiv_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addcmul_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addcmul_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addcmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addcmul_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addr_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_addr_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_alias_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_alias_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_alias_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_all_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_allclose_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_amax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_amax_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_amax_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_amax_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_amin_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_any_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_any_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_arange_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_arange_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_arange_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_copy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_partial_views_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_partial_views_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_partial_views_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_scatter_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_as_strided_scatter_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_asin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_asin_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_asinh_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_asinh_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_asinh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_asinh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_asinh_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atan2_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atan2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atan2_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atan_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atanh_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atanh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atanh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atanh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atleast_1d_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atleast_1d_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atleast_1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atleast_1d_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atleast_3d_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atleast_3d_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_atleast_3d_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_bitwise_and_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_bitwise_not_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_bitwise_or_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_bitwise_or_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_block_diag_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_block_diag_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_block_diag_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_block_diag_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_shapes_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_tensors_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_tensors_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_tensors_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_tensors_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_to_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_to_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_broadcast_to_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_bucketize_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_bucketize_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_bucketize_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cat_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cat_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cat_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cauchy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ceil_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ceil_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_chunk_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_chunk_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_chunk_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_chunk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_chunk_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_chunk_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_chunk_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_max_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_max_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_max_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_max_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_min_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_min_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clamp_min_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clone_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clone_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clone_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_clone_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_column_stack_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_column_stack_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_physical_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_physical_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_physical_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_physical_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_physical_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_physical_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_conj_physical_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_contiguous_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_contiguous_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_copysign_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_copysign_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_copysign_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cosh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cosh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cosh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_count_nonzero_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_count_nonzero_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_count_nonzero_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cumprod_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cumprod_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cumsum_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_cumsum_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_deg2rad_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diag_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diag_embed_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diag_embed_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diag_embed_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diag_embed_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diag_embed_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diag_embed_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_scatter_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_scatter_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_scatter_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_diagonal_scatter_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_digamma_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_div_floor_rounding_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_div_no_rounding_mode_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_div_no_rounding_mode_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_div_trunc_rounding_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dot_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dot_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dot_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dsplit_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dsplit_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dsplit_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_dstack_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_empty_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_empty_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_empty_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_empty_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_empty_like_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_empty_strided_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eq_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eq_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eq_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_equal_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_equal_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_erf_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_erf_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_erfinv_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_erfinv_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp2_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exp_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_as_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expand_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expm1_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expm1_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_expm1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exponential_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_exponential_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eye_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eye_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eye_cuda_float8_e4m3fn, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eye_cuda_float8_e5m2, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eye_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_eye_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fft2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fft2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fft2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fft_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fft_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fftn_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fftn_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fftshift_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fftshift_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_fftshift_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_hfft2_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_hfft_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_hfft_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_hfft_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_hfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_hfftn_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifft2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifft2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifft2_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifft_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftn_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftn_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftshift_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftshift_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftshift_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftshift_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftshift_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ifftshift_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ihfft2_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ihfft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ihfft_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ihfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ihfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ihfftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_ihfftn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfft2_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfft2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfft2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfft2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfft_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfftn_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfftn_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_irfftn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfft2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfft2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfft2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfft_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfftn_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fft_rfftn_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fill_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fill_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fill_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_flatten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_flatten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_flatten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_flatten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_flatten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_flip_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fliplr_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fliplr_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fliplr_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fliplr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_flipud_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_float_power_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_float_power_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_floor_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_floor_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_floor_divide_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_floor_divide_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_floor_divide_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmax_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmax_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmax_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmax_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmin_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmin_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmin_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmod_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_fmod_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_frac_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_frac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_frexp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_frexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_frexp_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_gcd_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ge_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ge_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ge_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_geometric_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_gt_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_heaviside_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_hsplit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_hsplit_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_hstack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_hstack_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_hypot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_i0_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_igammac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_imag_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_add_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_fill_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_fill_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_select_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_select_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_select_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_select_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_select_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_index_select_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isclose_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isclose_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isclose_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isclose_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isclose_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isfinite_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isinf_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isinf_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isinf_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isnan_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isnan_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isnan_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isposinf_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isreal_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_isreal_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_item_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_item_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_le_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_le_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_le_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_le_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_lerp_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_lerp_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_lgamma_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_lgamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_lgamma_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_cross_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_cross_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_diagonal_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_diagonal_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_norm_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_norm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_svd_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_svd_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_svdvals_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_vecdot_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_vecdot_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_vector_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_vector_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linalg_vector_norm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_tensor_overload_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_linspace_tensor_overload_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log10_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log10_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log10_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log1p_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log1p_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log1p_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log1p_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log1p_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_softmax_with_dtype_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_softmax_with_dtype_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_softmax_with_dtype_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_log_softmax_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logaddexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_and_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_and_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_not_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_not_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_not_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_or_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_or_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_xor_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_xor_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_xor_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_xor_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logical_xor_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logspace_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logspace_tensor_overload_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logsumexp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_logsumexp_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_lt_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_lt_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_masked_fill_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_maximum_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_maximum_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_maximum_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mean_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mean_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_meshgrid_list_of_tensors_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_meshgrid_list_of_tensors_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_meshgrid_list_of_tensors_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_meshgrid_list_of_tensors_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_meshgrid_variadic_tensors_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_minimum_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_movedim_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_movedim_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_movedim_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_movedim_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mul_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mul_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mul_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mul_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mul_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_mul_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nan_to_num_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nan_to_num_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_copy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_narrow_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ne_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_neg_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_neg_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_neg_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_empty_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_empty_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_empty_strided_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_empty_strided_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_empty_strided_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_empty_strided_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_empty_strided_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_full_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_full_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_full_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_full_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_full_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_ones_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_zeros_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_zeros_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_new_zeros_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nextafter_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_alpha_dropout_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_alpha_dropout_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_alpha_dropout_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_celu_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_channel_shuffle_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_channel_shuffle_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_channel_shuffle_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_elu_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_elu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_group_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_hardshrink_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_hinge_embedding_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_layer_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_log_softmax_with_dtype_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_log_softmax_with_dtype_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_log_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_log_softmax_with_dtype_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_log_softmax_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_margin_ranking_loss_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_mish_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_mish_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_mse_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_nll_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pairwise_distance_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pairwise_distance_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pairwise_distance_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pdist_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pixel_shuffle_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pixel_shuffle_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pixel_shuffle_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_pixel_unshuffle_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_poisson_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_poisson_nll_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_poisson_nll_loss_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_prelu_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_prelu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_relu6_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_relu6_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_relu6_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_selu_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_selu_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softmax_with_dtype_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softmax_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softmin_with_dtype_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softmin_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softmin_with_dtype_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softmin_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softmin_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_softplus_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_tanhshrink_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_tanhshrink_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_tanhshrink_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_threshold_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_threshold_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_threshold_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_threshold_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_triplet_margin_loss_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_triplet_margin_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_nn_functional_triplet_margin_loss_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_normal__in_place_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_normal__in_place_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_normal_number_mean_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_normal_number_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ones_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_permute_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_positive_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_pow_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_pow_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_pow_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_pow_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_prod_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_prod_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_prod_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_prod_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rad2deg_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rad2deg_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rad2deg_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_randn_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_randn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ravel_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ravel_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ravel_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_ravel_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_real_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_real_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_real_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_real_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_real_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reciprocal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reciprocal_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_remainder_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_remainder_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_remainder_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_remainder_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_repeat_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_repeat_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_repeat_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_repeat_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_repeat_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reshape_as_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reshape_as_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reshape_as_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reshape_as_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reshape_as_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reshape_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_reshape_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_roll_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_roll_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rot90_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rot90_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_round_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_round_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rsqrt_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rsqrt_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rsqrt_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rsub_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_rsub_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_select_scatter_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_select_scatter_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_select_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sgn_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sgn_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sgn_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sgn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sigmoid_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sign_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sign_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_signbit_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_signbit_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_signbit_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_signbit_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sin_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sin_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sinc_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sinc_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sinc_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sinh_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sinh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sinh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sinh_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_softmax_with_dtype_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_bessel_j0_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_bessel_j1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_bessel_j1_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_bessel_j1_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_bessel_j1_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_entr_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_entr_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_erfcx_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_erfcx_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_erfcx_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_erfcx_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_i0e_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_i0e_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_i1_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_i1_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_i1e_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_i1e_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_log_ndtr_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_log_ndtr_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_log_softmax_with_dtype_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_log_softmax_with_dtype_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_log_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_log_softmax_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_multigammaln_mvlgamma_p_1_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_multigammaln_mvlgamma_p_1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_multigammaln_mvlgamma_p_1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_multigammaln_mvlgamma_p_3_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_multigammaln_mvlgamma_p_3_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_ndtr_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_ndtr_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_ndtri_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_ndtri_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_ndtri_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_softmax_with_dtype_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_softmax_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_spherical_bessel_j0_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_spherical_bessel_j0_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_xlog1py_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_xlog1py_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_special_zeta_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_split_with_sizes_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_split_with_sizes_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sqrt_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sqrt_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sqrt_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sqrt_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sqrt_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sqrt_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_square_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_square_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_square_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_copy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_squeeze_multiple_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_stack_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_stack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_stack_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_std_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_std_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_std_mean_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_stft_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_stft_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sub_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sub_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sub_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sub_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sum_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sum_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sum_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sum_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sum_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_sum_to_size_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_t_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_t_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_t_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_t_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_t_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_take_along_dim_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_take_along_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_take_along_dim_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tan_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tan_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tanh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tanh_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tensor_split_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tensor_split_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tensor_split_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tensor_split_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tensor_split_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tensor_split_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tensor_split_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_to_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_to_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_to_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_trace_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_transpose_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_transpose_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_transpose_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_transpose_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_transpose_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_transpose_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_transpose_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tril_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tril_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tril_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tril_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tril_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_tril_indices_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_triu_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_triu_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_triu_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_triu_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_triu_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_true_divide_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_true_divide_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_true_divide_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_trunc_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unbind_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unbind_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unbind_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unbind_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unbind_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unflatten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unflatten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unflatten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unfold_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unfold_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unfold_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unfold_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unfold_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unfold_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unfold_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unsqueeze_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unsqueeze_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unsqueeze_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unsqueeze_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_unsqueeze_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_var_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_var_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_var_mean_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_var_mean_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vdot_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vdot_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_as_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_as_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_as_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_as_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_view_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vsplit_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vsplit_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vsplit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vsplit_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vsplit_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vstack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vstack_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_vstack_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_where_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_where_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_xlogy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_xlogy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_xlogy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_zeros_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_zeros_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_zeros_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_zeros_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref__refs_zeros_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_add_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_arange_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_bitwise_right_shift_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_bitwise_xor_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_diag_embed_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_div_floor_rounding_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_dot_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_dstack_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_eq_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fft_fft2_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fft_hfft2_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fft_hfft_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fft_hfftn_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fft_ifft_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fft_irfft_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fft_irfftn_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_floor_divide_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_fmin_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_geometric_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_index_select_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_linalg_cross_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_linspace_tensor_overload_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_logaddexp_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_logical_and_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_lt_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_mean_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_minimum_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_neg_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_nextafter_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_nn_functional_hardtanh_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_nn_functional_huber_loss_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_nn_functional_margin_ranking_loss_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_special_zeta_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_t_copy_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_unbind_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_view_copy_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_errors__refs_vsplit_cuda, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_T_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_T_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_T_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_T_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_T_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_bfloat16_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_bfloat16_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_bfloat16_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_bfloat16_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_bool_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_bool_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_bool_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_byte_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_byte_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_byte_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_cdouble_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_cdouble_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_cdouble_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_cdouble_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_cfloat_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_cfloat_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_cfloat_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_chalf_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_chalf_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_chalf_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_chalf_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_char_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_char_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_char_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_char_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_char_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_complex_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_complex_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_double_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_double_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_double_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_float_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_float_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_float_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_float_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_half_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_half_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_half_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_half_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_half_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_int_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_int_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_int_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_long_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_long_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_polar_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_short_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_short_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_short_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_short_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs__conversions_short_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_abs_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_abs_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_abs_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_abs_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_abs_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_acos_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_acos_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_acosh_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_acosh_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_acosh_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_acosh_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_acosh_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_add_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_add_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_add_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_add_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addcdiv_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addcmul_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addcmul_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addcmul_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addcmul_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addr_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addr_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addr_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addr_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_addr_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_alias_copy_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_alias_copy_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_alias_copy_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_alias_copy_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_all_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_all_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_allclose_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_allclose_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_amin_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_amin_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_amin_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_amin_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_any_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_any_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_any_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_arange_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_copy_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_partial_views_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_partial_views_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_partial_views_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_partial_views_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_scatter_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_as_strided_scatter_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_asin_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_asin_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_asin_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_asin_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_asinh_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_asinh_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atan2_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atan_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atan_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atan_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atanh_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atanh_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_1d_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_1d_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_1d_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_1d_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_1d_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_1d_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_1d_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_2d_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_2d_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_2d_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_2d_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_2d_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_2d_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_3d_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_3d_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_3d_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_3d_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_atleast_3d_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_bitwise_left_shift_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_bitwise_not_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_bitwise_or_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_bitwise_right_shift_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_bitwise_xor_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_block_diag_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_block_diag_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_tensors_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_tensors_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_tensors_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_tensors_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_tensors_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_tensors_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_tensors_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_broadcast_to_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_bucketize_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_bucketize_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cat_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cat_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cauchy_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ceil_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ceil_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ceil_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_chunk_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_chunk_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_chunk_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_max_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_max_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_max_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_min_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_clamp_min_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_column_stack_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_column_stack_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_column_stack_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_conj_physical_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_conj_physical_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_conj_physical_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_constant_pad_nd_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_constant_pad_nd_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_constant_pad_nd_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_contiguous_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_contiguous_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_contiguous_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_contiguous_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_contiguous_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_contiguous_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_copysign_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_copysign_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_copysign_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cos_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cos_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cos_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cos_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cosh_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cosh_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cosh_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_count_nonzero_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cumprod_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cumprod_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cumsum_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cumsum_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_cumsum_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_deg2rad_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_deg2rad_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_deg2rad_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_deg2rad_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_embed_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_embed_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diag_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_copy_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_copy_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_copy_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_scatter_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_scatter_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_scatter_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_scatter_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_scatter_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_diagonal_scatter_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_digamma_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_digamma_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_digamma_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_digamma_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_no_rounding_mode_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_no_rounding_mode_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_no_rounding_mode_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_no_rounding_mode_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_no_rounding_mode_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_trunc_rounding_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_trunc_rounding_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_div_trunc_rounding_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dot_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dsplit_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dsplit_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dsplit_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dsplit_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dsplit_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dsplit_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dstack_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dstack_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dstack_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_dstack_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_like_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_like_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_strided_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_strided_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_strided_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_strided_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_strided_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_strided_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_empty_strided_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_eq_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_eq_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_eq_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_equal_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_equal_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_equal_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_equal_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erf_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erf_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfc_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfc_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfinv_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfinv_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfinv_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfinv_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfinv_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_erfinv_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_exp2_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_exp2_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_exp_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_exp_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_as_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_as_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_as_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_copy_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_copy_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expand_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expm1_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_expm1_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_eye_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_eye_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_eye_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_eye_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft2_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft2_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft2_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft2_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fft_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fftn_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fftn_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fftn_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fftn_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fftn_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fftn_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_fftshift_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_hfft2_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_hfft_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_hfftn_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_hfftn_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_hfftn_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft2_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft2_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft2_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft2_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft2_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifft_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifftn_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifftshift_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifftshift_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifftshift_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ifftshift_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft2_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft2_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft2_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_ihfft_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft2_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft2_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft2_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft2_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft2_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfft_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_irfftn_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_rfft_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fft_rfft_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fill_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fill_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fill_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fill_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flatten_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flatten_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flatten_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flatten_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flatten_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flip_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flip_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fliplr_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fliplr_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fliplr_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fliplr_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fliplr_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fliplr_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flipud_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flipud_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_flipud_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_float_power_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_float_power_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_floor_divide_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_floor_divide_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_floor_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fmax_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fmin_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fmin_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fmin_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fmod_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fmod_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_fmod_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_frac_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_frac_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ge_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ge_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ge_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_geometric_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_geometric_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_gt_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_gt_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_heaviside_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_hsplit_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_hypot_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_i0_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_i0_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_i0_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_add_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_add_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_add_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_copy_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_copy_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_fill_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_fill_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_fill_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_fill_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_fill_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_select_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_index_select_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isclose_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isfinite_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isfinite_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isfinite_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isinf_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isinf_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isinf_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isnan_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isnan_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isnan_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isneginf_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isneginf_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isneginf_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isposinf_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isreal_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isreal_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_isreal_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_istft_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_item_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_item_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_lcm_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_le_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_lerp_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_lgamma_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_cross_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_cross_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_diagonal_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_diagonal_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_diagonal_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_matrix_norm_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_svd_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_svdvals_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_vecdot_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_vecdot_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linalg_vector_norm_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_tensor_overload_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_tensor_overload_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_tensor_overload_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_linspace_tensor_overload_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log10_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log10_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log10_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log10_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log10_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log1p_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log1p_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log1p_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log2_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log2_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log_softmax_with_dtype_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_log_softmax_with_dtype_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_and_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_and_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_and_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_and_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_and_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_not_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_not_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_or_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_xor_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_xor_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logical_xor_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logspace_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logspace_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logspace_tensor_overload_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logspace_tensor_overload_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logsumexp_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logsumexp_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logsumexp_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_logsumexp_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_lt_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_lt_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_lt_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_masked_fill_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_masked_fill_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_masked_fill_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_masked_fill_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_maximum_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_maximum_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_maximum_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_mean_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_meshgrid_list_of_tensors_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_meshgrid_list_of_tensors_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_meshgrid_list_of_tensors_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_meshgrid_variadic_tensors_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_meshgrid_variadic_tensors_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_meshgrid_variadic_tensors_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_minimum_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_minimum_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_minimum_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_minimum_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_minimum_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_movedim_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_mul_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_mul_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_mul_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_mul_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nan_to_num_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nan_to_num_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_narrow_copy_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_narrow_copy_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_narrow_copy_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_narrow_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_narrow_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_narrow_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_native_layer_norm_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_native_layer_norm_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_native_layer_norm_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ne_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ne_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_neg_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_neg_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_empty_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_empty_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_empty_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_empty_strided_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_full_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_full_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_full_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_full_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_ones_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_ones_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_zeros_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_zeros_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_zeros_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_zeros_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_zeros_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_zeros_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_new_zeros_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nextafter_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_celu_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_channel_shuffle_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_channel_shuffle_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_channel_shuffle_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_channel_shuffle_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_channel_shuffle_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_dropout_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_dropout_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_elu_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_elu_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_gelu_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_glu_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_glu_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_glu_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_group_norm_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_group_norm_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_hardshrink_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_hardtanh_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_hardtanh_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_hardtanh_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_hardtanh_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_hinge_embedding_loss_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_huber_loss_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_huber_loss_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_l1_loss_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_layer_norm_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_leaky_relu_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_leaky_relu_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_log_softmax_with_dtype_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_log_softmax_with_dtype_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_log_softmax_with_dtype_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_margin_ranking_loss_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_mse_loss_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pairwise_distance_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pairwise_distance_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pairwise_distance_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pairwise_distance_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pdist_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_shuffle_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_shuffle_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_shuffle_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_shuffle_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_shuffle_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_unshuffle_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_unshuffle_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_pixel_unshuffle_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_poisson_nll_loss_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_prelu_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_relu6_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_relu6_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_relu_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_relu_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmax_with_dtype_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmax_with_dtype_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmax_with_dtype_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmin_with_dtype_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmin_with_dtype_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmin_with_dtype_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmin_with_dtype_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softmin_with_dtype_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softplus_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softplus_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_softshrink_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_tanhshrink_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_tanhshrink_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_threshold_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_triplet_margin_loss_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_nn_functional_triplet_margin_loss_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_norm_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_norm_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_norm_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_normal__in_place_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_normal__in_place_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_normal_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_normal_number_mean_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ones_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ones_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ones_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_permute_copy_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_permute_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_permute_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_permute_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_positive_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_positive_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_positive_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_positive_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_positive_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_pow_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_pow_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_prod_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_prod_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rad2deg_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rad2deg_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rad2deg_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rad2deg_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_randn_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_ravel_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_real_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_real_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_real_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_real_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reciprocal_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reciprocal_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reciprocal_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reciprocal_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_remainder_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_remainder_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_remainder_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_remainder_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_renorm_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_renorm_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_renorm_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_repeat_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_repeat_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reshape_as_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reshape_as_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reshape_as_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reshape_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_reshape_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_roll_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_roll_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rot90_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rot90_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rot90_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_round_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_round_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_round_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsqrt_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsqrt_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsqrt_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsqrt_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsqrt_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsub_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsub_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_rsub_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_select_scatter_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_select_scatter_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sgn_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sgn_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sgn_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sgn_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sgn_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sgn_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sigmoid_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sigmoid_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sigmoid_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sigmoid_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sign_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sign_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sign_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_signbit_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_signbit_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sin_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sin_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sin_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sin_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sinc_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sinc_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sinc_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sinc_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sinh_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sinh_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sinh_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_softmax_with_dtype_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_softmax_with_dtype_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_softmax_with_dtype_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_softmax_with_dtype_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_bessel_j0_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_bessel_j0_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_bessel_j0_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_entr_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_entr_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_entr_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_erfcx_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_erfcx_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_erfcx_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i0e_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i0e_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i1_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i1_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i1_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i1e_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i1e_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_i1e_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_log_ndtr_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_log_ndtr_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_log_softmax_with_dtype_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_log_softmax_with_dtype_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_log_softmax_with_dtype_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_log_softmax_with_dtype_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_logit_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_logit_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_1_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_3_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_3_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_3_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_5_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_5_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_5_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_multigammaln_mvlgamma_p_5_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_ndtr_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_ndtr_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_ndtri_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_ndtri_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_softmax_with_dtype_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_softmax_with_dtype_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_spherical_bessel_j0_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_spherical_bessel_j0_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_xlog1py_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_xlog1py_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_special_zeta_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_split_with_sizes_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_split_with_sizes_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_split_with_sizes_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sqrt_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sqrt_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_square_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_square_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_square_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_copy_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_copy_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_copy_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_copy_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_multiple_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_multiple_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_multiple_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_squeeze_multiple_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_stack_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_stack_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_stack_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_stack_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_std_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_std_mean_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sub_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sub_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sub_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sub_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sub_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sub_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sub_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sum_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sum_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sum_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sum_to_size_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sum_to_size_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sum_to_size_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_sum_to_size_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_t_copy_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_t_copy_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_t_copy_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_t_copy_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_t_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_t_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_take_along_dim_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tan_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tan_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tan_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tan_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tan_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tanh_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tanh_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tanh_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tanh_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tensor_split_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tensor_split_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tensor_split_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_to_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_to_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_to_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_to_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_to_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_trace_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_trace_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_trace_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_copy_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_copy_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_copy_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_copy_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_transpose_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tril_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_tril_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_triu_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_triu_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_triu_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_triu_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_true_divide_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_true_divide_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_trunc_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_trunc_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unbind_copy_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unbind_copy_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unbind_copy_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unbind_copy_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unbind_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unbind_executor_aten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unflatten_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unflatten_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unfold_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_copy_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_copy_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_copy_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_unsqueeze_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_var_mean_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vdot_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_as_complex_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_as_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_as_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_as_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_as_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_as_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_copy_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_copy_executor_aten_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_copy_executor_aten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_copy_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_copy_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_copy_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_view_executor_aten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vsplit_executor_aten_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vsplit_executor_aten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vsplit_executor_aten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vsplit_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vstack_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vstack_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_vstack_executor_aten_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_where_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_where_executor_aten_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_xlogy_executor_aten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_zeros_executor_aten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_zeros_executor_aten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_executor__refs_zeros_executor_aten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_T_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_T_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_T_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_T_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_T_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_T_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bfloat16_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bfloat16_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bfloat16_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bfloat16_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bfloat16_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bool_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bool_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_bool_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_byte_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_byte_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cdouble_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cdouble_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cdouble_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cdouble_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cdouble_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cdouble_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cfloat_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_cfloat_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_chalf_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_chalf_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_chalf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_chalf_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_chalf_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_char_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_char_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_complex_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_double_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_double_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_double_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_double_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_double_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_float_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_float_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_half_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_int_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_int_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_int_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_int_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_long_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_short_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs__conversions_short_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_abs_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_abs_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_abs_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_abs_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_acos_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_acosh_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_acosh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_acosh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_acosh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_add_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_add_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_add_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_add_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_add_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addcdiv_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addcmul_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addcmul_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addcmul_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addcmul_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addcmul_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addr_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_addr_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_alias_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_alias_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_alias_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_all_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_all_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_all_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_allclose_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_allclose_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_allclose_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_amax_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_amin_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_amin_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_amin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_amin_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_amin_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_amin_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_any_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_any_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_arange_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_arange_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_arange_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_arange_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_partial_views_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_partial_views_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_partial_views_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_scatter_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_scatter_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_as_strided_scatter_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asin_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asin_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asin_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asinh_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asinh_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asinh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asinh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asinh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_asinh_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atan_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atanh_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atanh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atanh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_1d_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_1d_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_2d_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_2d_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_2d_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_3d_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_3d_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_3d_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_atleast_3d_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_and_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_and_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_and_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_left_shift_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_not_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_not_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_not_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bitwise_or_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_block_diag_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_broadcast_tensors_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_broadcast_tensors_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_broadcast_tensors_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_broadcast_to_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_broadcast_to_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_broadcast_to_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bucketize_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bucketize_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_bucketize_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cat_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cat_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cat_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cauchy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ceil_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ceil_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_chunk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clamp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clamp_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clamp_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clamp_max_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clamp_min_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clone_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clone_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clone_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_clone_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_column_stack_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_column_stack_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_column_stack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_column_stack_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_conj_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_conj_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_conj_physical_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_conj_physical_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_conj_physical_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_conj_physical_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_constant_pad_nd_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_constant_pad_nd_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_constant_pad_nd_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_constant_pad_nd_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_constant_pad_nd_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_contiguous_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_contiguous_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_contiguous_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_contiguous_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_contiguous_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_copysign_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_copysign_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cos_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cos_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cosh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cumprod_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cumprod_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cumprod_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cumprod_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cumsum_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_cumsum_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_deg2rad_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_deg2rad_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_deg2rad_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_deg2rad_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_embed_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_embed_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_embed_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diag_embed_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diagonal_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diagonal_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diagonal_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diagonal_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diagonal_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_diagonal_scatter_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_digamma_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_digamma_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_floor_rounding_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_floor_rounding_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_no_rounding_mode_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_no_rounding_mode_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_no_rounding_mode_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_no_rounding_mode_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_no_rounding_mode_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_trunc_rounding_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_trunc_rounding_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_trunc_rounding_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_div_trunc_rounding_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_dot_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_dot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_dsplit_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_dstack_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_dstack_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_dstack_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_like_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_strided_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_strided_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_strided_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_strided_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_empty_strided_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eq_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eq_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eq_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_equal_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_equal_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erf_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfc_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfc_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfinv_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfinv_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfinv_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfinv_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_erfinv_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp2_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp2_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_exp_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_as_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_as_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_as_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_as_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_as_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expand_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expm1_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expm1_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expm1_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expm1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_expm1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eye_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eye_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eye_cuda_float8_e4m3fn, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eye_cuda_float8_e5m2, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eye_cuda_float8_e5m2fnuz, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_eye_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_fft2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_fft2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_fft_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_fft_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_fftn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_fftshift_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_fftshift_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_hfft2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_hfft2_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_hfft2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_hfft2_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_hfft_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_hfftn_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifft2_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifft_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifft_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifftn_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifftn_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifftn_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifftshift_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifftshift_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ifftshift_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ihfft2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ihfft_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ihfft_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ihfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ihfft_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ihfft_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_ihfft_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft2_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfft_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfftn_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_irfftn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_rfft2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_rfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_rfft_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_rfftn_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_rfftn_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fft_rfftn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fill_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fill_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fill_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fill_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fill_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flatten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flatten_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flatten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flip_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flip_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flip_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fliplr_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flipud_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flipud_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flipud_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flipud_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flipud_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_flipud_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_float_power_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_divide_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_divide_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_divide_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_floor_divide_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fmax_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fmax_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fmin_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fmod_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_fmod_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_frac_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_frexp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_gcd_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_gcd_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ge_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ge_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ge_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_gt_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_gt_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_gt_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_heaviside_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_heaviside_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_heaviside_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_hsplit_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_hsplit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_hsplit_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_hsplit_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_hstack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_hstack_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_hstack_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_i0_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_i0_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_i0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_i0_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_i0_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_i0_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_igamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_imag_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_add_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_add_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_add_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_copy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_fill_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_fill_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_fill_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_fill_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_fill_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_fill_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_select_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_select_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_index_select_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isclose_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isclose_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isclose_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isfinite_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isfinite_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isfinite_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isfinite_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isfinite_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isfinite_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isfinite_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isinf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isinf_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isinf_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isnan_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isnan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isnan_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isnan_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isneginf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isneginf_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isposinf_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isposinf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isposinf_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isreal_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isreal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isreal_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_isreal_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_istft_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_item_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_item_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_item_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lcm_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lcm_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_le_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_le_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_le_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lerp_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lerp_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lgamma_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lgamma_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_cross_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_cross_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_cross_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_diagonal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_diagonal_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_diagonal_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_matrix_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_matrix_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_norm_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_svd_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_svdvals_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_svdvals_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_svdvals_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_vecdot_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_vector_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linalg_vector_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linspace_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linspace_tensor_overload_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linspace_tensor_overload_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_linspace_tensor_overload_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log10_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log10_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log1p_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log1p_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log1p_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log1p_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log2_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log2_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_normal_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_normal_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_softmax_with_dtype_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_softmax_with_dtype_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_log_softmax_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logaddexp_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logaddexp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logaddexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_and_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_xor_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_xor_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logical_xor_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logspace_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logspace_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logspace_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logspace_tensor_overload_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logspace_tensor_overload_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logspace_tensor_overload_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logspace_tensor_overload_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_logsumexp_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lt_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_lt_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_masked_fill_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_masked_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_masked_fill_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_masked_fill_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_maximum_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_maximum_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_maximum_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_maximum_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_mean_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_list_of_tensors_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_list_of_tensors_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_list_of_tensors_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_variadic_tensors_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_variadic_tensors_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_variadic_tensors_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_variadic_tensors_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_meshgrid_variadic_tensors_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_minimum_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_minimum_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_minimum_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_minimum_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_movedim_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_movedim_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_movedim_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_movedim_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_movedim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_movedim_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_movedim_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_mul_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_mul_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_mul_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_mul_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nan_to_num_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nan_to_num_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nan_to_num_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_narrow_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_narrow_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_narrow_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_narrow_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_narrow_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_narrow_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_native_layer_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_native_layer_norm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ne_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ne_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_neg_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_neg_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_empty_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_empty_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_empty_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_empty_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_empty_strided_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_empty_strided_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_empty_strided_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_full_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_full_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_full_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_ones_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_ones_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_ones_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_zeros_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_zeros_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_new_zeros_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nextafter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_alpha_dropout_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_alpha_dropout_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_celu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_celu_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_channel_shuffle_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_channel_shuffle_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_channel_shuffle_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_elu_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_gelu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_group_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_hardshrink_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_hardshrink_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_hardtanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_hinge_embedding_loss_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_hinge_embedding_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_hinge_embedding_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_l1_loss_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_l1_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_l1_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_leaky_relu_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_log_softmax_with_dtype_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_log_softmax_with_dtype_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_log_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_log_softmax_with_dtype_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_log_softmax_with_dtype_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_margin_ranking_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_mse_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_nll_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pairwise_distance_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pairwise_distance_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pairwise_distance_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pairwise_distance_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pairwise_distance_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_shuffle_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_shuffle_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_shuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_shuffle_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_shuffle_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_shuffle_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_shuffle_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_unshuffle_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_unshuffle_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_unshuffle_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_unshuffle_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_pixel_unshuffle_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_poisson_nll_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_poisson_nll_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_poisson_nll_loss_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_prelu_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_relu6_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_relu6_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_selu_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_selu_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_selu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_selu_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmax_with_dtype_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmax_with_dtype_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmax_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmin_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmin_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmin_with_dtype_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softmin_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_softshrink_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_tanhshrink_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_threshold_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_threshold_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_threshold_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_triplet_margin_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_triplet_margin_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_triplet_margin_loss_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_nn_functional_triplet_margin_loss_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_norm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_normal__in_place_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_normal_number_mean_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ones_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ones_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ones_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ones_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_permute_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_permute_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_permute_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_permute_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_permute_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_positive_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_positive_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_positive_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_positive_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_positive_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_pow_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_pow_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_prod_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_prod_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_prod_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rad2deg_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rad2deg_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rad2deg_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rad2deg_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_randn_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ravel_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ravel_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ravel_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ravel_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_ravel_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_real_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_real_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_real_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reciprocal_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reciprocal_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_remainder_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_remainder_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_remainder_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_remainder_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_renorm_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_renorm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_repeat_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_repeat_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_as_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_as_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_as_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_as_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_reshape_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_roll_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_roll_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_roll_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rot90_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_round_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_round_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rsqrt_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rsqrt_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rsub_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rsub_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_rsub_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_select_scatter_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_select_scatter_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_select_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_select_scatter_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sgn_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sgn_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sgn_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sigmoid_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sigmoid_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sigmoid_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sigmoid_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sign_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sign_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_signbit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sin_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sin_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sinc_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sinc_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sinh_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sinh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_softmax_with_dtype_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_bessel_j0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_bessel_j0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_bessel_j1_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_bessel_j1_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_bessel_j1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_bessel_j1_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_bessel_j1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_entr_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_entr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_entr_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_erfcx_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_erfcx_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_erfcx_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_i0e_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_i1_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_i1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_i1e_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_i1e_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_i1e_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_log_ndtr_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_log_ndtr_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_log_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_log_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_log_softmax_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_logit_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_logit_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_1_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_3_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_5_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_multigammaln_mvlgamma_p_5_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtr_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtr_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtr_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtr_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtr_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtri_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_ndtri_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_softmax_with_dtype_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_softmax_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_xlog1py_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_xlog1py_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_zeta_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_special_zeta_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_split_with_sizes_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sqrt_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sqrt_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sqrt_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_square_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_square_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_square_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_multiple_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_multiple_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_multiple_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_multiple_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_squeeze_multiple_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_stack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_stack_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_stack_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_std_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_std_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_std_mean_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_stft_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sub_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sub_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sub_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sum_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sum_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sum_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sum_to_size_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_sum_to_size_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_t_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_t_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_t_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_t_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_t_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_t_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_take_along_dim_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tan_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tan_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tan_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tan_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tanh_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tanh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tanh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tensor_split_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tensor_split_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tensor_split_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_to_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_to_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_to_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_to_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_trace_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_trace_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_trace_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_trace_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_transpose_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_transpose_copy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_transpose_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_transpose_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_transpose_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_transpose_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tril_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tril_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tril_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_tril_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_triu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_triu_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_triu_indices_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_true_divide_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_true_divide_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_trunc_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_trunc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unbind_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unbind_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unbind_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unbind_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unbind_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unflatten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unflatten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unflatten_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unfold_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unfold_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unfold_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unfold_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_unsqueeze_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_var_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_var_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_var_mean_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_var_mean_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_var_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_view_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_view_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_view_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_view_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_view_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_vsplit_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_vsplit_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_vsplit_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_vstack_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_vstack_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_vstack_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_where_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_where_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_where_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_where_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_xlogy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_xlogy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_zeros_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_zeros_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_zeros_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_zeros_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_meta__refs_zeros_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_T_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_T_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_T_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_T_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_bfloat16_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_bfloat16_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_bfloat16_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_bool_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_bool_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_bool_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_bool_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_byte_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_byte_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_byte_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_byte_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_cdouble_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_cdouble_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_cdouble_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_cdouble_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_cfloat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_cfloat_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_chalf_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_chalf_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_chalf_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_chalf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_chalf_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_char_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_char_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_char_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_char_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_complex_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_double_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_float_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_float_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_float_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_float_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_half_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_int_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_int_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_int_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_long_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_long_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_long_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_long_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_long_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_long_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_short_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_short_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs__conversions_short_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_abs_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_abs_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_acos_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_acos_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_acos_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_acos_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_acosh_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_acosh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_add_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_add_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_add_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_add_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addcmul_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addcmul_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addcmul_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addcmul_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addr_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addr_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addr_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_addr_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_alias_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_alias_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_alias_copy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_alias_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_all_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_all_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_allclose_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_amax_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_amax_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_amax_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_amax_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_amin_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_any_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_arange_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_arange_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_partial_views_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_partial_views_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_partial_views_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_scatter_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_scatter_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_scatter_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_as_strided_scatter_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_asin_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_asin_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_asin_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_asinh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_asinh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atan2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atan2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atan2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atan_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atan_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atan_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atanh_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_1d_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_1d_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_1d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_2d_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_2d_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_3d_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_3d_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_3d_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_3d_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_atleast_3d_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_and_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_left_shift_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_not_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_not_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_not_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_or_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_or_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_right_shift_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_right_shift_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_xor_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_xor_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bitwise_xor_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_block_diag_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_block_diag_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_block_diag_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_shapes_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_tensors_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_tensors_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_tensors_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_tensors_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_tensors_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_to_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_to_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_broadcast_to_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_bucketize_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cat_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cat_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cat_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ceil_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ceil_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_chunk_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_chunk_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clamp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clamp_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clamp_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clamp_min_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clone_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clone_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clone_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clone_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clone_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_clone_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_column_stack_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_column_stack_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_column_stack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_conj_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_conj_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_conj_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_conj_physical_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_conj_physical_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_conj_physical_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_conj_physical_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_constant_pad_nd_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_constant_pad_nd_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_contiguous_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_contiguous_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_contiguous_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_contiguous_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_copysign_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_copysign_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_copysign_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_copysign_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_copysign_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cos_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cos_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cos_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cos_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cos_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cos_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cosh_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cosh_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cosh_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_count_nonzero_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_count_nonzero_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cumprod_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cumprod_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cumprod_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cumprod_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cumsum_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cumsum_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_cumsum_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_deg2rad_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_deg2rad_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diag_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diag_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diag_embed_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diag_embed_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_scatter_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_scatter_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_scatter_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_diagonal_scatter_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_digamma_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_floor_rounding_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_floor_rounding_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_floor_rounding_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_no_rounding_mode_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_no_rounding_mode_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_no_rounding_mode_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_no_rounding_mode_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_trunc_rounding_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dot_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dsplit_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dsplit_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dsplit_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dstack_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dstack_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dstack_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dstack_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dstack_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_dstack_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_like_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_like_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_like_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_like_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_strided_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_empty_strided_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eq_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eq_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eq_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eq_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_equal_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_equal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_equal_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_erf_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_erf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_erfc_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_erfc_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_erfc_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_erfinv_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_exp2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_exp2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_exp2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_exp_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_exp_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_exp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_as_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_as_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expand_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expm1_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expm1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expm1_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_expm1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_exponential_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eye_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eye_cuda_float8_e4m3fn, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eye_cuda_float8_e4m3fnuz, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_eye_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fft2_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fft2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fft_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fft_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fftshift_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fftshift_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fftshift_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fftshift_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fftshift_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fftshift_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_fftshift_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfft_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfftn_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfftn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfftn_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_hfftn_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft2_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft2_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifft_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifftn_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifftn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifftshift_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ifftshift_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ihfft2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ihfft2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ihfftn_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ihfftn_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ihfftn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_ihfftn_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft2_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft2_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft2_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfft_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfftn_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_irfftn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfft2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfft2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfft_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfftn_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfftn_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfftn_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fft_rfftn_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fill_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flatten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flatten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flatten_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flip_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fliplr_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fliplr_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fliplr_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flipud_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flipud_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flipud_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flipud_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_flipud_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_float_power_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_float_power_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_float_power_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_float_power_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_float_power_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_float_power_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_floor_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_floor_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_floor_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_floor_divide_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_floor_divide_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fmax_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fmax_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fmax_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fmin_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fmin_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fmod_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_fmod_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_frac_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_frac_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_frac_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ge_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ge_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ge_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ge_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ge_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_geometric_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_geometric_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_geometric_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_gt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_heaviside_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_heaviside_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_heaviside_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hsplit_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hsplit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hsplit_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hsplit_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hsplit_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hstack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hstack_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hstack_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hypot_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_hypot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_i0_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_i0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_i0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_i0_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_igamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_add_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_add_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_add_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_add_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_add_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_copy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_fill_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_fill_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_fill_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_select_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_select_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_index_select_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isclose_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isclose_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isfinite_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isfinite_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isinf_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isinf_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isnan_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isnan_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isnan_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isneginf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isposinf_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isposinf_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isreal_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_isreal_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_item_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_item_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_lcm_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_lerp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_lgamma_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_lgamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_cross_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_cross_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_cross_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_diagonal_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_diagonal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_diagonal_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_diagonal_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_diagonal_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_norm_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_norm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_svdvals_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_vecdot_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_vecdot_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_vector_norm_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linalg_vector_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_tensor_overload_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_tensor_overload_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_tensor_overload_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_linspace_tensor_overload_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log10_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log1p_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log1p_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log1p_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log1p_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log2_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log2_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log2_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log2_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log2_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log_softmax_with_dtype_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log_softmax_with_dtype_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_log_softmax_with_dtype_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logaddexp2_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_and_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_and_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_and_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_not_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_not_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_not_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_not_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_not_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_or_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_or_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_or_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_or_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logical_xor_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logspace_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logspace_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logspace_tensor_overload_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logsumexp_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logsumexp_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logsumexp_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logsumexp_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_logsumexp_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_lt_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_masked_fill_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_masked_fill_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_masked_fill_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_masked_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_masked_fill_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_maximum_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_maximum_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_maximum_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_mean_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_mean_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_list_of_tensors_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_list_of_tensors_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_list_of_tensors_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_list_of_tensors_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_list_of_tensors_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_variadic_tensors_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_variadic_tensors_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_variadic_tensors_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_meshgrid_variadic_tensors_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_minimum_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_movedim_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_movedim_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nan_to_num_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_narrow_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_native_layer_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_native_layer_norm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ne_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ne_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ne_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ne_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_neg_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_neg_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_neg_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_neg_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_neg_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_empty_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_empty_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_empty_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_empty_strided_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_empty_strided_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_empty_strided_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_full_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_full_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_full_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_ones_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_ones_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_ones_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_ones_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_zeros_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_zeros_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_new_zeros_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nextafter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nextafter_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_alpha_dropout_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_celu_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_channel_shuffle_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_gelu_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_gelu_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_group_norm_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_hardshrink_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_hardshrink_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_hardtanh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_hardtanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_hardtanh_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_hinge_embedding_loss_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_huber_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_l1_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_layer_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_layer_norm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_log_softmax_with_dtype_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_log_softmax_with_dtype_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_log_softmax_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_log_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_log_softmax_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_margin_ranking_loss_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_margin_ranking_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_margin_ranking_loss_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_margin_ranking_loss_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_mish_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_mish_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_nll_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_pixel_shuffle_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_pixel_unshuffle_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_pixel_unshuffle_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_poisson_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_poisson_nll_loss_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_relu6_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_relu_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_selu_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_smooth_l1_loss_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_smooth_l1_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softmax_with_dtype_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softmax_with_dtype_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softmax_with_dtype_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softmax_with_dtype_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softmax_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softmin_with_dtype_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softmin_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softplus_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softplus_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softplus_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_softshrink_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_tanhshrink_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_tanhshrink_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_tanhshrink_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_threshold_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_threshold_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_triplet_margin_loss_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_triplet_margin_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_triplet_margin_loss_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_nn_functional_triplet_margin_loss_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_norm_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_normal__in_place_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_normal__in_place_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_normal_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_normal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_normal_number_mean_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ones_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ones_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ones_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ones_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ones_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ones_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_copy_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_permute_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_positive_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_positive_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_pow_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_prod_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_prod_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_prod_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rad2deg_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rad2deg_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rad2deg_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rad2deg_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rad2deg_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_randn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ravel_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_ravel_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_real_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_real_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_real_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_real_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reciprocal_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reciprocal_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reciprocal_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reciprocal_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_remainder_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_remainder_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_remainder_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_renorm_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_repeat_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_repeat_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_repeat_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reshape_as_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reshape_as_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reshape_as_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reshape_as_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reshape_as_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reshape_as_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_reshape_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_roll_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_roll_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_roll_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rot90_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rot90_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rot90_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rot90_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_round_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rsqrt_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rsub_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_rsub_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_select_scatter_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_select_scatter_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_select_scatter_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_select_scatter_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sgn_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_signbit_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_signbit_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sin_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sin_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sinc_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sinc_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sinh_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sinh_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sinh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sinh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sinh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_softmax_with_dtype_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_softmax_with_dtype_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_softmax_with_dtype_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_bessel_j0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_bessel_j0_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_bessel_j0_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_bessel_j0_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_bessel_j1_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_bessel_j1_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_bessel_j1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_entr_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_erfcx_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i0e_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1e_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1e_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_i1e_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_log_ndtr_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_log_ndtr_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_log_ndtr_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_log_softmax_with_dtype_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_log_softmax_with_dtype_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_log_softmax_with_dtype_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_log_softmax_with_dtype_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_logit_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_logit_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_logit_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_1_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_1_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_1_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_3_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_3_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_3_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_5_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_multigammaln_mvlgamma_p_5_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_ndtr_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_ndtr_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_ndtr_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_ndtri_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_softmax_with_dtype_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_softmax_with_dtype_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_spherical_bessel_j0_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_spherical_bessel_j0_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_xlog1py_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_xlog1py_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_zeta_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_special_zeta_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_split_with_sizes_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_split_with_sizes_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sqrt_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sqrt_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sqrt_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_square_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_square_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_square_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_squeeze_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_squeeze_copy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_squeeze_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_squeeze_multiple_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_squeeze_multiple_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_stack_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_stack_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_stack_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_std_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_std_mean_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sub_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sub_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sub_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sub_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sum_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sum_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sum_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sum_to_size_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_sum_to_size_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_t_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_t_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_t_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_t_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_t_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_t_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_take_along_dim_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_take_along_dim_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_take_along_dim_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tan_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tanh_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tanh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tanh_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tanh_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tanh_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tensor_split_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tensor_split_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_to_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_to_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trace_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trace_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trace_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trace_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_copy_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_copy_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_copy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_transpose_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tril_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_tril_indices_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_triu_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_true_divide_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_true_divide_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trunc_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trunc_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_trunc_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unbind_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unflatten_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unflatten_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unflatten_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unflatten_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unflatten_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unfold_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unfold_copy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unfold_copy_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unfold_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unfold_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unfold_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_copy_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_copy_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_unsqueeze_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_var_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_var_mean_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_var_mean_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_var_mean_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vdot_cuda_bfloat16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vdot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_view_as_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_view_copy_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_view_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_view_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_view_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_view_cuda_int64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_view_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vsplit_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vsplit_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vsplit_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vsplit_cuda_int8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vstack_cuda_float16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_vstack_cuda_int16, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_where_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_where_cuda_complex32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_where_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_where_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_xlogy_cuda_bool, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_xlogy_cuda_float64, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_xlogy_cuda_int32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_xlogy_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_zeros_cuda_complex128, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_zeros_cuda_float32, test/test_ops.py::TestCommonCUDA::test_python_ref_torch_fallback__refs_zeros_cuda_uint8, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_T_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager___radd___cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager___rdiv___cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager___rmatmul___cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager___rsub___cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager__batch_norm_with_update_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_abs_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_acos_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_addcdiv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_addcmul_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_addmm_decomposed_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_addr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_alias_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_all_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_allclose_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_atan2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_atan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_bfloat16_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_bmm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_bmm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_bool_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_cat_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_cdouble_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_chalf_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_char_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_cholesky_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_cholesky_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_chunk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_column_stack_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_combinations_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_conj_physical_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_copysign_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_diagflat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_diagonal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_diff_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_digamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_dist_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_double_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_double_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_dstack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_empty_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_eq_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_equal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_erfinv_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_expand_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_expand_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_eye_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_fft2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_fft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_fft_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_fftn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_fftshift_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_hfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_hfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_hfftn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_ifftshift_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_ihfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_ihfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_irfft2_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_irfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_rfft_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fft_rfftn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_fliplr_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_float_power_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_frexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_full_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_geometric_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_geqrf_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_grid_sampler_2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_half_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_hash_tensor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_hsplit_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_hstack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_hypot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_i0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_igamma_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_igammac_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_imag_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_index_fill_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_index_reduce_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_int_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_isclose_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_isfinite_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_isnan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_isnan_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_isneginf_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_isreal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_item_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_jiterator_binary_return_by_ref_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_kron_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_ldexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_lerp_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_cholesky_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_cholesky_ex_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_cross_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_householder_product_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_inv_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_ldl_factor_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_ldl_solve_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_lu_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_lu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_lu_factor_ex_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_lu_solve_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_matrix_power_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_multi_dot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_norm_subgradients_at_zero_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_pinv_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_pinv_hermitian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_qr_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_solve_ex_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_svdvals_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_svdvals_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_tensorsolve_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_linalg_vander_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_log1p_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_log2_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_logaddexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_logical_not_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_logical_or_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_logical_xor_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_lt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_lu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_lu_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_fill_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_log_softmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_logsumexp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_normalize_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_prod_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_std_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_masked_var_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_matrix_exp_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_max_pool2d_with_indices_backward_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_max_reduction_no_dim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_median_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_meshgrid_list_of_tensors_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_meshgrid_variadic_tensors_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_mm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_mode_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_movedim_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_movedim_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_mul_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_multinomial_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nan_to_num_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nanmean_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_narrow_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_narrow_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_narrow_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_native_layer_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_new_empty_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_new_empty_strided_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_new_full_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_new_zeros_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_avg_pool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_channel_shuffle_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_channel_shuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_cosine_embedding_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_ctc_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_feature_alpha_dropout_without_train_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_group_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_hardswish_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_hinge_embedding_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_instance_norm_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_interpolate_bilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_margin_ranking_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_max_unpool1d_grad_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_max_unpool2d_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_mse_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_multi_head_attention_forward_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_nll_loss_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_pad_reflect_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_pad_replicate_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_pad_replicate_negative_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_pairwise_distance_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_pixel_shuffle_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_pixel_unshuffle_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_rms_norm_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_rrelu_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_softmin_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_softplus_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_triplet_margin_loss_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nn_functional_upsample_bilinear_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_nonzero_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_norm_fro_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_norm_nuc_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_normal_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_normal_in_place_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_ones_like_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_permute_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_polygamma_polygamma_n_4_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_prod_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_put_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_rand_like_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_randn_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_ravel_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_reciprocal_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_remainder_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_repeat_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_repeat_interleave_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_repeat_interleave_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_reshape_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_reshape_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_resize__cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_resize_as__cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_resolve_conj_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_roll_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_round_decimals_0_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_scatter_add_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_scatter_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_scatter_reduce_prod_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_sgn_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_signal_windows_blackman_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_signal_windows_exponential_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_signal_windows_gaussian_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_signal_windows_hamming_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_signbit_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_sin_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_softmax_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_softmax_with_dtype_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_sparse_mm_reduce_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_special_bessel_j1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_special_hermite_polynomial_he_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_special_i1e_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_special_legendre_polynomial_p_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_special_modified_bessel_i1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_special_modified_bessel_k1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_special_scaled_modified_bessel_k1_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_split_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_split_list_args_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_split_with_sizes_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_sqrt_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_sqrt_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_squeeze_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_squeeze_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_squeeze_multiple_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_stack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_std_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_std_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_std_unbiased_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_std_unbiased_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_sub_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_sub_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_svd_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_svd_lowrank_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_t_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_tan_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_tanh_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_tensor_split_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_tensordot_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_to_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_to_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_to_sparse_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_topk_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_trace_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_trapz_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_triangular_solve_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_tril_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_triu_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_true_divide_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_trunc_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_unflatten_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_unfold_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_uniform_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_unsqueeze_copy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_unsqueeze_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_var_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_var_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_var_mean_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_vdot_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_view_as_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_view_copy_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_view_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_vstack_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_where_cuda_complex64, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_xlogy_cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_zero__cuda_float32, test/test_ops.py::TestCommonCUDA::test_variant_consistency_eager_zeros_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_H_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_T_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward___radd___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward___rmatmul___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward___rmul___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward___rsub___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward__softmax_backward_data_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward__unsafe_masked_index_put_accumulate_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward__upsample_bilinear2d_aa_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_acos_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_acosh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_addcdiv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_addmm_decomposed_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_alias_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_angle_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_as_strided_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_as_strided_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_as_strided_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_atan_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_atanh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_atleast_1d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_bmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_broadcast_tensors_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_broadcast_to_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_cartesian_prod_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_cat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_cfloat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_cholesky_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_chunk_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_column_stack_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_conj_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_conj_physical_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_contiguous_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_diagonal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_diagonal_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_dot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_erfc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_exp2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_fft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_fftn_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_hfft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_ifft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_ifftshift_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_ihfft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_ihfft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_fft_rfft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_flipud_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_float_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_gather_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_hstack_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_hypot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_index_reduce_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_index_select_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_cond_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_eig_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_eigh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_householder_product_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_lu_factor_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_pinv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_qr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_solve_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_svd_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_linalg_vecdot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_log1p_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_log2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_logaddexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_logit_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_logsumexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_mH_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_masked_logsumexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_masked_median_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_masked_normalize_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_masked_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_masked_softmin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_min_reduction_no_dim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_movedim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_native_batch_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_native_dropout_backward_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_batch_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_binary_cross_entropy_with_logits_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_channel_shuffle_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_conv1d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_conv2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_conv_transpose1d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_cosine_similarity_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_ctc_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_feature_alpha_dropout_without_train_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_hardtanh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_huber_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_instance_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_interpolate_area_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_interpolate_bilinear_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_interpolate_nearest-exact_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_l1_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_linear_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_margin_ranking_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_max_unpool2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_max_unpool3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_max_unpool3d_grad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_mish_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_pad_replicate_negative_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_prelu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_relu6_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_relu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_scaled_dot_product_attention_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_selu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_silu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_softshrink_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_threshold_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_nn_functional_upsample_bilinear_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_ormqr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_polar_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_polygamma_polygamma_n_4_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_quantile_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_rad2deg_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_repeat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_reshape_as_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_round_decimals_0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_round_decimals_neg_3_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_scatter_reduce_amin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_scatter_reduce_sum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_sin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_sinc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_special_i0e_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_special_i1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_special_ndtr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_special_xlog1py_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_split_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_squeeze_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_squeeze_multiple_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_sub_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_sum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_t_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_take_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_tensor_split_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_topk_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_torch_ops_aten__safe_softmax_default_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_unbind_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_unflatten_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_unsafe_split_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_var_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_var_mean_unbiased_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_backward_view_as_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input___rmul___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input___rsub___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input__softmax_backward_data_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_add_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_addmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_all_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_argmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_as_strided_partial_views_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_atan2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_bernoulli_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_byte_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_cartesian_prod_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_cdouble_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_char_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_chunk_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_clamp_min_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_combinations_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_complex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_contiguous_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_corrcoef_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_cosh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_deg2rad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_diagflat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_dist_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_dot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_dsplit_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_einsum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_empty_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_empty_strided_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_eq_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_equal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_expand_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_fft_ifft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_fft_ihfft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_fft_irfft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_fft_rfft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_floor_divide_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_fmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_hstack_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_hypot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_igammac_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_inner_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_isfinite_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_isin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_isposinf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_isreal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_jiterator_4inputs_with_extra_args_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_jiterator_binary_return_by_ref_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_lgamma_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_eigvals_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_eigvalsh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_lstsq_grad_oriented_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_matrix_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_pinv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_pinv_singular_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_solve_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_svd_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_tensorinv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linalg_vander_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_linspace_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_log1p_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_logical_xor_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_logspace_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_mT_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_masked_amin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_masked_argmin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_masked_log_softmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_masked_logaddexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_masked_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_masked_median_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_matrix_exp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_max_reduction_with_dim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_maximum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_min_reduction_with_dim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_mode_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nanmedian_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_native_dropout_backward_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_ne_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_new_empty_strided_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_new_full_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_new_ones_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_new_zeros_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_alpha_dropout_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_avg_pool2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_binary_cross_entropy_with_logits_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_cosine_embedding_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_dropout2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_dropout_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_embedding_bag_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_hardtanh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_instance_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_interpolate_area_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_interpolate_nearest-exact_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_l1_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_layer_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_logsigmoid_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_max_unpool3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_normalize_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_relu6_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_scaled_dot_product_attention_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_nn_functional_softplus_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_norm_inf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_norm_nuc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_outer_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_permute_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_pinverse_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_polygamma_polygamma_n_2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_randint_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_ravel_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_real_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_reciprocal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_remainder_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_roll_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_round_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_round_decimals_0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_round_decimals_neg_3_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_rsub_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_scatter_reduce_sum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_sign_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_signal_windows_exponential_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_signal_windows_general_cosine_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_signbit_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_slice_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_bessel_y0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_bessel_y1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_chebyshev_polynomial_u_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_hermite_polynomial_he_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_i1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_laguerre_polynomial_l_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_log_ndtr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_modified_bessel_i0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_modified_bessel_i1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_modified_bessel_k1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_ndtr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_scaled_modified_bessel_k0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_special_zeta_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_split_with_sizes_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_squeeze_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_std_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_std_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_std_unbiased_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_sum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_t_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_tanh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_tile_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_topk_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_transpose_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_unbind_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_unflatten_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_unfold_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_unfold_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_uniform_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_view_as_complex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_cow_input_zero__cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad___rdiv___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad___rmod___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad___rmul___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad__softmax_backward_data_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad__unsafe_masked_index_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad__upsample_bilinear2d_aa_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_abs_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_addbmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_addmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_allclose_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_amin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_any_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_argmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_as_strided_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_as_strided_partial_views_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_as_strided_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_atan2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_atanh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_bernoulli_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_bmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_cartesian_prod_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_cfloat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_conj_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_cross_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_cumsum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_deg2rad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_diag_embed_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_diff_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_digamma_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_div_floor_rounding_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_double_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_empty_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_empty_permuted_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_expand_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_fft_fft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_fft_ifftn_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_fft_rfft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_fft_rfft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_float_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_float_power_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_floor_divide_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_fmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_frac_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_full_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_full_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_gt_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_index_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_index_put_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_isin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_isnan_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_isposinf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_jiterator_unary_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_lgamma_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_eigvalsh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_householder_product_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_inv_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_ldl_factor_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_ldl_factor_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_ldl_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_lstsq_grad_oriented_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_lu_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_matrix_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linalg_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_linspace_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_log_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_log_normal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_logaddexp2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_logcumsumexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_logdet_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_logical_not_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_masked_argmin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_masked_cumprod_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_masked_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_masked_normalize_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_matmul_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_max_reduction_no_dim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_max_reduction_with_dim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_min_binary_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_min_reduction_no_dim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_mul_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_mv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nanmean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nanmedian_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_narrow_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_native_dropout_backward_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_new_empty_strided_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_new_ones_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_adaptive_max_pool3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_bilinear_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_binary_cross_entropy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_conv_transpose2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_cross_entropy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_ctc_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_dropout2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_dropout3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_dropout_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_embedding_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_fractional_max_pool3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_glu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_hardswish_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_interpolate_area_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_kl_div_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_logsigmoid_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_margin_ranking_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_max_unpool2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_max_unpool2d_grad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_mish_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_multi_head_attention_forward_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_multi_margin_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_nll_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_pad_constant_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_pad_reflect_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_poisson_nll_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_relu6_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_scaled_dot_product_attention_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_selu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_silu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_softmin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_threshold_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_triplet_margin_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_unfold_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nn_functional_upsample_nearest_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_nonzero_static_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_norm_fro_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_normal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_ormqr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_permute_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_polygamma_polygamma_n_1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_polygamma_polygamma_n_3_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_randn_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_randn_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_reciprocal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_reshape_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_resize__cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_resize_as__cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_roll_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_scatter_add_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_scatter_reduce_sum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_short_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_sigmoid_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_sign_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_signal_windows_general_hamming_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_sinc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_softmax_with_dtype_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_bessel_y1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_hermite_polynomial_h_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_hermite_polynomial_he_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_i1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_log_ndtr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_scaled_modified_bessel_k0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_spherical_bessel_j0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_special_xlog1py_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_split_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_split_with_sizes_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_sqrt_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_squeeze_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_stft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_take_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_tan_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_to_sparse_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_transpose_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_triangular_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_unbind_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_unfold_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_forward_ad_var_mean_unbiased_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_T_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator___rmul___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator___rsub___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator__segment_reduce_lengths_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_abs_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_acos_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_addmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_addmm_decomposed_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_alias_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_allclose_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_angle_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_argmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_argwhere_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_as_strided_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_as_strided_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_asin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_bfloat16_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_bmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_cat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_char_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_cholesky_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_chunk_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_conj_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_copysign_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_count_nonzero_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_deg2rad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_diagflat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_diagonal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_dot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_einsum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_empty_strided_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_expand_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_fft_hfft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_fft_ifftn_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_fft_irfft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_fft_rfft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_fft_rfftn_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_flip_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_full_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_gather_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_geqrf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_gt_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_half_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_histc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_i0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_index_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_index_put_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_isneginf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_le_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_inv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_inv_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_ldl_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_matrix_rank_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_pinv_singular_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_solve_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_svdvals_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_linalg_vander_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_logaddexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_logical_or_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_logspace_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_logsumexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_long_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_lu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_lu_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_lu_unpack_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_masked_logsumexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_masked_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_masked_select_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_masked_softmin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_masked_std_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_matmul_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_matrix_exp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_max_pool2d_with_indices_backward_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_min_reduction_with_dim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_mm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_movedim_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_msort_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_mv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nanmedian_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nanquantile_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_narrow_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_native_layer_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_ne_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nextafter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_adaptive_avg_pool2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_conv_transpose1d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_dropout3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_embedding_bag_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_embedding_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_glu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_hinge_embedding_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_huber_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_instance_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_interpolate_area_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_kl_div_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_max_pool1d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_max_unpool1d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_mish_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_multi_margin_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_pad_reflect_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_pad_replicate_negative_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_pixel_unshuffle_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_prelu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_relu6_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_selu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_silu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_softmin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_softmin_with_dtype_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_softplus_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_softshrink_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_triplet_margin_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_upsample_bilinear_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_nn_functional_upsample_nearest_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_normal_number_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_polar_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_polygamma_polygamma_n_0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_pow_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_prod_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_rand_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_repeat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_resize__cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_resize_as__cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_roll_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_rot90_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_round_decimals_3_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_rsqrt_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_short_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_signal_windows_general_hamming_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_sinc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_sparse_mm_reduce_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_special_hermite_polynomial_he_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_special_i1e_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_special_legendre_polynomial_p_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_special_xlog1py_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_squeeze_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_stack_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_stft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_sub_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_sum_to_size_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_take_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_tensor_split_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_tensordot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_triangular_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_unbind_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_unflatten_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_unfold_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_unique_consecutive_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_unique_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_unsqueeze_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_var_mean_unbiased_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_vdot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_view_as_complex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_operator_zeros_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay___getitem___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay___rmod___cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay__native_batch_norm_legit_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_abs_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_acos_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_add_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_addcdiv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_addr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_all_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_aminmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_argsort_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_argwhere_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_as_strided_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_atan2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_baddbmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_broadcast_to_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_bucketize_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_byte_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_cfloat_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_chalf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_cholesky_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_clamp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_clone_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_combinations_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_cumulative_trapezoid_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_deg2rad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_diagonal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_diagonal_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_digamma_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_dist_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_div_trunc_rounding_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_dot_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_erfc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_erfinv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_exp2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_fft_fft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_fft_fftshift_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_fft_ifft2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_fft_ifft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_flip_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_float_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_frexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_full_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_full_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_gather_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_geometric_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_hash_tensor_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_i0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_index_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_index_put_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_index_reduce_amin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_isclose_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_isfinite_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_isin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_isinf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_diagonal_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_eig_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_eigh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_eigvals_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_ldl_factor_ex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_pinv_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_pinv_singular_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_qr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_tensorsolve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_linalg_vector_norm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_log_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_logaddexp2_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_logaddexp_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_logdet_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_logical_xor_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_lu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_mH_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_mT_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_masked_cumprod_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_masked_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_masked_select_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_masked_std_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_masked_var_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_meshgrid_list_of_tensors_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_minimum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_msort_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nansum_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_narrow_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nextafter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_adaptive_max_pool2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_alpha_dropout_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_binary_cross_entropy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_conv2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_cross_entropy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_dropout2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_elu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_fractional_max_pool2d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_hardtanh_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_max_pool1d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_max_pool3d_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_max_unpool1d_grad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_max_unpool3d_grad_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_normalize_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_pad_constant_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_rrelu_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nn_functional_softmin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_nonzero_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_norm_inf_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_norm_nuc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_normal_number_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_ones_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_permute_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_polygamma_polygamma_n_1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_randn_like_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_ravel_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_real_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_resize__cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_resolve_conj_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_resolve_neg_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_rot90_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_round_decimals_3_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_rsub_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_sigmoid_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_sin_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_sinc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_slice_scatter_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_softmax_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_sparse_sampled_addmm_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_special_bessel_j0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_special_bessel_j1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_special_bessel_y0_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_special_entr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_special_legendre_polynomial_p_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_special_modified_bessel_i1_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_special_ndtr_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_split_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_split_with_sizes_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_squeeze_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_squeeze_multiple_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_std_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_std_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_stft_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_t_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_take_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_to_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_topk_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_torch_ops_aten__efficient_attention_forward_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_torch_ops_aten__safe_softmax_default_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_triangular_solve_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_tril_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_true_divide_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_trunc_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_unbind_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_unflatten_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_unfold_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_unfold_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_unsqueeze_copy_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_unsqueeze_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_var_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_var_mean_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_view_as_complex_cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_zero__cuda_float32, test/test_ops.py::TestCompositeComplianceCUDA::test_view_replay_zeros_like_cuda_float32, test/test_ops.py::TestMathBitsCUDA::test_conj_view_H_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view___rsub___cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs__conversions_bfloat16_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs__conversions_cdouble_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs__conversions_chalf_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs__conversions_char_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs__conversions_double_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs__conversions_half_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs__conversions_long_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_allclose_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_atleast_2d_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_block_diag_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_chunk_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_constant_pad_nd_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_cos_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_diag_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_diagonal_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_fft_fft2_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_fft_fft_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_fft_fftn_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_fft_hfft_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_fft_ifft_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_float_power_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_hsplit_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_imag_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_index_add_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_isreal_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_linalg_matrix_norm_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_linalg_svdvals_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_linalg_vector_norm_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_log10_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_log1p_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_log_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_masked_fill_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_neg_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_new_empty_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_new_zeros_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_nn_functional_l1_loss_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_nn_functional_log_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_nn_functional_pairwise_distance_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_nn_functional_pixel_shuffle_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_nn_functional_softmax_with_dtype_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_nn_functional_softmin_with_dtype_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_nn_functional_triplet_margin_loss_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_positive_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_ravel_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_repeat_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_roll_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_rot90_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_sgn_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_sin_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_sinh_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_stft_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_sub_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_t_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_unbind_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_unfold_copy_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_unfold_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view__refs_vsplit_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_abs_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_acos_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_addcdiv_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_allclose_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_any_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_asin_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_atanh_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_bfloat16_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_bool_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_broadcast_tensors_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_byte_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_cfloat_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_chalf_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_cholesky_solve_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_chunk_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_constant_pad_nd_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_cumsum_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_div_no_rounding_mode_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_einsum_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_empty_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_empty_like_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_expm1_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_fft_fftshift_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_fft_ifftn_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_fft_irfft2_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_fft_irfftn_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_flatten_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_float_power_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_half_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_hsplit_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_imag_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_isinf_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_isnan_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_isreal_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_jiterator_unary_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_cholesky_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_cond_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_ldl_factor_ex_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_lstsq_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_lstsq_grad_oriented_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_lu_solve_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_matrix_power_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_norm_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_norm_subgradients_at_zero_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_solve_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_svd_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_tensorinv_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_tensorsolve_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_vander_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_linalg_vecdot_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_log2_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_logdet_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_logical_and_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_logical_not_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_logical_xor_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_long_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_lu_solve_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_masked_normalize_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_mm_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_mul_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_mv_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_nanmean_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_new_empty_strided_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_nn_functional_conv_transpose1d_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_nn_functional_triplet_margin_loss_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_nn_functional_triplet_margin_with_distance_loss_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_nonzero_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_ones_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_put_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_rand_like_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_randn_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_renorm_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_resize_as__cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_roll_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_sparse_sampled_addmm_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_sqrt_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_squeeze_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_std_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_std_mean_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_std_mean_unbiased_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_sub_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_sum_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_sum_to_size_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_svd_lowrank_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_take_along_dim_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_take_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_tan_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_trace_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_trapz_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_tril_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_triu_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_unfold_copy_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_unsafe_chunk_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_unsqueeze_copy_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_var_mean_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_var_mean_unbiased_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_view_as_real_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_conj_view_zeros_cuda_complex64, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_H_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_T_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view___getitem___cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view___radd___cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view___rsub___cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_T_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs__conversions_bfloat16_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs__conversions_byte_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs__conversions_cdouble_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs__conversions_chalf_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs__conversions_float_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_abs_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_acos_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_add_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_addcdiv_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_addr_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_as_strided_scatter_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_atleast_1d_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_block_diag_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_clone_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_column_stack_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_conj_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_count_nonzero_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_diag_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_diag_embed_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_diagonal_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_diagonal_scatter_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_eq_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_exp2_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_exp_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_expand_as_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_fft_ifft_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_fft_ifftn_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_fill_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_flatten_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_flip_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_hstack_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_index_fill_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_index_select_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_isclose_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_isinf_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_linalg_vector_norm_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_log10_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_log1p_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_log2_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_logspace_tensor_overload_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_ne_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_new_empty_strided_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_new_zeros_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_nn_functional_channel_shuffle_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_nn_functional_pairwise_distance_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_nn_functional_pixel_shuffle_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_nn_functional_triplet_margin_loss_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_permute_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_pow_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_real_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_renorm_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_reshape_as_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_roll_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_sgn_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_sin_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_split_with_sizes_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_std_mean_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_sum_to_size_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_t_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_transpose_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_unbind_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_unfold_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_unfold_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_unsqueeze_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_var_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_var_mean_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view__refs_view_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_abs_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_acosh_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_alias_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_as_strided_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_as_strided_partial_views_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_atanh_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_atleast_1d_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_baddbmm_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_bmm_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_conj_physical_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_cross_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_diagonal_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_diagonal_scatter_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_dist_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_dsplit_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_dstack_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_equal_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_expand_as_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_expand_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_expm1_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_fft_ifft_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_fft_ifftshift_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_flip_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_flipud_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_float_power_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_full_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_gradient_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_half_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_imag_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_index_put_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_inner_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_isinf_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_isreal_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_item_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_jiterator_binary_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_jiterator_binary_return_by_ref_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_jiterator_unary_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_cholesky_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_cholesky_ex_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_cond_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_det_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_diagonal_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_matrix_rank_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_matrix_rank_hermitian_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_norm_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_pinv_singular_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_slogdet_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_solve_ex_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_tensorinv_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_linalg_vander_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_log1p_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_logcumsumexp_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_logspace_tensor_overload_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_logsumexp_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_mT_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_masked_mean_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_masked_normalize_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nanmean_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_new_empty_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_new_empty_strided_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nn_functional_linear_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nn_functional_pad_replicate_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nn_functional_pairwise_distance_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nn_functional_pixel_shuffle_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nn_functional_tanhshrink_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nn_functional_triplet_margin_loss_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nn_functional_unfold_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_nonzero_static_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_normal_in_place_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_ones_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_permute_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_permute_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_prod_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_ravel_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_reciprocal_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_repeat_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_resize__cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_resolve_conj_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_resolve_neg_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_scatter_add_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_squeeze_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_squeeze_multiple_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_sum_to_size_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_svd_lowrank_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_t_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_t_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_tan_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_trace_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_transpose_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_unbind_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_unflatten_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_unsafe_split_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_var_mean_unbiased_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_view_as_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_view_copy_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_zeros_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_conj_view_zeros_like_cuda_complex128, test/test_ops.py::TestMathBitsCUDA::test_neg_view___getitem___cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view___rmod___cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__chunk_cat_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__native_batch_norm_legit_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs__conversions_bool_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs__conversions_chalf_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs__conversions_float_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_acosh_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_add_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_addcdiv_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_addcmul_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_amin_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_arange_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_as_strided_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_block_diag_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_chunk_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_clamp_min_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_clone_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_constant_pad_nd_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_deg2rad_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_diagonal_scatter_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_div_trunc_rounding_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_dot_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_eq_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_exp_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_exponential_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_fft_hfft_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_fft_ihfftn_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_fft_rfft2_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_fft_rfft_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_flipud_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_frexp_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_geometric_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_gt_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_heaviside_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_i0_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_index_fill_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_index_select_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_isclose_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_isreal_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_le_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_linalg_cross_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_linalg_matrix_norm_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_linalg_norm_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_log10_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_log_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_logaddexp2_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_masked_fill_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_meshgrid_list_of_tensors_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_meshgrid_variadic_tensors_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_movedim_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_mul_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_narrow_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_new_empty_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_gelu_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_group_norm_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_huber_loss_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_l1_loss_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_mish_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_mse_loss_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_pixel_unshuffle_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_softplus_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_nn_functional_triplet_margin_loss_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_ones_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_permute_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_pow_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_ravel_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_reciprocal_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_repeat_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_reshape_as_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_reshape_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_sigmoid_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_sinc_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_special_i0e_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_special_i1e_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_special_log_softmax_with_dtype_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_special_logit_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_special_softmax_with_dtype_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_take_along_dim_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_tensor_split_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_to_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_trace_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_tril_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_triu_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_unfold_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_unsqueeze_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_unsqueeze_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_var_mean_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__refs_vstack_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view__unsafe_masked_index_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_acosh_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_add_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_addmv_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_all_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_allclose_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_argmax_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_atan_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_atanh_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_atleast_2d_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_ceil_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_char_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_cholesky_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_clone_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_complex_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_corrcoef_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_cos_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_cov_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_cummin_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_cumsum_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_diag_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_diagonal_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_digamma_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_div_floor_rounding_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_div_no_rounding_mode_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_dstack_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_einsum_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_exp_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_expand_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_expand_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_fft_fft2_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_fft_fftshift_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_fft_hfft2_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_fft_ifft_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_fft_ifftshift_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_fft_ihfft2_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_flatten_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_flip_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_fliplr_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_float_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_full_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_ge_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_geometric_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_grid_sampler_2d_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_heaviside_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_hstack_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_hypot_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_i0_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_igamma_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_index_put_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_index_reduce_mean_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_jiterator_4inputs_with_extra_args_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_jiterator_binary_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_jiterator_binary_return_by_ref_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_ldexp_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_lerp_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_lgamma_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_linalg_eig_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_linalg_eigvalsh_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_linalg_ldl_solve_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_linalg_lu_solve_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_linalg_tensorinv_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_linalg_vander_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_linspace_tensor_overload_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_log1p_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_log_normal_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_logcumsumexp_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_logical_and_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_logical_not_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_lu_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_lu_solve_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_mH_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_masked_fill_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_masked_logsumexp_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_masked_normalize_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_masked_scatter_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_masked_softmin_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_matmul_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_max_reduction_with_dim_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_median_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_min_reduction_with_dim_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_minimum_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_movedim_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_mul_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_multinomial_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_mvlgamma_mvlgamma_p_1_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nanmean_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_native_layer_norm_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_ne_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_adaptive_avg_pool1d_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_alpha_dropout_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_binary_cross_entropy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_binary_cross_entropy_with_logits_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_conv1d_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_cosine_similarity_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_cross_entropy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_embedding_bag_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_embedding_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_feature_alpha_dropout_without_train_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_hardsigmoid_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_instance_norm_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_interpolate_area_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_interpolate_nearest_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_local_response_norm_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_max_pool2d_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_max_unpool1d_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_max_unpool1d_grad_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_mish_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_pad_reflect_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_pixel_shuffle_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_rrelu_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_scaled_dot_product_attention_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_soft_margin_loss_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_softplus_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_softshrink_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_tanhshrink_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_threshold_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_triplet_margin_loss_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nn_functional_upsample_bilinear_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_nonzero_static_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_norm_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_norm_nuc_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_normal_in_place_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_permute_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_permute_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_polar_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_polygamma_polygamma_n_3_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_positive_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_pow_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_qr_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_rad2deg_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_rand_like_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_round_decimals_0_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_select_scatter_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_sgn_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_short_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_signal_windows_general_cosine_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_signal_windows_hann_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_signal_windows_kaiser_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_signal_windows_nuttall_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_chebyshev_polynomial_v_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_erfcx_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_hermite_polynomial_he_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_i1e_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_modified_bessel_i0_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_modified_bessel_i1_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_modified_bessel_k0_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_modified_bessel_k1_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_ndtri_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_shifted_chebyshev_polynomial_u_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_shifted_chebyshev_polynomial_v_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_special_xlog1py_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_split_list_args_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_squeeze_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_stack_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_std_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_sub_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_sum_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_take_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_tensordot_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_trace_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_tril_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_true_divide_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_unique_consecutive_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_unsafe_split_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_unsqueeze_copy_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_unsqueeze_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_vstack_cuda_float64, test/test_ops.py::TestMathBitsCUDA::test_neg_view_zeros_like_cuda_float64, test/test_ops.py::TestFakeTensorCUDA::test_fake___radd___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake___rand___cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake___rmatmul___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake___rmul___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake___ror___cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake___rsub___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake__chunk_cat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake__native_batch_norm_legit_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake__unsafe_masked_index_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake__upsample_bilinear2d_aa_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_acos_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_addbmm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_alias_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_angle_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_as_strided_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_asinh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_atleast_2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast___getitem___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast___rdiv___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast__chunk_cat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast__native_batch_norm_legit_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast__segment_reduce_offsets_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast__unsafe_masked_index_put_accumulate_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_abs_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_addcdiv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_any_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_arange_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_atan_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_bincount_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_bitwise_not_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_bitwise_right_shift_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_bitwise_xor_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_block_diag_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_broadcast_shapes_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_ceil_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_cfloat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_char_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_clamp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_clamp_min_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_clone_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_combinations_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_copysign_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_cov_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_cross_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_cumprod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_diagonal_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_diff_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_double_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_dstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_empty_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_empty_like_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_empty_strided_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_erfc_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_erfinv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_expand_as_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_expand_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_exponential_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_fft_fft2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_fft_fftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_fft_ihfft2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_fft_ihfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_fft_irfftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_fft_rfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_float_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_float_power_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_frexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_grid_sampler_2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_gt_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_half_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_hstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_i0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_igammac_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_index_reduce_amin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_inner_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_isinf_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_isneginf_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_isreal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_jiterator_2inputs_2outputs_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_jiterator_4inputs_with_extra_args_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_jiterator_binary_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_jiterator_unary_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_ldexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_lgamma_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linalg_cholesky_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linalg_lu_factor_ex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linalg_lu_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linalg_matrix_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linalg_solve_ex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linalg_solve_triangular_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linspace_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_linspace_tensor_overload_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_log_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_logaddexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_logical_not_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_logical_or_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_logsumexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_long_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_lt_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_lu_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_mT_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_masked_amin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_masked_argmax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_masked_cumsum_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_masked_fill_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_masked_log_softmax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_masked_median_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_masked_softmax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_max_binary_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_meshgrid_list_of_tensors_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_mm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_mv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nan_to_num_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_narrow_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_neg_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_new_empty_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_new_full_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_adaptive_max_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_alpha_dropout_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_avg_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_conv_transpose3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_dropout3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_elu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_embedding_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_gelu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_glu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_group_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_hardswish_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_interpolate_bilinear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_layer_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_max_pool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_max_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_max_unpool3d_grad_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_multi_head_attention_forward_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_multilabel_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_nll_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_normalize_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_poisson_nll_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_scaled_dot_product_attention_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_selu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_silu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_soft_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_tanhshrink_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nn_functional_triplet_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_nonzero_static_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_ormqr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_permute_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_polygamma_polygamma_n_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_randint_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_real_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_repeat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_reshape_as_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_reshape_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_rot90_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_round_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_round_decimals_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_scatter_add_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_scatter_reduce_amin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_scatter_reduce_mean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_select_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_select_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_sgn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_signal_windows_blackman_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_signal_windows_cosine_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_signal_windows_general_cosine_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_signal_windows_general_hamming_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_signal_windows_hamming_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_signal_windows_hann_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_signal_windows_kaiser_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_sinh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_slice_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_sparse_mm_reduce_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_sparse_sampled_addmm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_airy_ai_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_bessel_j1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_bessel_y1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_chebyshev_polynomial_u_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_chebyshev_polynomial_w_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_erfcx_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_hermite_polynomial_h_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_i1e_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_modified_bessel_k0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_scaled_modified_bessel_k0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_shifted_chebyshev_polynomial_t_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_special_zeta_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_split_with_sizes_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_squeeze_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_squeeze_multiple_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_stack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_stft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_take_along_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_tan_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_tile_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_torch_ops_aten__efficient_attention_forward_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_torch_ops_aten__flash_attention_forward_cuda_float16, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_transpose_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_transpose_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_unsqueeze_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_var_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_view_as_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_autocast_zeros_like_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_bitwise_and_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_bitwise_left_shift_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_broadcast_to_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_bucketize_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_cfloat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_cholesky_inverse_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_chunk_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_clamp_max_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_clamp_min_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_conj_physical_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_cov_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_H_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp___getitem___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp__segment_reduce_lengths_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp__segment_reduce_offsets_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp__upsample_bilinear2d_aa_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_acosh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_addmv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_addr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_amin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_angle_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_baddbmm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_broadcast_tensors_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_cdist_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_cdouble_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_cholesky_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_cholesky_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_clone_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_conj_physical_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_constant_pad_nd_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_cummin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_deg2rad_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_diag_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_diagonal_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_div_floor_rounding_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_dstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_exp2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_exp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_expand_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_expand_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fft_fft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fft_fftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fft_hfft2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fft_hfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fft_ifft2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fft_ifftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fft_ifftshift_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_fill_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_flatten_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_frexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_half_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_hsplit_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_hstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_index_reduce_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_ldexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_lerp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_cholesky_ex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_cond_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_diagonal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_eigvalsh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_inv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_lstsq_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_lu_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_pinv_hermitian_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_svdvals_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_linalg_tensorinv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_log10_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_log_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_log_softmax_with_dtype_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_masked_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_masked_amin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_masked_sum_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_matmul_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_max_reduction_no_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_median_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_min_binary_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_min_reduction_no_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_min_reduction_with_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_mm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_mul_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_narrow_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_native_dropout_backward_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_adaptive_avg_pool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_adaptive_max_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_conv1d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_cross_entropy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_gelu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_hardswish_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_hardtanh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_hinge_embedding_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_interpolate_bicubic_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_interpolate_bilinear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_interpolate_linear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_interpolate_trilinear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_logsigmoid_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_max_pool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_max_unpool1d_grad_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_max_unpool3d_grad_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_multi_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_multilabel_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_multilabel_soft_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_pad_reflect_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_pdist_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_selu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_silu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_softmin_with_dtype_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_nn_functional_softplus_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_norm_fro_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_polar_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_polygamma_polygamma_n_1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_polygamma_polygamma_n_4_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_prod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_qr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_rad2deg_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_reciprocal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_renorm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_repeat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_roll_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_rot90_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_round_decimals_neg_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_rsqrt_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_rsub_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_scatter_reduce_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_scatter_reduce_prod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_sign_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_softmax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_softmax_with_dtype_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_special_erfcx_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_special_ndtri_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_split_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_split_list_args_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_std_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_std_mean_unbiased_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_sum_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_take_along_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_topk_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_transpose_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_transpose_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_trapezoid_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_tril_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_true_divide_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_unfold_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_var_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_var_mean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_var_unbiased_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_view_as_complex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_vstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_amp_zero__cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp___radd___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp___rdiv___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp___rsub___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp__segment_reduce_offsets_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp__softmax_backward_data_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp__unsafe_masked_index_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp__upsample_bilinear2d_aa_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_acos_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_acosh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_alias_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_as_strided_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_asinh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_atleast_2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_atleast_3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_bernoulli_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_bfloat16_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_cartesian_prod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_cdist_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_cdouble_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_clamp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_column_stack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_complex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_contiguous_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_copysign_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_cos_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_cross_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_cumprod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_diagflat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_diagonal_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_diagonal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_div_trunc_rounding_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_erf_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_expand_as_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_expm1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fft_fft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fft_ifftshift_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fft_irfftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fft_rfft2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fft_rfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fill_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_flipud_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_float_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_float_power_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_floor_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fmax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_fmod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_half_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_hstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_index_reduce_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_index_reduce_prod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_lerp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_lgamma_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_cholesky_ex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_det_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_eigh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_householder_product_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_lstsq_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_lu_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_matrix_power_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_norm_subgradients_at_zero_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_linalg_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_log2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_lu_unpack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_masked_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_masked_amin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_masked_logsumexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_masked_softmax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_masked_std_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_matmul_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_matrix_exp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_meshgrid_list_of_tensors_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_min_reduction_no_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_msort_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_mv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_mvlgamma_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nan_to_num_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_native_dropout_backward_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_neg_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_adaptive_avg_pool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_adaptive_max_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_alpha_dropout_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_conv1d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_conv2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_conv_transpose2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_cosine_embedding_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_dropout3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_embedding_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_feature_alpha_dropout_without_train_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_group_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_hardsigmoid_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_hardswish_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_interpolate_linear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_interpolate_nearest_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_interpolate_trilinear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_layer_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_local_response_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_logsigmoid_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_margin_ranking_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_max_unpool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_max_unpool3d_grad_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_normalize_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_pad_constant_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_pad_replicate_negative_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_pdist_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_relu6_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_relu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_smooth_l1_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_soft_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_unfold_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_upsample_bilinear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_nn_functional_upsample_nearest_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_norm_inf_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_ormqr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_pca_lowrank_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_pinverse_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_polygamma_polygamma_n_0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_polygamma_polygamma_n_1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_qr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_rad2deg_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_real_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_reciprocal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_renorm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_reshape_as_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_roll_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_round_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_round_decimals_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_select_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_sign_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_sinh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_sparse_mm_reduce_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_sparse_sampled_addmm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_special_i1e_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_special_ndtri_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_special_polygamma_special_polygamma_n_0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_special_xlog1py_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_squeeze_multiple_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_std_mean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_std_unbiased_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_svd_lowrank_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_t_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_tensor_split_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_to_sparse_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_topk_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_torch_ops_aten__safe_softmax_default_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_trunc_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_unsafe_chunk_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_unsafe_split_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_var_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_var_mean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_var_unbiased_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_view_as_complex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_view_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_crossref_backward_no_amp_vstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_cummax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_diag_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_diagflat_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_diagonal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_dot_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_empty_permuted_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_expand_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_fft_fft2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_fft_hfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_fft_irfft2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_fft_irfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_fft_rfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_fft_rfftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_flipud_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_fmod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_frac_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_geqrf_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_hash_tensor_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_hsplit_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_index_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_index_fill_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_index_put_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_index_reduce_amin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_index_reduce_mean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_index_select_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_inner_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_jiterator_binary_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_le_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_lerp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_diagonal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_eigvalsh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_lu_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_matrix_rank_hermitian_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_qr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_slogdet_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_solve_triangular_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_linalg_vecdot_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_log2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_logaddexp2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_logspace_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_lu_unpack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_mT_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_masked_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_masked_argmin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_masked_fill_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_masked_log_softmax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_max_binary_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_median_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_meshgrid_variadic_tensors_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_min_reduction_no_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_mm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_movedim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_mv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_mvlgamma_mvlgamma_p_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nanmean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nanmedian_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_native_batch_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_new_empty_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_new_full_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_adaptive_max_pool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_avg_pool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_avg_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_channel_shuffle_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_conv_transpose2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_cross_entropy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_dropout_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_embedding_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_fractional_max_pool2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_grid_sample_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_huber_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_interpolate_nearest-exact_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_l1_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_leaky_relu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_linear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_max_unpool3d_grad_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_mish_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_mse_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_multi_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_pad_replicate_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_pixel_shuffle_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_poisson_nll_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_softplus_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_softshrink_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_tanhshrink_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_triplet_margin_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_nn_functional_unfold_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_norm_nuc_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_normal_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_normal_in_place_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_normal_number_mean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_outer_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_permute_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_pinverse_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_polygamma_polygamma_n_0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_polygamma_polygamma_n_2_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_polygamma_polygamma_n_4_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_prod_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_qr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_randint_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_randint_like_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_randn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_remainder_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_renorm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_resize_as__cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_rot90_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_round_decimals_neg_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_scalar_tensor_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_scatter_add_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_select_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_signal_windows_bartlett_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_signal_windows_cosine_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_signal_windows_exponential_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_signal_windows_gaussian_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_signal_windows_general_hamming_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_signal_windows_nuttall_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_sin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_slice_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_softmax_with_dtype_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_chebyshev_polynomial_t_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_chebyshev_polynomial_v_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_erfcx_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_hermite_polynomial_h_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_hermite_polynomial_he_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_modified_bessel_k0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_ndtri_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_special_scaled_modified_bessel_k0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_split_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_split_with_sizes_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_split_with_sizes_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_squeeze_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_squeeze_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_squeeze_multiple_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_stack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_std_mean_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_std_unbiased_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_stft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_t_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_take_along_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_take_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_tan_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_torch_ops_aten__flash_attention_forward_cuda_float16, test/test_ops.py::TestFakeTensorCUDA::test_fake_trapezoid_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_trapz_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_tril_indices_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_triu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_triu_indices_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_fake_unfold_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_unique_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_unsafe_chunk_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_unsafe_split_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_view_as_complex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_view_as_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_view_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_vsplit_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_fake_vstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_H_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_T_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops___radd___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops___rmatmul___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops___rpow___cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops__batch_norm_with_update_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops__native_batch_norm_legit_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops__upsample_bilinear2d_aa_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_abs_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_addbmm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_addmv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_addr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_all_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_allclose_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_argmin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_as_strided_partial_views_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_atan_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_atleast_1d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_bernoulli_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_bitwise_not_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_block_diag_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_byte_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_cholesky_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_chunk_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_clamp_min_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_column_stack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_combinations_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_contiguous_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_cummax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_cumulative_trapezoid_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_diagonal_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_dist_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_empty_like_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_eq_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_erf_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_fft_hfftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_fft_ihfft_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_fft_irfftn_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_flatten_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_float_power_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_floor_divide_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_fmin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_frac_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_frexp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_hstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_imag_cuda_complex64, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_index_reduce_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_inner_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_int_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_isclose_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_jiterator_2inputs_2outputs_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_cholesky_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_det_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_eig_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_householder_product_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_inv_ex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_ldl_factor_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_ldl_factor_ex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_lstsq_grad_oriented_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_lu_factor_ex_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_matrix_rank_hermitian_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_multi_dot_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_pinv_hermitian_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_qr_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_solve_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_svdvals_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_tensorinv_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_vander_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_linalg_vecdot_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_logical_and_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_masked_cumsum_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_masked_median_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_masked_scatter_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_masked_std_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_masked_var_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_matrix_exp_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_max_binary_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_max_pool2d_with_indices_backward_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_median_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_minimum_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_mm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_mode_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_multinomial_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_mvlgamma_mvlgamma_p_1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_narrow_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_native_batch_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_ne_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_new_full_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_new_ones_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_new_zeros_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_adaptive_max_pool1d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_avg_pool1d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_bilinear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_binary_cross_entropy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_conv1d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_conv_transpose2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_cosine_embedding_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_cosine_similarity_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_dropout2d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_elu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_feature_alpha_dropout_with_train_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_fractional_max_pool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_gaussian_nll_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_group_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_hardsigmoid_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_hardtanh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_l1_loss_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_linear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_max_unpool1d_grad_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_max_unpool3d_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_pad_circular_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_pad_reflect_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_pdist_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_prelu_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_rms_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_tanhshrink_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_threshold_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nn_functional_upsample_bilinear_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nonzero_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_nonzero_static_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_norm_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_norm_inf_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_normal_in_place_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_ones_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_permute_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_pinverse_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_quantile_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_rad2deg_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_randint_like_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_ravel_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_real_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_remainder_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_resize_as__cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_roll_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_round_decimals_0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_round_decimals_3_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_scatter_reduce_amax_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_scatter_reduce_sum_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_signal_windows_gaussian_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_sin_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_sinc_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_sinh_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_slice_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_sort_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_special_bessel_y1_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_special_erfcx_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_special_legendre_polynomial_p_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_special_modified_bessel_i0_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_special_shifted_chebyshev_polynomial_w_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_special_zeta_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_split_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_split_with_sizes_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_square_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_squeeze_multiple_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_std_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_take_along_dim_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_tan_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_tensor_split_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_topk_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_torch__scaled_mm_cuda_float8_e4m3fn, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_torch_ops_aten__safe_softmax_default_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_trace_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_transpose_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_unbind_copy_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_unfold_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_unique_consecutive_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_unsqueeze_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_var_unbiased_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_view_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_vstack_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_zeros_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_pointwise_ops_zeros_like_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_arange_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_linspace_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_linspace_cuda_int16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_linspace_cuda_int8, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_linspace_cuda_uint8, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_linspace_tensor_overload_cuda_bfloat16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_linspace_tensor_overload_cuda_complex64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_logspace_cuda_complex128, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_logspace_cuda_complex64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_logspace_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_logspace_tensor_overload_cuda_int16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_logspace_tensor_overload_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_ones_cuda_bfloat16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_ones_cuda_bool, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_ones_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout__refs_zeros_cuda_complex128, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_arange_cuda_int16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_full_cuda_bool, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_full_cuda_float16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_full_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_full_cuda_int32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_full_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_cuda_float32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_cuda_int16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_cuda_int32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_cuda_int8, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_tensor_overload_cuda_complex64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_tensor_overload_cuda_float16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_linspace_tensor_overload_cuda_int16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_logspace_cuda_bfloat16, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_logspace_cuda_complex128, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_logspace_cuda_complex64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_logspace_cuda_int32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_logspace_cuda_int64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_logspace_cuda_uint8, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_ones_cuda_complex128, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_ones_cuda_complex64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_zeros_cuda_complex32, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_zeros_cuda_float64, test/test_ops.py::TestFakeTensorCUDA::test_strided_layout_zeros_cuda_int16, test/test_ops.py::TestTagsCUDA::test_tags___rmatmul___cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags___rxor___cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags__refs__conversions_bool_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs__conversions_float_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_acos_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_addcmul_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_allclose_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_amax_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_atleast_1d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_bitwise_left_shift_cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags__refs_bitwise_not_cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags__refs_bitwise_right_shift_cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags__refs_constant_pad_nd_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_count_nonzero_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_cumsum_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_diag_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_dsplit_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_dstack_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_empty_like_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_exp_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_expm1_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_fft_fft_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_fft_ifftshift_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_fft_ihfft_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_fft_ihfftn_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_fft_rfft_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_fill_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_flatten_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_flip_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_fmax_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_frexp_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_geometric_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_gt_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_hypot_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_i0_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_imag_cuda_complex64, test/test_ops.py::TestTagsCUDA::test_tags__refs_index_add_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_isclose_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_lcm_cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags__refs_lerp_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_lgamma_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_linalg_diagonal_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_linalg_svd_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_linalg_vector_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_linspace_tensor_overload_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_log10_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_logical_and_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_logical_or_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_mean_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_meshgrid_variadic_tensors_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_neg_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_new_full_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_new_ones_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nextafter_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_group_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_huber_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_log_softmax_with_dtype_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_margin_ranking_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_mish_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_mse_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_pairwise_distance_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_pdist_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_pixel_unshuffle_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_relu6_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_softmax_with_dtype_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_nn_functional_threshold_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_ravel_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_repeat_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_sigmoid_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_sinc_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_sinh_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_special_bessel_j0_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_special_bessel_j1_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_special_erfcx_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_special_multigammaln_mvlgamma_p_5_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_special_xlog1py_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_squeeze_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_squeeze_multiple_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_std_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_sum_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_take_along_dim_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_trace_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_tril_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_triu_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_trunc_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags__refs_where_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_acos_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_add_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_all_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_any_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_argmin_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_as_strided_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_as_strided_scatter_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_atanh_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_atleast_3d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_bernoulli_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_bitwise_right_shift_cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags_broadcast_tensors_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_ceil_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_cfloat_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_cholesky_inverse_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_cholesky_solve_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_clone_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_combinations_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_conj_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_constant_pad_nd_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_cosh_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_count_nonzero_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_cov_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_cumprod_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_diag_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_diag_embed_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_diagonal_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_dist_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_div_no_rounding_mode_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_dot_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_empty_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_empty_permuted_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_equal_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_erf_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_erfinv_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_exp2_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_expm1_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_eye_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_fft_fftn_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_fft_hfft2_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_fft_hfft_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_fft_irfftn_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_fmod_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_frexp_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_full_like_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_gcd_cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags_half_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_hsplit_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_imag_cuda_complex64, test/test_ops.py::TestTagsCUDA::test_tags_index_reduce_mean_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_istft_cuda_complex64, test/test_ops.py::TestTagsCUDA::test_tags_jiterator_binary_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_kron_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_kthvalue_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_cholesky_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_eigh_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_eigvals_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_householder_product_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_ldl_factor_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_ldl_factor_ex_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_matrix_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_matrix_power_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_matrix_rank_hermitian_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_pinv_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_qr_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_solve_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linalg_solve_ex_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_linspace_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_log1p_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_log_softmax_with_dtype_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_logaddexp2_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_logit_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_logspace_tensor_overload_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_mH_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_masked_logsumexp_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_masked_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_masked_prod_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_maximum_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_minimum_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_mm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nansum_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_native_batch_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_native_layer_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_adaptive_avg_pool2d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_adaptive_avg_pool3d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_adaptive_max_pool2d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_avg_pool3d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_batch_norm_without_cudnn_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_binary_cross_entropy_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_channel_shuffle_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_conv2d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_conv3d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_cosine_embedding_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_cross_entropy_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_dropout2d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_embedding_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_gelu_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_group_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_hardshrink_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_hardsigmoid_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_hardtanh_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_hinge_embedding_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_l1_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_logsigmoid_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_max_pool1d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_max_unpool2d_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_multi_margin_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_multilabel_margin_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_one_hot_cuda_int64, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_pad_constant_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_pixel_shuffle_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_relu_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_silu_complex_cuda_complex64, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_smooth_l1_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_soft_margin_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_softplus_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_tanhshrink_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_triplet_margin_with_distance_loss_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_upsample_bilinear_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nn_functional_upsample_nearest_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_nonzero_static_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_norm_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_normal_in_place_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_polygamma_polygamma_n_4_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_pow_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_quantile_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_randint_like_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_randn_like_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_ravel_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_resolve_conj_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_round_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_rsqrt_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_scalar_tensor_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_scatter_reduce_amax_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_scatter_reduce_mean_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_scatter_reduce_sum_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_searchsorted_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_sgn_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_sigmoid_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_signal_windows_general_cosine_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_signal_windows_nuttall_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_bessel_y0_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_chebyshev_polynomial_t_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_chebyshev_polynomial_u_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_chebyshev_polynomial_v_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_entr_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_i1e_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_laguerre_polynomial_l_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_modified_bessel_i0_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_scaled_modified_bessel_k1_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_shifted_chebyshev_polynomial_v_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_xlog1py_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_special_zeta_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_split_list_args_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_square_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_squeeze_copy_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_std_mean_unbiased_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_std_unbiased_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_stft_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_sum_to_size_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_take_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_tensor_split_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_triangular_solve_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_unique_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_unsqueeze_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_var_mean_unbiased_cuda_float32, test/test_ops.py::TestTagsCUDA::test_tags_var_unbiased_cuda_float32 2025-09-07T09:32:54.4512683Z 2025-09-07T09:32:54.4512811Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-09-07T09:32:54.4512996Z Uploading artifacts took 0.00 seconds 2025-09-07T09:32:54.4513250Z Running test_quantization 2/5 ... [2025-09-07 09:32:54.264948] 2025-09-07T09:32:54.4513422Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:32:54.4513892Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_quantization.py', '--shard-id=2', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:32:54.265153] 2025-09-07T09:42:23.2816584Z 2025-09-07T09:42:23.2817323Z test_quantization 2/5 was successful, full logs can be found in artifacts with path test/test-reports/test_quantization_2.5_95a961de7d4c932e_.log 2025-09-07T09:42:23.2844156Z Running 255 items in this shard: test/test_quantization.py::TestQuantizedOps::test_avg_pool3d, test/test_quantization.py::TestQuantizedOps::test_batch_norm, test/test_quantization.py::TestQuantizedOps::test_channel_shuffle, test/test_quantization.py::TestQuantizedOps::test_equal, test/test_quantization.py::TestQuantizedOps::test_instance_norm, test/test_quantization.py::TestQuantizedOps::test_leaky_relu, test/test_quantization.py::TestQuantizedOps::test_max_pool3d, test/test_quantization.py::TestQuantizedOps::test_max_pool3d_nhwc, test/test_quantization.py::TestQuantizedOps::test_mul_scalar_relu, test/test_quantization.py::TestQuantizedOps::test_qlayer_norm, test/test_quantization.py::TestQuantizedOps::test_qrelu, test/test_quantization.py::TestQuantizedOps::test_qsoftmax_qnnpack, test/test_quantization.py::TestQuantizedOps::test_quantized_mean_qnnpack, test/test_quantization.py::TestQuantizedOps::test_std, test/test_quantization.py::TestQNNPackOps::test_hardtanh, test/test_quantization.py::TestQNNPackOps::test_qnnpack_add_broadcast, test/test_quantization.py::TestQNNPackOps::test_qnnpack_relu, test/test_quantization.py::TestQuantizedLinear::test_qlinear_add_fp8, test/test_quantization.py::TestQuantizedLinear::test_qlinear_add_relu_fp8, test/test_quantization.py::TestQuantizedLinear::test_qlinear_tanh, test/test_quantization.py::TestQuantizedLinear::test_wrapped_quantized_linear, test/test_quantization.py::TestQuantizedConv::test_qconv1d, test/test_quantization.py::TestQuantizedConv::test_qconv1d_cudnn, test/test_quantization.py::TestQuantizedConv::test_qconv2d_add, test/test_quantization.py::TestQuantizedConv::test_qconv2d_hardtanh_pt2e, test/test_quantization.py::TestQuantizedConv::test_qconv3d_unpack, test/test_quantization.py::TestQuantizedConv::test_qconv_transpose2d, test/test_quantization.py::TestDynamicQuantizedOps::test_dynamic_conv2d, test/test_quantization.py::TestDynamicQuantizedOps::test_wrapped_fbgemm_pack_gemm_matrix_fp16_pt2_compliant, test/test_quantization.py::TestComparatorOps::test_compare_tensor_tensor, test/test_quantization.py::TestPadding::test_constant_padNd, test/test_quantization.py::TestQuantizedEmbeddingOps::test_embedding_2d_indices, test/test_quantization.py::TestQuantizedEmbeddingOps::test_embedding_bag_2bit, test/test_quantization.py::TestQuantizedEmbeddingOps::test_embedding_bag_4bit, test/test_quantization.py::TestQuantizedFunctionalOps::test_conv3d_api, test/test_quantization.py::TestQuantizedFunctionalOps::test_grid_sample, test/test_quantization.py::TestQuantizedFunctionalOps::test_relu_api, test/test_quantization.py::TestFakeQuantizeOps::test_backward_per_tensor, test/test_quantization.py::TestFakeQuantizeOps::test_forward_per_channel, test/test_quantization.py::TestFakeQuantizeOps::test_learnable_backward_per_tensor_cpu, test/test_quantization.py::TestFusedObsFakeQuant::test_fused_obs_fake_quant_backward_op, test/test_quantization.py::TestQuantizedTensor::test_compare_per_channel_device_numerics, test/test_quantization.py::TestQuantizedTensor::test_per_channel_qtensor_to_memory_format, test/test_quantization.py::TestQuantizedTensor::test_per_tensor_qtensor_to_memory_format, test/test_quantization.py::TestQuantizedTensor::test_qtensor_channel_float_assignment, test/test_quantization.py::TestQuantizedTensor::test_qtensor_dtypes, test/test_quantization.py::TestQuantizedTensor::test_qtensor_index_put_cuda, test/test_quantization.py::TestQuantizedTensor::test_qtensor_legacy_new_failure, test/test_quantization.py::TestQuantizedTensor::test_qtensor_permute, test/test_quantization.py::TestQuantizedTensor::test_qtensor_resize, test/test_quantization.py::TestQuantizedTensor::test_qtensor_sub_byte_not_aligned_cols, test/test_quantization.py::TestFakeQuantize::test_fq_module_per_channel, test/test_quantization.py::TestObserver::test_histogram_observer_ignore_infinity, test/test_quantization.py::TestStaticQuantizedModule::test_batch_norm2d, test/test_quantization.py::TestStaticQuantizedModule::test_conv1d_relu_api, test/test_quantization.py::TestStaticQuantizedModule::test_conv3d_api, test/test_quantization.py::TestStaticQuantizedModule::test_dropout_serialization, test/test_quantization.py::TestStaticQuantizedModule::test_hard_swish, test/test_quantization.py::TestStaticQuantizedModule::test_layer_norm, test/test_quantization.py::TestStaticQuantizedModule::test_linear_tanh, test/test_quantization.py::TestStaticQuantizedModule::test_relu, test/test_quantization.py::TestStaticQuantizedModule::test_sigmoid, test/test_quantization.py::TestDynamicQuantizedModule::test_dynamic_convtranspose1d, test/test_quantization.py::TestDynamicQuantizedModule::test_linear_api, test/test_quantization.py::TestDynamicQuantizedModule::test_lstm_api, test/test_quantization.py::TestReferenceQuantizedModule::test_rnn_cell, test/test_quantization.py::TestHistogramObserver::test_histogram_observer_against_reference, test/test_quantization.py::TestHistogramObserver::test_histogram_observer_one_sided, test/test_quantization.py::TestHistogramObserver::test_histogram_observer_single_inputs, test/test_quantization.py::TestHistogramObserver::test_histogram_observer_update_within_range_succeeds, test/test_quantization.py::TestBackendConfig::test_backend_config_set_name, test/test_quantization.py::TestBackendConfig::test_backend_op_config_set_fuser_method, test/test_quantization.py::TestBackendConfig::test_backend_op_config_set_num_tensor_args_to_observation_type, test/test_quantization.py::TestBackendConfig::test_backend_op_config_set_qat_module, test/test_quantization.py::TestUtils::test_uint4_int4_dtype, test/test_quantization.py::TestQuantizeEagerPTQDynamic::test_forward_hooks_preserved, test/test_quantization.py::TestQuantizeEagerPTQDynamic::test_two_layers, test/test_quantization.py::TestQuantizeEagerOps::test_conv_transpose_1d, test/test_quantization.py::TestQuantizeEagerOps::test_conv_transpose_3d, test/test_quantization.py::TestQuantizeEagerOps::test_leaky_relu, test/test_quantization.py::TestQuantizeEagerQAT::test_conv_linear, test/test_quantization.py::TestQuantizeEagerQAT::test_dynamic_qat_linear, test/test_quantization.py::TestQuantizeEagerQAT::test_eval_only_fake_quant, test/test_quantization.py::TestQuantizeEagerQATNumerics::test_linear_bn_symm_numerics, test/test_quantization.py::TestFuseEager::test_forward_hooks_preserved, test/test_quantization.py::TestFuseEager::test_fuse_modules_with_nested_hooks, test/test_quantization.py::TestFuseEager::test_fusion_convtranspose_bn_eval, test/test_quantization.py::TestNumericSuiteEager::test_compare_model_outputs_functional_static, test/test_quantization.py::TestNumericSuiteEager::test_compare_model_outputs_linear_static, test/test_quantization.py::TestNumericSuiteEager::test_compare_model_outputs_lstm_dynamic, test/test_quantization.py::TestNumericSuiteEager::test_compare_model_stub_conv_static, test/test_quantization.py::TestNumericSuiteEager::test_compare_model_stub_lstm_dynamic, test/test_quantization.py::TestNumericSuiteEager::test_mobilenet_v3, test/test_quantization.py::TestNumericSuiteEager::test_shadow_logger, test/test_quantization.py::TestEqualizeEager::test_cross_layer_equalization, test/test_quantization.py::TestFuseFx::test_fuse_conv_bn_add_relu_lowering, test/test_quantization.py::TestFuseFx::test_fuse_convtranspose_bn_eval, test/test_quantization.py::TestFuseFx::test_fuse_linear_bn_leaky_relu_onednn, test/test_quantization.py::TestFuseFx::test_fuse_module_relu, test/test_quantization.py::TestFuseFx::test_problematic_fuse_example, test/test_quantization.py::TestQuantizeFx::test_channel_shuffle_lowering, test/test_quantization.py::TestQuantizeFx::test_convert_custom_config_set_preserved_attributes, test/test_quantization.py::TestQuantizeFx::test_copy_node_has_shared_actpp_instance, test/test_quantization.py::TestQuantizeFx::test_dict_output, test/test_quantization.py::TestQuantizeFx::test_fuse_custom_config_set_preserved_attributes, test/test_quantization.py::TestQuantizeFx::test_fused_module_qat_swap, test/test_quantization.py::TestQuantizeFx::test_fusion_pattern_unquantized, test/test_quantization.py::TestQuantizeFx::test_get_default_qconfig_valid_backend, test/test_quantization.py::TestQuantizeFx::test_getattr_with_nontensor_result, test/test_quantization.py::TestQuantizeFx::test_linear_bn, test/test_quantization.py::TestQuantizeFx::test_lowering_functional_linear_with_kwargs, test/test_quantization.py::TestQuantizeFx::test_pattern_match, test/test_quantization.py::TestQuantizeFx::test_prepare_custom_config_set_output_quantized_indexes, test/test_quantization.py::TestQuantizeFx::test_prepare_mode, test/test_quantization.py::TestQuantizeFx::test_preserve_qconfig, test/test_quantization.py::TestQuantizeFx::test_propagate_dtypes_for_known_nodes_dict_args, test/test_quantization.py::TestQuantizeFx::test_propagate_dtypes_for_known_nodes_split_list_args, test/test_quantization.py::TestQuantizeFx::test_qconfig_mapping_set_object_type, test/test_quantization.py::TestQuantizeFx::test_qconfig_mapping_to_dict, test/test_quantization.py::TestQuantizeFx::test_qconfig_none, test/test_quantization.py::TestQuantizeFx::test_qparams_buffers, test/test_quantization.py::TestQuantizeFx::test_quant_output_always_observed, test/test_quantization.py::TestQuantizeFx::test_quantized_model_type, test/test_quantization.py::TestQuantizeFx::test_register_patterns, test/test_quantization.py::TestQuantizeFx::test_reshape_nontensor_args_not_observed, test/test_quantization.py::TestQuantizeFx::test_stack_trace_preserved_linear, test/test_quantization.py::TestQuantizeFx::test_standalone_module_float_interface, test/test_quantization.py::TestQuantizeFx::test_state_dict, test/test_quantization.py::TestQuantizeFx::test_static_lstm, test/test_quantization.py::TestQuantizeFx::test_static_lstm_with_custom_fixed_qparams, test/test_quantization.py::TestQuantizeFx::test_sub_scalar, test/test_quantization.py::TestQuantizeFx::test_torch_unsqueeze_nontensor_args_not_observed, test/test_quantization.py::TestQuantizeFx::test_unsqueeze__nontensor_args_not_observed, test/test_quantization.py::TestQuantizeFx::test_unsqueeze_nontensor_args_not_observed, test/test_quantization.py::TestQuantizeFxOps::test_add, test/test_quantization.py::TestQuantizeFxOps::test_add_relu_multiple_uses_of_relu, test/test_quantization.py::TestQuantizeFxOps::test_elu, test/test_quantization.py::TestQuantizeFxOps::test_embedding, test/test_quantization.py::TestQuantizeFxOps::test_embedding_bag, test/test_quantization.py::TestQuantizeFxOps::test_fixed_qparams_ops, test/test_quantization.py::TestQuantizeFxOps::test_linear_dynamic_fp16, test/test_quantization.py::TestQuantizeFxOps::test_mish_reference, test/test_quantization.py::TestQuantizeFxOps::test_pixel_shuffle_module, test/test_quantization.py::TestQuantizeFxOps::test_prelu, test/test_quantization.py::TestQuantizeFxOps::test_qbatch_norm_relu, test/test_quantization.py::TestQuantizeFxOps::test_quantized_add_qat, test/test_quantization.py::TestQuantizeFxOps::test_rnn, test/test_quantization.py::TestQuantizeFxOps::test_softmax_normal, test/test_quantization.py::TestQuantizeFxModels::test_model_dropout, test/test_quantization.py::TestQuantizeFxModels::test_qat_functional_linear, test/test_quantization.py::TestQuantizeFxModels::test_resnet_base, test/test_quantization.py::TestQuantizeFxModels::test_torchvision, test/test_quantization.py::TestGraphUtils::test_conv_bn_relu, test/test_quantization.py::TestGraphUtils::test_customized_equivalet_types_dict, test/test_quantization.py::TestMetaDataPorting::test_metadata_porting_for_dq, test/test_quantization.py::TestNumericDebugger::test_added_node_gets_unique_id, test/test_quantization.py::TestNumericDebugger::test_control_flow, test/test_quantization.py::TestNumericDebugger::test_extract_results_from_loggers_list_output, test/test_quantization.py::TestNumericDebugger::test_quantize_pt2e_preserve_handle, test/test_quantization.py::TestNumericDebugger::test_run_decompositions_same_handle_id, test/test_quantization.py::TestNumericDebugger::test_simple, test/test_quantization.py::TestQuantizePT2E::test_composable_quantizer_linear_conv, test/test_quantization.py::TestQuantizePT2E::test_composable_quantizer_transform_for_annotation, test/test_quantization.py::TestQuantizePT2E::test_conv_transpose_bn_relu, test/test_quantization.py::TestQuantizePT2E::test_embedding_conv_linear_quantization, test/test_quantization.py::TestQuantizePT2E::test_fixed_qparams_qspec_ptq, test/test_quantization.py::TestQuantizePT2E::test_fold_quantize_per_channel, test/test_quantization.py::TestQuantizePT2E::test_max_pool2d_quantizer, test/test_quantization.py::TestQuantizePT2E::test_move_exported_model_dropout, test/test_quantization.py::TestQuantizePT2E::test_save_load, test/test_quantization.py::TestQuantizePT2E::test_shared_qspec_transitivity, test/test_quantization.py::TestQuantizePT2E::test_transform_for_annotation, test/test_quantization.py::TestQuantizePT2EAffineQuantization::test_channel_group_quantization, test/test_quantization.py::TestQuantizePT2EAffineQuantization::test_dynamic_affine_act_per_channel_weights, test/test_quantization.py::TestPT2ERepresentation::test_qdq_per_channel, test/test_quantization.py::TestXNNPACKQuantizer::test_conv_linear, test/test_quantization.py::TestXNNPACKQuantizer::test_dynamic_linear, test/test_quantization.py::TestXNNPACKQuantizer::test_dynamic_linear_int4_weight, test/test_quantization.py::TestXNNPACKQuantizer::test_linear_with_dynamic_shape, test/test_quantization.py::TestXNNPACKQuantizer::test_mul_and_inplace_mul, test/test_quantization.py::TestXNNPACKQuantizer::test_set_module_name, test/test_quantization.py::TestQuantizePT2EX86Inductor::test_cat_recipe_same_inputs, test/test_quantization.py::TestQuantizePT2EX86Inductor::test_conv2d_binary_unary, test/test_quantization.py::TestQuantizePT2EX86Inductor::test_flatten_recipe, test/test_quantization.py::TestQuantizePT2EX86Inductor::test_linear_binary_unary_serials, test/test_quantization.py::TestQuantizePT2EX86Inductor::test_qat_conv2d_binary2, test/test_quantization.py::TestQuantizePT2EQAT_ConvBn1d::test_fold_bn_erases_bn_node, test/test_quantization.py::TestQuantizePT2EQAT_ConvBn1d::test_qat_conv_bn_bias_derived_qspec, test/test_quantization.py::TestQuantizePT2EQAT_ConvBn1d::test_qat_conv_bn_fusion_no_conv_bias, test/test_quantization.py::TestQuantizePT2EQAT_ConvBn1d::test_qat_conv_transpose_bn_relu, test/test_quantization.py::TestQuantizePT2EQAT_ConvBn1d::test_qat_per_channel_weight_custom_dtype, test/test_quantization.py::TestQuantizePT2EQAT_ConvBn2d::test_qat_conv_bn_relu_fusion, test/test_quantization.py::TestQuantizePT2EQAT_ConvBn2d::test_qat_update_shared_qspec, test/test_quantization.py::TestFXGraphMatcher::test_methods, test/test_quantization.py::TestFXGraphMatcher::test_nodes_before_cat, test/test_quantization.py::TestFXNumericSuiteCoreAPIs::test_extract_weights_conv_fun_qat, test/test_quantization.py::TestFXNumericSuiteCoreAPIs::test_fp16_shadows_fp32, test/test_quantization.py::TestFXNumericSuiteCoreAPIs::test_layer_names, test/test_quantization.py::TestFXNumericSuiteCoreAPIs::test_ops_with_same_fp32_and_int8_signature, test/test_quantization.py::TestFXNumericSuiteCoreAPIs::test_user_defined_function, test/test_quantization.py::TestFXNumericSuiteNShadows::test_add_loggers_conv_bn_relu_fusion_fp32, test/test_quantization.py::TestFXNumericSuiteNShadows::test_add_loggers_functions, test/test_quantization.py::TestFXNumericSuiteNShadows::test_add_loggers_mobilenet_v2, test/test_quantization.py::TestFXNumericSuiteNShadows::test_extract_weights_linear, test/test_quantization.py::TestFXNumericSuiteNShadows::test_linear_mod, test/test_quantization.py::TestFXNumericSuiteNShadows::test_linear_relu_mod, test/test_quantization.py::TestFXNumericSuiteNShadows::test_logger_enabled_and_save_activations_flags, test/test_quantization.py::TestFXNumericSuiteNShadows::test_mobilenet_v2, test/test_quantization.py::TestFXNumericSuiteNShadows::test_partial_qconfig_mapping, test/test_quantization.py::TestFXNumericSuiteCoreAPIsModels::test_compare_weights_linear, test/test_quantization.py::TestFXNumericSuiteCoreAPIsModels::test_compare_weights_lstm_dynamic, test/test_quantization.py::TestFxModelReportDetectDynamicStatic::test_nested_detection_case, test/test_quantization.py::TestFxModelReportClass::test_prepare_model_callibration, test/test_quantization.py::TestFxModelReportVisualizer::test_generate_tables_match_with_report, test/test_quantization.py::TestEqualizeFx::test_input_weight_equalization_branching, test/test_quantization.py::TestSerialization::test_conv2d_graph, test/test_quantization.py::TestSerialization::test_conv2d_graph_v3, test/test_quantization.py::TestSerialization::test_conv2d_nobias, test/test_quantization.py::TestSerialization::test_conv2d_relu, test/test_quantization.py::TestSerialization::test_conv3d, test/test_quantization.py::TestSerialization::test_linear_dynamic, test/test_quantization.py::TestQuantizeJit::test_linear_dynamic_fp16, test/test_quantization.py::TestQuantizeJitPasses::test_convtranspose_trace, test/test_quantization.py::TestQuantizeJitPasses::test_dedup_module_uses, test/test_quantization.py::TestQuantizeJitPasses::test_insert_observers, test/test_quantization.py::TestQuantizeJitPasses::test_insert_observers_for_general_ops, test/test_quantization.py::TestQuantizeJitPasses::test_quantize_fork_wait, test/test_quantization.py::TestQuantizeJitOps::test_general_value_ops, test/test_quantization.py::TestQuantizeJitOps::test_hardswish, test/test_quantization.py::TestQuantizeJitOps::test_instance_norm, test/test_quantization.py::TestQuantizeJitOps::test_layer_norm, test/test_quantization.py::TestQuantizeJitOps::test_qbatch_norm_relu_BNFuncInplaceRelu, test/test_quantization.py::TestQuantizeJitOps::test_quantized_add_scalar_relu, test/test_quantization.py::TestQuantizeJitOps::test_quantized_mul_relu, test/test_quantization.py::TestQuantizeDynamicJitPasses::test_dynamic_shared_weights, test/test_quantization.py::TestQuantizeDynamicJitPasses::test_dynamic_weight_observer, test/test_quantization.py::TestQuantizeDynamicJitPasses::test_quantize_dynamic_fp16, test/test_quantization.py::TestQuantizeDynamicJitOps::test_linear, test/test_quantization.py::TestDeprecatedJitQuantized::test_quantization_modules, test/test_quantization.py::TestAOMigrationQuantization::test_function_import_quantization_mappings, test/test_quantization.py::TestAOMigrationQuantization::test_function_import_stubs, test/test_quantization.py::TestAOMigrationNNQuantized::test_import_nn_qat_embedding_ops, test/test_quantization.py::TestAOMigrationNNQuantized::test_import_nn_quantizable_activation, test/test_quantization.py::TestAOMigrationNNQuantized::test_modules_conv, test/test_quantization.py::TestAOMigrationNNQuantized::test_modules_dropout, test/test_quantization.py::TestAOMigrationNNQuantized::test_modules_import, test/test_quantization.py::TestAOMigrationNNIntrinsic::test_modules_intrinsic_quantized_linear_relu, test/test_quantization.py::TestAOMigrationNNIntrinsic::test_modules_nn_intrinsic_fused, test/test_quantization.py::TestAOMigrationQuantizationFx::test_function_import_fx_match_utils, test/test_quantization.py::TestFloat8DtypeCUDA::test_cast_round_trip_extremes_cuda_float8_e5m2, test/test_quantization.py::TestFloat8DtypeCUDA::test_cat_cuda_float8_e8m0fnu, test/test_quantization.py::TestFloat8DtypeCUDA::test_empty_cuda_float8_e4m3fn, test/test_quantization.py::TestFloat8DtypeCUDA::test_finfo_cuda_float8_e5m2fnuz, test/test_quantization.py::TestFloat8DtypeCUDA::test_float8_e8m0fnu_rne_rounding_cuda, test/test_quantization.py::TestFloat8DtypeCUDA::test_special_numbers_cuda_float8_e8m0fnu 2025-09-07T09:42:23.2890724Z 2025-09-07T09:42:23.2890833Z Running test_sparse_csr 2/2 ... [2025-09-07 09:42:23.282437] 2025-09-07T09:42:23.2891054Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:42:23.2891665Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_sparse_csr.py', '--shard-id=2', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:42:23.282655] 2025-09-07T09:47:12.5111787Z 2025-09-07T09:47:12.5113021Z PRINTING LOG FILE of test_sparse_csr 2/2 (test/test-reports/test_sparse_csr_2.2_b69370d88dea38b2_.log) 2025-09-07T09:47:12.5115641Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T09:47:12.5117059Z import pkg_resources 2025-09-07T09:47:12.5117638Z Test results will be stored in test-reports/python-pytest/test_sparse_csr/test_sparse_csr-f525f67e35f3ad92.xml 2025-09-07T09:47:12.5118309Z ============================= test session starts ============================== 2025-09-07T09:47:12.5118909Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T09:47:12.5119422Z cachedir: .pytest_cache 2025-09-07T09:47:12.5120041Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T09:47:12.5120724Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T09:47:12.5121050Z configfile: pytest.ini 2025-09-07T09:47:12.5129409Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T09:47:12.5130155Z collecting ... collected 4958 items 2025-09-07T09:47:12.5130384Z stepcurrent: Cannot find last run test, not skipping 2025-09-07T09:47:12.5458341Z Running 2417 items in this shard: test/test_sparse_csr.py::TestSparseCSRCUDA::test_add_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_add_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_all_sparse_csr_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_all_sparse_csr_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_errors_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_0_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_25_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_25_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_25_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_25_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_25_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_25_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_1_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_1_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_0_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_0_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_0_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_1_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_1_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_25_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_25_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_25_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_0_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_0_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_1_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_1_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_25_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_0_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_0_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_1_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_0_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_0_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_0_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_1_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_1_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_25_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_25_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_25_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_10_m_0_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_10_m_1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_10_m_25_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_0_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_0_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_1_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_11x9_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_11x9_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_11x9_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_3x3_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_5x7_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_5x7_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_abs_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_angle_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_angle_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_asin_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_asinh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_atan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_atanh_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_ceil_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_erf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_erfinv_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_expm1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_isnan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_isneginf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_neg_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_positive_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_positive_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_rad2deg_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sgn_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sgn_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_signbit_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sin_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sin_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sinh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_trunc_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_baddbmm_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_baddbmm_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_baddbmm_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_False_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_False_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_False_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_True_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_False_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_False_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_False_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_True_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int64_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int64_noncontiguous_False_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int64_noncontiguous_True_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int32_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int32_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int32_noncontiguous_True_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_True_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_True_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_False_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_True_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_True_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_True_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int32_noncontiguous_False_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int32_noncontiguous_False_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int32_noncontiguous_True_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int64_noncontiguous_False_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int64_noncontiguous_True_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int64_noncontiguous_True_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_bmm_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_bmm_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSC_SparseBSC_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSC_SparseCSR_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSR_SparseBSR_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSR_SparseCSC_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSC_SparseCSC_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSR_SparseBSC_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSR_SparseCSC_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSR_SparseCSR_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_coo_to_csr_convert_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_storage_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_stride_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_to_block_csr_blocksize_2_cuda_float64_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_csr_to_block_csr_blocksize_4_cuda_float64_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSC_NonBatched_Hybrid_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSC_NonBatched_NonHybrid_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSR_Batched_NonHybrid_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSR_NonBatched_Hybrid_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSR_NonBatched_NonHybrid_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseCSC_NonBatched_NonHybrid_cuda, test/test_sparse_csr.py::TestSparseCSRCUDA::test_direct_coo_csr_conversion_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_direct_coo_csr_conversion_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_direct_coo_csr_conversion_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_matmul_device_mismatch_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mm_errors_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_autograd_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_autograd_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_errors_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_errors_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_zero_sized_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_zero_sized_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_zero_sized_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_add_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_add_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_add_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_frac_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_frac_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_frac_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_nn_functional_relu_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sign_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sign_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sin_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sin_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sin_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_ceil_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_ceil_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_ceil_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_expm1_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_expm1_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isneginf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isneginf_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isneginf_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_nn_functional_relu_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_nn_functional_relu_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_nn_functional_relu_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_mm_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_mm_reduce_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_mm_reduce_sum_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_to_sparse_compressed_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_to_sparse_compressed_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_triangular_solve_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_frac_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_frac_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_frac_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isinf_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isinf_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isinf_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isneginf_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isneginf_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isneginf_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isposinf_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isposinf_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isposinf_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_nn_functional_relu_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_round_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_round_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_round_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sign_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sign_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sign_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_signbit_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_signbit_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_signbit_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_int64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_complex64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_int16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_complex128, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_int8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_bool, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_complex32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_float16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_float32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_int32, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_uint8, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_trunc_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_trunc_cuda_float64, test/test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_trunc_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_frac_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_frac_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_log1p_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_log1p_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_log1p_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_nn_functional_relu_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_nn_functional_relu_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_nn_functional_relu_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sign_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sign_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sign_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_zeros_like_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_zeros_like_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_zeros_like_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_abs_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_abs_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_ceil_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_ceil_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_deg2rad_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_deg2rad_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_deg2rad_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_frac_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_frac_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_mean_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_mean_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_randn_like_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_randn_like_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_trunc_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_trunc_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erfinv_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_expm1_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_expm1_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_expm1_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_frac_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_mean_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_mean_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_mean_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_round_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_round_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_round_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_signbit_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_signbit_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_signbit_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asinh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_deg2rad_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_deg2rad_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_deg2rad_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_frac_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_frac_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_mean_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_mean_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_complex32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseBSC_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseBSR_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseCSC_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseCSR_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_invalid_input_SparseBSC_target_sparse_compressed_tensor_no_size_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_invalid_input_SparseBSR_target_sparse_compressed_tensor_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_invalid_input_SparseBSR_target_sparse_compressed_tensor_no_size_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_layout_SparseBSR_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_layout_SparseCSR_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_pickle_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_pickle_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_pickle_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_print_SparseBSR_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_print_SparseCSR_cuda, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int32_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_complex128, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_bool, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_uint8, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_float64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_complex64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int16, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int32, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int64, test/test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_16_int64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_16_int64_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_16_int64_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int64_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_64_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_64_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_64_int64_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_16_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_2_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_2_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_2x3_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_softmax_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_softmax_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_softmax_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16_out_dtype_unspecified_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16_out_dtype_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_unspecified_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_unspecified_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_unspecified_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16x32_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16x32_out_dtype_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16x32_out_dtype_unspecified_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_32_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_32_out_dtype_unspecified_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_32_out_dtype_unspecified_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_unspecified_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16x32_out_dtype_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16x32_out_dtype_unspecified_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16x32_out_dtype_unspecified_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_unspecified_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_unspecified_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_sampled_addmm_block_size_64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_sampled_addmm_block_size_64_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_sampled_addmm_block_size_64_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_16_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_64_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_64_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scatter_mm_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_float32, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_unspecified_cuda_float16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_int32_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_int32_cuda_int8, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_unspecified_cuda_bfloat16, test/test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_unspecified_cuda_int8 2025-09-07T09:47:12.5769202Z 2025-09-07T09:47:12.5769363Z test_sparse_csr.py::TestSparseCSRCUDA::test_add_SparseCSC_cuda_float32 PASSED [0.3121s] [ 0%] 2025-09-07T09:47:12.5769666Z test_sparse_csr.py::TestSparseCSRCUDA::test_add_SparseCSC_cuda_float64 PASSED [0.0952s] [ 0%] 2025-09-07T09:47:12.5770155Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_all_sparse_csr_SparseCSC_cuda_float64 PASSED [0.5738s] [ 0%] 2025-09-07T09:47:12.5770451Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_all_sparse_csr_SparseCSR_cuda_float64 PASSED [0.0333s] [ 0%] 2025-09-07T09:47:12.5770792Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_complex128 SKIPPED [0.0006s] (Only runs on cpu) [ 0%] 2025-09-07T09:47:12.5771147Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_complex64 SKIPPED [0.0005s] (Only runs on cpu) [ 0%] 2025-09-07T09:47:12.5771496Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_float32 SKIPPED [0.0006s] (Only runs on cpu) [ 0%] 2025-09-07T09:47:12.5771842Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSC_cuda_float64 SKIPPED [0.0004s] (Only runs on cpu) [ 0%] 2025-09-07T09:47:12.5772259Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_dense_result_SparseCSR_cuda_float32 SKIPPED [0.0004s] (Only runs on cpu) [ 0%] 2025-09-07T09:47:12.5772562Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_errors_cuda_float32 PASSED [0.0023s] [ 0%] 2025-09-07T09:47:12.5772857Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_0_cuda_float64 PASSED [0.0023s] [ 0%] 2025-09-07T09:47:12.5773239Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_1_cuda_complex128 PASSED [0.0021s] [ 0%] 2025-09-07T09:47:12.5773843Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_25_cuda_complex64 PASSED [0.0022s] [ 0%] 2025-09-07T09:47:12.5774156Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_25_cuda_float32 PASSED [0.0021s] [ 0%] 2025-09-07T09:47:12.5774464Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_0_m_25_cuda_float64 PASSED [0.0021s] [ 0%] 2025-09-07T09:47:12.5774782Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_complex128 PASSED [0.0023s] [ 0%] 2025-09-07T09:47:12.5775098Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_complex64 PASSED [0.0022s] [ 0%] 2025-09-07T09:47:12.5775407Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_float32 PASSED [0.0021s] [ 0%] 2025-09-07T09:47:12.5775717Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_0_cuda_float64 PASSED [0.0024s] [ 0%] 2025-09-07T09:47:12.5776029Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_complex128 PASSED [0.0043s] [ 0%] 2025-09-07T09:47:12.5776343Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_complex64 PASSED [0.0039s] [ 0%] 2025-09-07T09:47:12.5776649Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_float32 PASSED [0.0027s] [ 0%] 2025-09-07T09:47:12.5776957Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_1_cuda_float64 PASSED [0.0027s] [ 0%] 2025-09-07T09:47:12.5777307Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_25_cuda_complex128 PASSED [0.0029s] [ 0%] 2025-09-07T09:47:12.5777651Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_25_cuda_complex64 PASSED [0.0027s] [ 1%] 2025-09-07T09:47:12.5778028Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_10_m_25_cuda_float32 PASSED [0.0027s] [ 1%] 2025-09-07T09:47:12.5778350Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_complex128 PASSED [0.0023s] [ 1%] 2025-09-07T09:47:12.5778659Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_complex64 PASSED [0.0022s] [ 1%] 2025-09-07T09:47:12.5778969Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_float32 PASSED [0.0022s] [ 1%] 2025-09-07T09:47:12.5779295Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_0_cuda_float64 PASSED [0.0022s] [ 1%] 2025-09-07T09:47:12.5779648Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_1_cuda_complex64 PASSED [0.0029s] [ 1%] 2025-09-07T09:47:12.5780044Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_1_cuda_float32 PASSED [0.0026s] [ 1%] 2025-09-07T09:47:12.5780387Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_complex128 PASSED [0.0023s] [ 1%] 2025-09-07T09:47:12.5780728Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_complex64 PASSED [0.0023s] [ 1%] 2025-09-07T09:47:12.5781102Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_float32 PASSED [0.0022s] [ 1%] 2025-09-07T09:47:12.5781455Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_0_n_1_m_25_cuda_float64 PASSED [0.0022s] [ 1%] 2025-09-07T09:47:12.5781827Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_0_cuda_complex64 PASSED [0.0022s] [ 1%] 2025-09-07T09:47:12.5782176Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_0_cuda_float32 PASSED [0.0022s] [ 1%] 2025-09-07T09:47:12.5782528Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_0_cuda_float64 PASSED [0.0024s] [ 1%] 2025-09-07T09:47:12.5782884Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_1_cuda_complex128 PASSED [0.0023s] [ 1%] 2025-09-07T09:47:12.5783282Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_1_cuda_complex64 PASSED [0.0023s] [ 1%] 2025-09-07T09:47:12.5783617Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_1_cuda_float64 PASSED [0.0018s] [ 1%] 2025-09-07T09:47:12.5783988Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_25_cuda_complex128 PASSED [0.0018s] [ 1%] 2025-09-07T09:47:12.5784338Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_25_cuda_complex64 PASSED [0.0019s] [ 1%] 2025-09-07T09:47:12.5784687Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_0_m_25_cuda_float32 PASSED [0.0018s] [ 1%] 2025-09-07T09:47:12.5785031Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_0_cuda_complex64 PASSED [0.0019s] [ 1%] 2025-09-07T09:47:12.5785376Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_0_cuda_float32 PASSED [0.0020s] [ 1%] 2025-09-07T09:47:12.5785732Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_1_cuda_complex64 PASSED [0.0030s] [ 1%] 2025-09-07T09:47:12.5786076Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_1_cuda_float32 PASSED [0.0027s] [ 2%] 2025-09-07T09:47:12.5786414Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_10_m_25_cuda_complex64 PASSED [0.0029s] [ 2%] 2025-09-07T09:47:12.5786798Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_0_cuda_float32 PASSED [0.0019s] [ 2%] 2025-09-07T09:47:12.5787144Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_0_cuda_float64 PASSED [0.0018s] [ 2%] 2025-09-07T09:47:12.5787483Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_1_cuda_complex128 PASSED [0.0029s] [ 2%] 2025-09-07T09:47:12.5787853Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_1_n_1_m_1_cuda_float32 PASSED [0.0027s] [ 2%] 2025-09-07T09:47:12.5788196Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_0_cuda_complex128 PASSED [0.0017s] [ 2%] 2025-09-07T09:47:12.5788543Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_0_cuda_complex64 PASSED [0.0017s] [ 2%] 2025-09-07T09:47:12.5788922Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_0_cuda_float32 PASSED [0.0022s] [ 2%] 2025-09-07T09:47:12.5789266Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_1_cuda_complex64 PASSED [0.0019s] [ 2%] 2025-09-07T09:47:12.5789627Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_1_cuda_float64 PASSED [0.0018s] [ 2%] 2025-09-07T09:47:12.5789971Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_25_cuda_complex128 PASSED [0.0019s] [ 2%] 2025-09-07T09:47:12.5790312Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_25_cuda_complex64 PASSED [0.0018s] [ 2%] 2025-09-07T09:47:12.5790673Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_0_m_25_cuda_float32 PASSED [0.0018s] [ 2%] 2025-09-07T09:47:12.5791014Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_10_m_0_cuda_complex64 PASSED [0.0019s] [ 2%] 2025-09-07T09:47:12.5791389Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_10_m_1_cuda_complex128 PASSED [0.0029s] [ 2%] 2025-09-07T09:47:12.5791740Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_10_m_25_cuda_float32 PASSED [0.0028s] [ 2%] 2025-09-07T09:47:12.5792086Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_0_cuda_complex128 PASSED [0.0019s] [ 2%] 2025-09-07T09:47:12.5792445Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_0_cuda_float32 PASSED [0.0019s] [ 2%] 2025-09-07T09:47:12.5792788Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_1_cuda_complex128 PASSED [0.0027s] [ 2%] 2025-09-07T09:47:12.5793180Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmm_sizes_all_sparse_csr_k_8_n_1_m_1_cuda_complex64 PASSED [0.0028s] [ 2%] 2025-09-07T09:47:12.5793550Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_11x9_cuda_complex128 SKIPPED [0.0004s] (Only runs on cpu) [ 2%] 2025-09-07T09:47:12.5793894Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_11x9_cuda_complex64 SKIPPED [0.0004s] (Only runs on cpu) [ 2%] 2025-09-07T09:47:12.5794253Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_11x9_cuda_float32 SKIPPED [0.0005s] (Only runs on cpu) [ 2%] 2025-09-07T09:47:12.5796688Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_3x3_cuda_float64 SKIPPED [0.0004s] (Only runs on cpu) [ 3%] 2025-09-07T09:47:12.5797031Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_5x7_cuda_complex64 SKIPPED [0.0004s] (Only runs on cpu) [ 3%] 2025-09-07T09:47:12.5804019Z test_sparse_csr.py::TestSparseCSRCUDA::test_addmv_shape_5x7_cuda_float32 SKIPPED [0.0004s] (Only runs on cpu) [ 3%] 2025-09-07T09:47:12.5804328Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_abs_cuda_float64 PASSED [0.0648s] [ 3%] 2025-09-07T09:47:12.5804744Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_angle_cuda_complex128 SKIPPED [0.0012s] (Skipped! Unary op angle not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5805284Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_angle_cuda_float64 SKIPPED [0.0011s] (Skipped! Unary op angle not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5805771Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_asin_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op asin not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5806232Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_asinh_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op asinh not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5806692Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_atan_cuda_complex128 SKIPPED [0.0010s] (Skipped! Unary op atan not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5807193Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_atanh_cuda_complex128 SKIPPED [0.0011s] (Skipped! Unary op atanh not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5807651Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_ceil_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op ceil not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5808100Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_erf_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op erf not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5808549Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_erfinv_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op erfinv not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5809013Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_expm1_cuda_complex128 SKIPPED [0.0011s] (Skipped! Unary op expm1 not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5809503Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_isnan_cuda_complex128 SKIPPED [0.0010s] (Skipped! Unary op isnan not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5809975Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_isneginf_cuda_float64 SKIPPED [0.0011s] (Skipped! Unary op isneginf not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5810429Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_neg_cuda_float64 PASSED [0.0041s] [ 3%] 2025-09-07T09:47:12.5810727Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_positive_cuda_complex128 PASSED [0.0037s] [ 3%] 2025-09-07T09:47:12.5811033Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_positive_cuda_float64 PASSED [0.0038s] [ 3%] 2025-09-07T09:47:12.5811330Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_rad2deg_cuda_float64 PASSED [0.0039s] [ 3%] 2025-09-07T09:47:12.5811709Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sgn_cuda_complex128 SKIPPED [0.0010s] (Skipped! Unary op sgn not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5812161Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sgn_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op sgn not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5812619Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_signbit_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op signbit not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5813124Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sin_cuda_complex128 SKIPPED [0.0011s] (Skipped! Unary op sin not supported with CSR input and autograd) [ 3%] 2025-09-07T09:47:12.5813579Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sin_cuda_float64 SKIPPED [0.0017s] (Skipped! Unary op sin not supported with CSR input and autograd) [ 4%] 2025-09-07T09:47:12.5814045Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_sinh_cuda_float64 SKIPPED [0.0010s] (Skipped! Unary op sinh not supported with CSR input and autograd) [ 4%] 2025-09-07T09:47:12.5814544Z test_sparse_csr.py::TestSparseCSRCUDA::test_autograd_sparse_csr_unary_trunc_cuda_float64 SKIPPED [0.0013s] (Skipped! Unary op trunc not supported with CSR input and autograd) [ 4%] 2025-09-07T09:47:12.5814903Z test_sparse_csr.py::TestSparseCSRCUDA::test_baddbmm_cuda_complex128 PASSED [0.0191s] [ 4%] 2025-09-07T09:47:12.5815149Z test_sparse_csr.py::TestSparseCSRCUDA::test_baddbmm_cuda_float32 PASSED [0.0084s] [ 4%] 2025-09-07T09:47:12.5815384Z test_sparse_csr.py::TestSparseCSRCUDA::test_baddbmm_cuda_float64 PASSED [0.0082s] [ 4%] 2025-09-07T09:47:12.5815676Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_False_cuda_float32 PASSED [0.2867s] [ 4%] 2025-09-07T09:47:12.5816036Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_False_cuda_float64 PASSED [0.0686s] [ 4%] 2025-09-07T09:47:12.5816377Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_bfloat16 PASSED [0.3282s] [ 4%] 2025-09-07T09:47:12.5816721Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_complex128 PASSED [0.0532s] [ 4%] 2025-09-07T09:47:12.5817063Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_complex64 PASSED [0.0508s] [ 4%] 2025-09-07T09:47:12.5817400Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int32_noncontiguous_True_cuda_float16 PASSED [0.0583s] [ 4%] 2025-09-07T09:47:12.5817737Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_False_cuda_bfloat16 PASSED [0.0545s] [ 4%] 2025-09-07T09:47:12.5818075Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_False_cuda_float32 PASSED [0.0533s] [ 4%] 2025-09-07T09:47:12.5818436Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_False_cuda_float64 PASSED [0.0457s] [ 4%] 2025-09-07T09:47:12.5818772Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_bfloat16 PASSED [0.0553s] [ 4%] 2025-09-07T09:47:12.5819108Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_complex128 PASSED [0.0508s] [ 4%] 2025-09-07T09:47:12.5819444Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_float16 PASSED [0.0485s] [ 4%] 2025-09-07T09:47:12.5819778Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_2_int64_noncontiguous_True_cuda_float32 PASSED [0.0499s] [ 4%] 2025-09-07T09:47:12.5820113Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_bfloat16 PASSED [0.0479s] [ 4%] 2025-09-07T09:47:12.5820458Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_complex128 PASSED [0.0531s] [ 4%] 2025-09-07T09:47:12.5820799Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_float16 PASSED [0.0480s] [ 4%] 2025-09-07T09:47:12.5821140Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_False_cuda_float64 PASSED [0.0398s] [ 4%] 2025-09-07T09:47:12.5821477Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int32_noncontiguous_True_cuda_bfloat16 PASSED [0.0482s] [ 4%] 2025-09-07T09:47:12.5821815Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_False_cuda_complex128 PASSED [0.0450s] [ 5%] 2025-09-07T09:47:12.5822153Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_False_cuda_complex64 PASSED [0.0457s] [ 5%] 2025-09-07T09:47:12.5822490Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_False_cuda_float16 PASSED [0.0478s] [ 5%] 2025-09-07T09:47:12.5822842Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_complex128 PASSED [0.0515s] [ 5%] 2025-09-07T09:47:12.5823247Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_complex64 PASSED [0.0518s] [ 5%] 2025-09-07T09:47:12.5823580Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_float16 PASSED [0.0505s] [ 5%] 2025-09-07T09:47:12.5823909Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_float32 PASSED [0.0518s] [ 5%] 2025-09-07T09:47:12.5824237Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmm_block_size_3_int64_noncontiguous_True_cuda_float64 PASSED [0.0429s] [ 5%] 2025-09-07T09:47:12.5824570Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_False_cuda_complex128 PASSED [0.0639s] [ 5%] 2025-09-07T09:47:12.5824929Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_False_cuda_complex64 PASSED [0.0069s] [ 5%] 2025-09-07T09:47:12.5825263Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_False_cuda_float32 PASSED [0.0069s] [ 5%] 2025-09-07T09:47:12.5825594Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int32_noncontiguous_True_cuda_float32 PASSED [0.0054s] [ 5%] 2025-09-07T09:47:12.5825928Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int64_noncontiguous_False_cuda_complex128 PASSED [0.0075s] [ 5%] 2025-09-07T09:47:12.5826263Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int64_noncontiguous_False_cuda_float64 PASSED [0.0077s] [ 5%] 2025-09-07T09:47:12.5826596Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_2_int64_noncontiguous_True_cuda_complex64 PASSED [0.0055s] [ 5%] 2025-09-07T09:47:12.5826950Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int32_noncontiguous_False_cuda_complex128 PASSED [0.0306s] [ 5%] 2025-09-07T09:47:12.5827284Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int32_noncontiguous_False_cuda_float32 PASSED [0.0090s] [ 5%] 2025-09-07T09:47:12.5827617Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int32_noncontiguous_True_cuda_complex128 PASSED [0.0054s] [ 5%] 2025-09-07T09:47:12.5827955Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_False_cuda_complex128 PASSED [0.0089s] [ 5%] 2025-09-07T09:47:12.5828289Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_False_cuda_float32 PASSED [0.0088s] [ 5%] 2025-09-07T09:47:12.5828621Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_True_cuda_complex64 PASSED [0.0055s] [ 5%] 2025-09-07T09:47:12.5828952Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_addmv_block_size_3_int64_noncontiguous_True_cuda_float32 PASSED [0.0053s] [ 5%] 2025-09-07T09:47:12.5829303Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_False_cuda_complex128 PASSED [0.1527s] [ 5%] 2025-09-07T09:47:12.5829674Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_False_cuda_complex64 PASSED [0.0313s] [ 5%] 2025-09-07T09:47:12.5830035Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_False_cuda_float32 PASSED [0.0298s] [ 5%] 2025-09-07T09:47:12.5830398Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int32_noncontiguous_True_cuda_complex64 PASSED [0.0274s] [ 6%] 2025-09-07T09:47:12.5830769Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_complex128 PASSED [0.0303s] [ 6%] 2025-09-07T09:47:12.5831135Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_complex64 PASSED [0.0325s] [ 6%] 2025-09-07T09:47:12.5831517Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_float32 PASSED [0.0322s] [ 6%] 2025-09-07T09:47:12.5831890Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_False_cuda_float64 PASSED [0.0311s] [ 6%] 2025-09-07T09:47:12.5832252Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_True_cuda_complex128 PASSED [0.0303s] [ 6%] 2025-09-07T09:47:12.5832613Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_2_int64_noncontiguous_True_cuda_complex64 PASSED [0.0296s] [ 6%] 2025-09-07T09:47:12.5832977Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int32_noncontiguous_False_cuda_complex128 PASSED [0.0318s] [ 6%] 2025-09-07T09:47:12.5833404Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int32_noncontiguous_False_cuda_complex64 PASSED [0.0316s] [ 6%] 2025-09-07T09:47:12.5833768Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int32_noncontiguous_True_cuda_complex64 PASSED [0.0304s] [ 6%] 2025-09-07T09:47:12.5834128Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int64_noncontiguous_False_cuda_float32 PASSED [0.0319s] [ 6%] 2025-09-07T09:47:12.5834487Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int64_noncontiguous_True_cuda_complex128 PASSED [0.0298s] [ 6%] 2025-09-07T09:47:12.5834846Z test_sparse_csr.py::TestSparseCSRCUDA::test_block_triangular_solve_block_size_3_int64_noncontiguous_True_cuda_float64 PASSED [0.0290s] [ 6%] 2025-09-07T09:47:12.5835146Z test_sparse_csr.py::TestSparseCSRCUDA::test_bmm_cuda_complex64 PASSED [0.0093s] [ 6%] 2025-09-07T09:47:12.5835375Z test_sparse_csr.py::TestSparseCSRCUDA::test_bmm_cuda_float32 PASSED [0.0088s] [ 6%] 2025-09-07T09:47:12.5839976Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSC_SparseBSC_cuda PASSED [0.0122s] [ 6%] 2025-09-07T09:47:12.5840333Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSC_SparseCSR_cuda PASSED [0.0027s] [ 6%] 2025-09-07T09:47:12.5840683Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSR_SparseBSR_cuda PASSED [0.0034s] [ 6%] 2025-09-07T09:47:12.5841027Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseBSR_SparseCSC_cuda PASSED [0.0025s] [ 6%] 2025-09-07T09:47:12.5841374Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSC_SparseCSC_cuda PASSED [0.0029s] [ 6%] 2025-09-07T09:47:12.5841718Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSR_SparseBSC_cuda PASSED [0.0021s] [ 6%] 2025-09-07T09:47:12.5842067Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSR_SparseCSC_cuda PASSED [0.0039s] [ 6%] 2025-09-07T09:47:12.5842411Z test_sparse_csr.py::TestSparseCSRCUDA::test_compressed_layout_conversions_coverage_SparseCSR_SparseCSR_cuda PASSED [0.0027s] [ 6%] 2025-09-07T09:47:12.5842722Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_complex128 PASSED [0.0140s] [ 6%] 2025-09-07T09:47:12.5842991Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_complex64 PASSED [0.0040s] [ 7%] 2025-09-07T09:47:12.5843319Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_float32 PASSED [0.0036s] [ 7%] 2025-09-07T09:47:12.5843577Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_float64 PASSED [0.0034s] [ 7%] 2025-09-07T09:47:12.5843832Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int16 PASSED [0.0031s] [ 7%] 2025-09-07T09:47:12.5844087Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int32 PASSED [0.0028s] [ 7%] 2025-09-07T09:47:12.5844381Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int64 PASSED [0.0028s] [ 7%] 2025-09-07T09:47:12.5844632Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_csr_conversion_cuda_int8 PASSED [0.0027s] [ 7%] 2025-09-07T09:47:12.5844908Z test_sparse_csr.py::TestSparseCSRCUDA::test_coo_to_csr_convert_cuda_float64 PASSED [0.0324s] [ 7%] 2025-09-07T09:47:12.5845167Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_bfloat16 PASSED [0.0038s] [ 7%] 2025-09-07T09:47:12.5846869Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_float16 PASSED [0.0034s] [ 7%] 2025-09-07T09:47:12.5847134Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_float64 PASSED [0.0034s] [ 7%] 2025-09-07T09:47:12.5847386Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_int16 PASSED [0.0027s] [ 7%] 2025-09-07T09:47:12.5847633Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_coo_conversion_cuda_int8 PASSED [0.0027s] [ 7%] 2025-09-07T09:47:12.5847971Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_bfloat16 SKIPPED [0.0005s] (ROCm doesn't work with half dtypes correctly.) [ 7%] 2025-09-07T09:47:12.5848276Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_complex64 PASSED [0.0705s] [ 7%] 2025-09-07T09:47:12.5848520Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_float32 PASSED [0.0244s] [ 7%] 2025-09-07T09:47:12.5848760Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_matvec_cuda_float64 PASSED [0.0241s] [ 7%] 2025-09-07T09:47:12.5848992Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_storage_cuda PASSED [0.0012s] [ 7%] 2025-09-07T09:47:12.5849213Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_stride_cuda PASSED [0.0011s] [ 7%] 2025-09-07T09:47:12.5849468Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_to_block_csr_blocksize_2_cuda_float64_int32 PASSED [0.0111s] [ 7%] 2025-09-07T09:47:12.5850995Z test_sparse_csr.py::TestSparseCSRCUDA::test_csr_to_block_csr_blocksize_4_cuda_float64_int64 PASSED [0.0230s] [ 7%] 2025-09-07T09:47:12.5851357Z test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSC_NonBatched_Hybrid_cuda PASSED [0.0145s] [ 7%] 2025-09-07T09:47:12.5851699Z test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSC_NonBatched_NonHybrid_cuda PASSED [0.0091s] [ 7%] 2025-09-07T09:47:12.5852040Z test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSR_Batched_NonHybrid_cuda PASSED [0.1211s] [ 7%] 2025-09-07T09:47:12.5852375Z test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSR_NonBatched_Hybrid_cuda PASSED [0.0137s] [ 8%] 2025-09-07T09:47:12.5852716Z test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseBSR_NonBatched_NonHybrid_cuda PASSED [0.0080s] [ 8%] 2025-09-07T09:47:12.5853059Z test_sparse_csr.py::TestSparseCSRCUDA::test_dense_to_from_sparse_compressed_SparseCSC_NonBatched_NonHybrid_cuda PASSED [0.0028s] [ 8%] 2025-09-07T09:47:12.5853443Z test_sparse_csr.py::TestSparseCSRCUDA::test_direct_coo_csr_conversion_cuda_complex128 PASSED [0.0038s] [ 8%] 2025-09-07T09:47:12.5853718Z test_sparse_csr.py::TestSparseCSRCUDA::test_direct_coo_csr_conversion_cuda_int16 PASSED [0.0029s] [ 8%] 2025-09-07T09:47:12.5853985Z test_sparse_csr.py::TestSparseCSRCUDA::test_direct_coo_csr_conversion_cuda_uint8 PASSED [0.0028s] [ 8%] 2025-09-07T09:47:12.5854242Z test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_float16 PASSED [0.0022s] [ 8%] 2025-09-07T09:47:12.5855559Z test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_int16 PASSED [0.0019s] [ 8%] 2025-09-07T09:47:12.5855811Z test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_int32 PASSED [0.0019s] [ 8%] 2025-09-07T09:47:12.5856057Z test_sparse_csr.py::TestSparseCSRCUDA::test_exercise_detach_cuda_int8 PASSED [0.0019s] [ 8%] 2025-09-07T09:47:12.5856310Z test_sparse_csr.py::TestSparseCSRCUDA::test_matmul_device_mismatch_cuda_float64 PASSED [0.0659s] [ 8%] 2025-09-07T09:47:12.5856590Z test_sparse_csr.py::TestSparseCSRCUDA::test_mm_errors_cuda_float32 PASSED [0.0011s] [ 8%] 2025-09-07T09:47:12.5856818Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_cuda_float32 PASSED [0.2196s] [ 8%] 2025-09-07T09:47:12.5857097Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_bool PASSED [0.3760s] [ 8%] 2025-09-07T09:47:12.5857411Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_complex128 PASSED [0.7497s] [ 8%] 2025-09-07T09:47:12.5857727Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_complex64 PASSED [0.6216s] [ 8%] 2025-09-07T09:47:12.5858039Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_float16 PASSED [0.5505s] [ 8%] 2025-09-07T09:47:12.5858345Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_float32 PASSED [0.6110s] [ 8%] 2025-09-07T09:47:12.5859700Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_float64 PASSED [0.5474s] [ 8%] 2025-09-07T09:47:12.5860011Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_int32 PASSED [0.3952s] [ 8%] 2025-09-07T09:47:12.5860318Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_int64 PASSED [0.4182s] [ 8%] 2025-09-07T09:47:12.5860621Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_int8 PASSED [0.4143s] [ 8%] 2025-09-07T09:47:12.5860924Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSC_cuda_uint8 PASSED [0.3906s] [ 8%] 2025-09-07T09:47:12.5861236Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_complex128 PASSED [0.5694s] [ 8%] 2025-09-07T09:47:12.5861553Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_complex64 PASSED [0.5710s] [ 9%] 2025-09-07T09:47:12.5861894Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_float32 PASSED [0.6107s] [ 9%] 2025-09-07T09:47:12.5862201Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_float64 PASSED [0.6133s] [ 9%] 2025-09-07T09:47:12.5862504Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseBSR_cuda_int8 PASSED [0.4197s] [ 9%] 2025-09-07T09:47:12.5862808Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_bfloat16 PASSED [0.6102s] [ 9%] 2025-09-07T09:47:12.5864186Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_bool PASSED [0.3228s] [ 9%] 2025-09-07T09:47:12.5864496Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_complex128 PASSED [0.6922s] [ 9%] 2025-09-07T09:47:12.5864811Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_complex64 PASSED [0.6981s] [ 9%] 2025-09-07T09:47:12.5865127Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_float16 PASSED [0.5599s] [ 9%] 2025-09-07T09:47:12.5865432Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_float64 PASSED [0.6238s] [ 9%] 2025-09-07T09:47:12.5865736Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_int16 PASSED [0.4267s] [ 9%] 2025-09-07T09:47:12.5866037Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_int64 PASSED [0.4279s] [ 9%] 2025-09-07T09:47:12.5866336Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSC_cuda_int8 PASSED [0.4384s] [ 9%] 2025-09-07T09:47:12.5866639Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_bfloat16 PASSED [0.6261s] [ 9%] 2025-09-07T09:47:12.5866943Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_bool PASSED [0.3339s] [ 9%] 2025-09-07T09:47:12.5867280Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_complex64 PASSED [0.7123s] [ 9%] 2025-09-07T09:47:12.5868626Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_int16 PASSED [0.4233s] [ 9%] 2025-09-07T09:47:12.5868952Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_int64 PASSED [0.4235s] [ 9%] 2025-09-07T09:47:12.5869254Z test_sparse_csr.py::TestSparseCSRCUDA::test_mul_scalar_enable_hybrid_False_SparseCSR_cuda_int8 PASSED [0.4230s] [ 9%] 2025-09-07T09:47:12.5869553Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSC_cuda_bool PASSED [0.0168s] [ 9%] 2025-09-07T09:47:12.5869854Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSC_cuda_float32 PASSED [0.0159s] [ 9%] 2025-09-07T09:47:12.5870173Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSR_cuda_bool PASSED [0.0134s] [ 9%] 2025-09-07T09:47:12.5870473Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseBSR_cuda_float32 PASSED [0.0133s] [ 9%] 2025-09-07T09:47:12.5870771Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseCSR_cuda_bool PASSED [0.0323s] [ 9%] 2025-09-07T09:47:12.5871070Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_as_sparse_compressed_SparseCSR_cuda_float32 PASSED [0.0326s] [ 10%] 2025-09-07T09:47:12.5871337Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_bfloat16 PASSED [0.0021s] [ 10%] 2025-09-07T09:47:12.5872565Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_bool PASSED [0.0021s] [ 10%] 2025-09-07T09:47:12.5872796Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_float16 PASSED [0.0020s] [ 10%] 2025-09-07T09:47:12.5873020Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_int8 PASSED [0.0020s] [ 10%] 2025-09-07T09:47:12.5873327Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_cuda_uint8 PASSED [0.0021s] [ 10%] 2025-09-07T09:47:12.5873566Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_bfloat16 PASSED [0.0016s] [ 10%] 2025-09-07T09:47:12.5873818Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_complex64 PASSED [0.0015s] [ 10%] 2025-09-07T09:47:12.5874068Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_float16 PASSED [0.0015s] [ 10%] 2025-09-07T09:47:12.5874310Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_float32 PASSED [0.0014s] [ 10%] 2025-09-07T09:47:12.5874548Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_float64 PASSED [0.0014s] [ 10%] 2025-09-07T09:47:12.5874786Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_int16 PASSED [0.0014s] [ 10%] 2025-09-07T09:47:12.5875021Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_int32 PASSED [0.0015s] [ 10%] 2025-09-07T09:47:12.5876286Z test_sparse_csr.py::TestSparseCSRCUDA::test_resize_errors_cuda_int8 PASSED [0.0015s] [ 10%] 2025-09-07T09:47:12.5876554Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_autograd_cuda_complex128 PASSED [0.0044s] [ 10%] 2025-09-07T09:47:12.5876825Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_autograd_cuda_float64 PASSED [0.0030s] [ 10%] 2025-09-07T09:47:12.5877088Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_cuda_complex128 PASSED [1.1891s] [ 10%] 2025-09-07T09:47:12.5877340Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_cuda_complex64 PASSED [1.1741s] [ 10%] 2025-09-07T09:47:12.5877585Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_cuda_float64 PASSED [1.2942s] [ 10%] 2025-09-07T09:47:12.5877840Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_errors_cuda_complex128 PASSED [0.0021s] [ 10%] 2025-09-07T09:47:12.5878104Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_errors_cuda_float64 PASSED [0.0014s] [ 10%] 2025-09-07T09:47:12.5878375Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_zero_sized_cuda_complex128 PASSED [0.0012s] [ 10%] 2025-09-07T09:47:12.5878676Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_zero_sized_cuda_float32 PASSED [0.0011s] [ 10%] 2025-09-07T09:47:12.5878944Z test_sparse_csr.py::TestSparseCSRCUDA::test_sampled_addmm_zero_sized_cuda_float64 PASSED [0.0011s] [ 10%] 2025-09-07T09:47:12.5880491Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float16 :0:rocdevice.cpp :2992: 2706675491392 us: Callback: Queue 0x7fca42b00000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016 2025-09-07T09:47:12.5880913Z Fatal Python error: Aborted 2025-09-07T09:47:12.5880985Z 2025-09-07T09:47:12.5881047Z Thread 0x00007fc9fddff6c0 (most recent call first): 2025-09-07T09:47:12.5881178Z 2025-09-07T09:47:12.5881235Z 2025-09-07T09:47:12.5881290Z Thread 0x00007fd52aa2e600 (most recent call first): 2025-09-07T09:47:12.5881589Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3614 in random_sparse_compressed 2025-09-07T09:47:12.5881978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3629 in genSparseCompressedTensor 2025-09-07T09:47:12.5882290Z File "/var/lib/jenkins/pytorch/test/test_sparse_csr.py", line 1104 in test_select 2025-09-07T09:47:12.5882579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 698 in test_wrapper 2025-09-07T09:47:12.5882936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 426 in instantiated_test 2025-09-07T09:47:12.5883367Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3224 in wrapper 2025-09-07T09:47:12.5884789Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3224 in wrapper 2025-09-07T09:47:12.5885107Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 589 in _callTestMethod 2025-09-07T09:47:12.5885333Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 634 in run 2025-09-07T09:47:12.5885609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3376 in _run_custom 2025-09-07T09:47:12.5885939Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3406 in run 2025-09-07T09:47:12.5886263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 517 in run 2025-09-07T09:47:12.5886538Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 690 in __call__ 2025-09-07T09:47:12.5886778Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/unittest.py", line 333 in runtest 2025-09-07T09:47:12.5887058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/runner.py", line 169 in pytest_runtest_call 2025-09-07T09:47:12.5887338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_callers.py", line 121 in _multicall 2025-09-07T09:47:12.5887602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_manager.py", line 120 in _hookexec 2025-09-07T09:47:12.5888895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_hooks.py", line 512 in __call__ 2025-09-07T09:47:12.5889156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/runner.py", line 262 in 2025-09-07T09:47:12.5889414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/runner.py", line 341 in from_call 2025-09-07T09:47:12.5889687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/runner.py", line 261 in call_runtest_hook 2025-09-07T09:47:12.5889971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/runner.py", line 222 in call_and_report 2025-09-07T09:47:12.5890314Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/runner.py", line 133 in runtestprotocol 2025-09-07T09:47:12.5890646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pytest_rerunfailures.py", line 549 in pytest_runtest_protocol 2025-09-07T09:47:12.5890961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_callers.py", line 121 in _multicall 2025-09-07T09:47:12.5891224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_manager.py", line 120 in _hookexec 2025-09-07T09:47:12.5891480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_hooks.py", line 512 in __call__ 2025-09-07T09:47:12.5891750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/main.py", line 348 in pytest_runtestloop 2025-09-07T09:47:12.5893159Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_callers.py", line 121 in _multicall 2025-09-07T09:47:12.5893422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_manager.py", line 120 in _hookexec 2025-09-07T09:47:12.5893721Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_hooks.py", line 512 in __call__ 2025-09-07T09:47:12.5893973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/main.py", line 323 in _main 2025-09-07T09:47:12.5894229Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/main.py", line 269 in wrap_session 2025-09-07T09:47:12.5894504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/main.py", line 316 in pytest_cmdline_main 2025-09-07T09:47:12.5894780Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_callers.py", line 121 in _multicall 2025-09-07T09:47:12.5895042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_manager.py", line 120 in _hookexec 2025-09-07T09:47:12.5895298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/pluggy/_hooks.py", line 512 in __call__ 2025-09-07T09:47:12.5895584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/_pytest/config/__init__.py", line 166 in main 2025-09-07T09:47:12.5896922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1299 in run_tests 2025-09-07T09:47:12.5898850Z File "/var/lib/jenkins/pytorch/test/test_sparse_csr.py", line 4333 in 2025-09-07T09:47:12.5898985Z 2025-09-07T09:47:12.5904306Z Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._dynamo.autograd_compiler, torch._C._dynamo.eval_frame, torch._C._dynamo.guards, torch._C._dynamo.utils, torch._C._fft, torch._C._linalg, torch._C._nested, torch._C._nn, torch._C._sparse, torch._C._special, multidict._multidict, yarl._quoting_c, propcache._helpers_c, aiohttp._http_writer, aiohttp._http_parser, aiohttp._websocket.mask, aiohttp._websocket.reader_c, frozenlist._frozenlist, charset_normalizer.md, requests.packages.charset_normalizer.md, requests.packages.chardet.md, thriftpy2.transport.cybase, thriftpy2.transport.buffered.cybuffered, thriftpy2.transport.framed.cyframed, thriftpy2.transport.memory.cymemory, thriftpy2.transport.sasl.cysasl, thriftpy2.protocol.cybin.cybin, scipy._lib._ccallback_c, yaml._yaml, numba.core.typeconv._typeconv, numba._helperlib, numba._dynfunc, numba._dispatcher, numba.core.runtime._nrt_python, numba.np.ufunc._internal, numba.experimental.jitclass._box, numba.mviewbuf, numba.types.itertools, psutil._psutil_linux, psutil._psutil_posix, scipy._lib._uarray._uarray, scipy.special._ufuncs_cxx, scipy.special._ufuncs, scipy.special._specfun, scipy.special._comb, scipy.linalg._fblas, scipy.linalg._flapack, scipy.linalg.cython_lapack, scipy.linalg._cythonized_array_utils, scipy.linalg._solve_toeplitz, scipy.linalg._decomp_lu_cython, scipy.linalg._matfuncs_sqrtm_triu, scipy.linalg.cython_blas, scipy.linalg._matfuncs_expm, scipy.linalg._decomp_update, scipy.sparse._sparsetools, _csparsetools, scipy.sparse._csparsetools, scipy.sparse.linalg._dsolve._superlu, scipy.sparse.linalg._eigen.arpack._arpack, scipy.sparse.linalg._propack._spropack, scipy.sparse.linalg._propack._dpropack, scipy.sparse.linalg._propack._cpropack, scipy.sparse.linalg._propack._zpropack, scipy.sparse.csgraph._tools, scipy.sparse.csgraph._shortest_path, scipy.sparse.csgraph._traversal, scipy.sparse.csgraph._min_spanning_tree, scipy.sparse.csgraph._flow, scipy.sparse.csgraph._matching, scipy.sparse.csgraph._reordering, scipy.special._ellip_harm_2, scipy.signal._sigtools, scipy.signal._max_len_seq_inner, scipy.signal._upfirdn_apply, scipy.signal._spline, scipy.spatial._ckdtree, scipy._lib.messagestream, scipy.spatial._qhull, scipy.spatial._voronoi, scipy.spatial._distance_wrap, scipy.spatial._hausdorff, scipy.spatial.transform._rotation, scipy.interpolate._fitpack, scipy.interpolate._dfitpack, scipy.optimize._group_columns, scipy.optimize._trlib._trlib, scipy.optimize._lbfgsb, _moduleTNC, scipy.optimize._moduleTNC, scipy.optimize._cobyla, scipy.optimize._slsqp, scipy.optimize._minpack, scipy.optimize._lsq.givens_elimination, scipy.optimize._zeros, scipy.optimize._highs.cython.src._highs_wrapper, scipy.optimize._highs._highs_wrapper, scipy.optimize._highs.cython.src._highs_constants, scipy.optimize._highs._highs_constants, scipy.linalg._interpolative, scipy.optimize._bglu_dense, scipy.optimize._lsap, scipy.optimize._direct, scipy.interpolate._bspl, scipy.interpolate._ppoly, scipy.interpolate.interpnd, scipy.interpolate._rbfinterp_pythran, scipy.interpolate._rgi_cython, scipy.ndimage._nd_image, _ni_label, scipy.ndimage._ni_label, scipy.signal._sosfilt, scipy.signal._spectral, scipy.integrate._odepack, scipy.integrate._quadpack, scipy.integrate._vode, scipy.integrate._dop, scipy.integrate._lsoda, scipy.special.cython_special, scipy.stats._stats, scipy.stats._biasedurn, scipy.stats._levy_stable.levyst, scipy.stats._stats_pythran, scipy.stats._ansari_swilk_statistics, scipy.stats._sobol, scipy.stats._qmc_cy, scipy.stats._mvn, scipy.stats._rcont.rcont, scipy.stats._unuran.unuran_wrapper, scipy.signal._peak_finding_utils (total: 144) 2025-09-07T09:47:12.5909668Z Got exit code -6 (SIGIOT) 2025-09-07T09:47:12.5909853Z Retrying single test... 2025-09-07T09:47:12.5910350Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T09:47:12.5910831Z import pkg_resources 2025-09-07T09:47:12.5911028Z Test results will be stored in test-reports/python-pytest/test_sparse_csr/test_sparse_csr-7bcd925ceaa6ac0d.xml 2025-09-07T09:47:12.5911256Z ============================= test session starts ============================== 2025-09-07T09:47:12.5913191Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T09:47:12.5913378Z cachedir: .pytest_cache 2025-09-07T09:47:12.5913598Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T09:47:12.5913834Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T09:47:12.5913948Z configfile: pytest.ini 2025-09-07T09:47:12.5914169Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T09:47:12.5914441Z collecting ... collected 4958 items / 2416 deselected / 2542 selected 2025-09-07T09:47:12.5914726Z stepcurrent: skipping 265 already run items. Running only test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float16 2025-09-07T09:47:12.5914973Z Running 1 items in this shard 2025-09-07T09:47:12.5915046Z 2025-09-07T09:47:12.5915304Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float16 [W907 09:42:54.496543048 Module.cpp:190] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1... 2025-09-07T09:47:12.5915631Z 2025-09-07T09:47:12.5915780Z [W907 09:42:55.773345644 Module.cpp:190] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1... 2025-09-07T09:47:12.5915966Z 2025-09-07T09:47:12.5917279Z [W907 09:42:55.817023205 Module.cpp:190] symbolizing C++ stack trace for exception; if this hangs, rerun with TORCH_DISABLE_ADDR2LINE=1... 2025-09-07T09:47:12.5917465Z 2025-09-07T09:47:12.5917505Z PASSED [0.5602s] [100%] 2025-09-07T09:47:12.5917566Z 2025-09-07T09:47:12.5917751Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_sparse_csr/test_sparse_csr-7bcd925ceaa6ac0d.xml - 2025-09-07T09:47:12.5918033Z ====================== 1 passed, 2416 deselected in 0.66s ====================== 2025-09-07T09:47:12.5918170Z Got exit code 0 2025-09-07T09:47:12.5918339Z Test succeeeded in new process, continuing with the rest of the tests 2025-09-07T09:47:12.5918871Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T09:47:12.5919354Z import pkg_resources 2025-09-07T09:47:12.5919548Z Test results will be stored in test-reports/python-pytest/test_sparse_csr/test_sparse_csr-44dd32f10c369488.xml 2025-09-07T09:47:12.5919773Z ============================= test session starts ============================== 2025-09-07T09:47:12.5919976Z platform linux -- Python 3.12.11, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-09-07T09:47:12.5921193Z cachedir: .pytest_cache 2025-09-07T09:47:12.5921439Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-09-07T09:47:12.5921671Z rootdir: /var/lib/jenkins/pytorch 2025-09-07T09:47:12.5921783Z configfile: pytest.ini 2025-09-07T09:47:12.5922022Z plugins: hypothesis-5.35.1, subtests-0.13.1, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.1.0, typeguard-4.3.0 2025-09-07T09:47:12.5922289Z collecting ... collected 4958 items / 266 deselected / 4692 selected 2025-09-07T09:47:12.5922451Z stepcurrent: skipping 266 already run items. 2025-09-07T09:47:12.5922577Z Running 2151 items in this shard 2025-09-07T09:47:12.5922647Z 2025-09-07T09:47:12.5922770Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float32 PASSED [0.2393s] [ 0%] 2025-09-07T09:47:12.5923039Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float64 PASSED [0.0127s] [ 0%] 2025-09-07T09:47:12.5923363Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int16 PASSED [0.0116s] [ 0%] 2025-09-07T09:47:12.5924642Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int32 PASSED [0.0065s] [ 0%] 2025-09-07T09:47:12.5924906Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int64 PASSED [0.0064s] [ 0%] 2025-09-07T09:47:12.5925166Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_int8 PASSED [0.0063s] [ 0%] 2025-09-07T09:47:12.5925430Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_bfloat16 PASSED [0.0157s] [ 0%] 2025-09-07T09:47:12.5925692Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_bool PASSED [0.0065s] [ 0%] 2025-09-07T09:47:12.5925959Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_complex128 PASSED [0.0081s] [ 0%] 2025-09-07T09:47:12.5926230Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_complex64 PASSED [0.0081s] [ 0%] 2025-09-07T09:47:12.5926497Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_float32 PASSED [0.0067s] [ 0%] 2025-09-07T09:47:12.5926789Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int64_cuda_float64 PASSED [0.0069s] [ 0%] 2025-09-07T09:47:12.5927052Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_bfloat16 PASSED [0.0057s] [ 0%] 2025-09-07T09:47:12.5927315Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_bool PASSED [0.0051s] [ 0%] 2025-09-07T09:47:12.5928552Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_complex64 PASSED [0.0056s] [ 0%] 2025-09-07T09:47:12.5928821Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_float16 PASSED [0.0056s] [ 0%] 2025-09-07T09:47:12.5929084Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_float32 PASSED [0.0055s] [ 0%] 2025-09-07T09:47:12.5929346Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_float64 PASSED [0.0055s] [ 0%] 2025-09-07T09:47:12.5929646Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_int8 PASSED [0.0052s] [ 0%] 2025-09-07T09:47:12.5929907Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int32_cuda_uint8 PASSED [0.0051s] [ 0%] 2025-09-07T09:47:12.5930247Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_bfloat16 PASSED [0.0055s] [ 0%] 2025-09-07T09:47:12.5930506Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_bool PASSED [0.0050s] [ 1%] 2025-09-07T09:47:12.5930771Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_complex128 PASSED [0.0058s] [ 1%] 2025-09-07T09:47:12.5931041Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_complex64 PASSED [0.0057s] [ 1%] 2025-09-07T09:47:12.5931305Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_float32 PASSED [0.0055s] [ 1%] 2025-09-07T09:47:12.5932560Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_int16 PASSED [0.0050s] [ 1%] 2025-09-07T09:47:12.5932851Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSR_int64_cuda_uint8 PASSED [0.0049s] [ 1%] 2025-09-07T09:47:12.5933237Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int16 PASSED [0.0289s] [ 1%] 2025-09-07T09:47:12.5933515Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int32 PASSED [0.0100s] [ 1%] 2025-09-07T09:47:12.5933773Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int64 PASSED [0.0100s] [ 1%] 2025-09-07T09:47:12.5934030Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int32_cuda_int8 PASSED [0.0099s] [ 1%] 2025-09-07T09:47:12.5934292Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_bfloat16 PASSED [0.0106s] [ 1%] 2025-09-07T09:47:12.5934552Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_bool PASSED [0.0093s] [ 1%] 2025-09-07T09:47:12.5934815Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_complex128 PASSED [0.0097s] [ 1%] 2025-09-07T09:47:12.5935088Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_complex64 PASSED [0.0096s] [ 1%] 2025-09-07T09:47:12.5936351Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_float32 PASSED [0.0096s] [ 1%] 2025-09-07T09:47:12.5936620Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_float64 PASSED [0.0095s] [ 1%] 2025-09-07T09:47:12.5936879Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_int16 PASSED [0.0092s] [ 1%] 2025-09-07T09:47:12.5937136Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSC_int64_cuda_int32 PASSED [0.0089s] [ 1%] 2025-09-07T09:47:12.5937396Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_bfloat16 PASSED [0.0069s] [ 1%] 2025-09-07T09:47:12.5937657Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_bool PASSED [0.0064s] [ 1%] 2025-09-07T09:47:12.5937923Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_complex128 PASSED [0.0071s] [ 1%] 2025-09-07T09:47:12.5938220Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_complex64 PASSED [0.0070s] [ 1%] 2025-09-07T09:47:12.5938487Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_float16 PASSED [0.0069s] [ 2%] 2025-09-07T09:47:12.5938748Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_float32 PASSED [0.0069s] [ 2%] 2025-09-07T09:47:12.5939007Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_int16 PASSED [0.0065s] [ 2%] 2025-09-07T09:47:12.5940238Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_int32 PASSED [0.0065s] [ 2%] 2025-09-07T09:47:12.5940501Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_int8 PASSED [0.0065s] [ 2%] 2025-09-07T09:47:12.5940757Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int32_cuda_uint8 PASSED [0.0065s] [ 2%] 2025-09-07T09:47:12.5941045Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_bfloat16 PASSED [0.0070s] [ 2%] 2025-09-07T09:47:12.5941316Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_complex128 PASSED [0.0070s] [ 2%] 2025-09-07T09:47:12.5941587Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_complex64 PASSED [0.0070s] [ 2%] 2025-09-07T09:47:12.5941851Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_float16 PASSED [0.0071s] [ 2%] 2025-09-07T09:47:12.5942112Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_int32 PASSED [0.0065s] [ 2%] 2025-09-07T09:47:12.5942370Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_int64 PASSED [0.0064s] [ 2%] 2025-09-07T09:47:12.5942628Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_int8 PASSED [0.0064s] [ 2%] 2025-09-07T09:47:12.5942884Z test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseCSR_int64_cuda_uint8 PASSED [0.0066s] [ 2%] 2025-09-07T09:47:12.5944202Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_add_cuda_complex128 PASSED [0.2236s] [ 2%] 2025-09-07T09:47:12.5944455Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_add_cuda_complex64 PASSED [0.2122s] [ 2%] 2025-09-07T09:47:12.5944721Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_add_cuda_float32 PASSED [0.2014s] [ 2%] 2025-09-07T09:47:12.5944976Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_complex128 PASSED [0.0166s] [ 2%] 2025-09-07T09:47:12.5945237Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_complex64 PASSED [0.0042s] [ 2%] 2025-09-07T09:47:12.5945493Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_float64 PASSED [0.0039s] [ 2%] 2025-09-07T09:47:12.5945748Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_int16 PASSED [0.0034s] [ 2%] 2025-09-07T09:47:12.5946001Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csc_to_dense_cuda_uint8 PASSED [0.0032s] [ 3%] 2025-09-07T09:47:12.5946259Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_float16 PASSED [0.0017s] [ 3%] 2025-09-07T09:47:12.5946520Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_float64 PASSED [0.0016s] [ 3%] 2025-09-07T09:47:12.5946777Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_int16 PASSED [0.0015s] [ 3%] 2025-09-07T09:47:12.5948013Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_int32 PASSED [0.0016s] [ 3%] 2025-09-07T09:47:12.5948271Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_from_dense_cuda_uint8 PASSED [0.0015s] [ 3%] 2025-09-07T09:47:12.5948526Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_bfloat16 PASSED [0.0038s] [ 3%] 2025-09-07T09:47:12.5948784Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_complex128 PASSED [0.0041s] [ 3%] 2025-09-07T09:47:12.5949043Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_complex64 PASSED [0.0039s] [ 3%] 2025-09-07T09:47:12.5949331Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_float16 PASSED [0.0038s] [ 3%] 2025-09-07T09:47:12.5949584Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_int16 PASSED [0.0031s] [ 3%] 2025-09-07T09:47:12.5949839Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_to_dense_cuda_int64 PASSED [0.0031s] [ 3%] 2025-09-07T09:47:12.5950110Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_bfloat16 PASSED [0.0314s] [ 3%] 2025-09-07T09:47:12.5950393Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_complex128 PASSED [0.0028s] [ 3%] 2025-09-07T09:47:12.5950677Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_complex32 PASSED [0.0037s] [ 3%] 2025-09-07T09:47:12.5951946Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_complex64 PASSED [0.0027s] [ 3%] 2025-09-07T09:47:12.5952252Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_int16 PASSED [0.0027s] [ 3%] 2025-09-07T09:47:12.5952526Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_int8 PASSED [0.0028s] [ 3%] 2025-09-07T09:47:12.5952797Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_abs_cuda_uint8 PASSED [0.0027s] [ 3%] 2025-09-07T09:47:12.5953182Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_bool SKIPPED [0.0021s] (Skipped! Inplace variant not supported!) [ 3%] 2025-09-07T09:47:12.5953579Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_complex128 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 3%] 2025-09-07T09:47:12.5953979Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_complex32 SKIPPED [0.0024s] (Skipped! Inplace variant not supported!) [ 3%] 2025-09-07T09:47:12.5954372Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_float32 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 4%] 2025-09-07T09:47:12.5954781Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_angle_cuda_uint8 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 4%] 2025-09-07T09:47:12.5955135Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_bfloat16 PASSED [0.0082s] [ 4%] 2025-09-07T09:47:12.5955422Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_complex128 PASSED [0.0030s] [ 4%] 2025-09-07T09:47:12.5956775Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_complex32 PASSED [0.0038s] [ 4%] 2025-09-07T09:47:12.5957058Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_complex64 PASSED [0.0028s] [ 4%] 2025-09-07T09:47:12.5957339Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_float32 PASSED [0.0028s] [ 4%] 2025-09-07T09:47:12.5957622Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_float64 PASSED [0.0029s] [ 4%] 2025-09-07T09:47:12.5957899Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asin_cuda_int16 PASSED [0.0027s] [ 4%] 2025-09-07T09:47:12.5958174Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_bool PASSED [0.0087s] [ 4%] 2025-09-07T09:47:12.5958455Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_complex128 PASSED [0.0029s] [ 4%] 2025-09-07T09:47:12.5958744Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_complex32 PASSED [0.0029s] [ 4%] 2025-09-07T09:47:12.5959030Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_complex64 PASSED [0.0029s] [ 4%] 2025-09-07T09:47:12.5959311Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_int16 PASSED [0.0026s] [ 4%] 2025-09-07T09:47:12.5960577Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_int64 PASSED [0.0025s] [ 4%] 2025-09-07T09:47:12.5960888Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_asinh_cuda_uint8 PASSED [0.0025s] [ 4%] 2025-09-07T09:47:12.5961164Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_bool PASSED [0.0054s] [ 4%] 2025-09-07T09:47:12.5961445Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_complex128 PASSED [0.0038s] [ 4%] 2025-09-07T09:47:12.5961730Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_complex64 PASSED [0.0037s] [ 4%] 2025-09-07T09:47:12.5962010Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_float16 PASSED [0.0028s] [ 4%] 2025-09-07T09:47:12.5962289Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_float32 PASSED [0.0029s] [ 4%] 2025-09-07T09:47:12.5962565Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_float64 PASSED [0.0029s] [ 5%] 2025-09-07T09:47:12.5962864Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_int16 PASSED [0.0026s] [ 5%] 2025-09-07T09:47:12.5963197Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atan_cuda_int64 PASSED [0.0026s] [ 5%] 2025-09-07T09:47:12.5963470Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_bool PASSED [0.0025s] [ 5%] 2025-09-07T09:47:12.5964757Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_complex128 PASSED [0.0038s] [ 5%] 2025-09-07T09:47:12.5965050Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_complex32 PASSED [0.0038s] [ 5%] 2025-09-07T09:47:12.5965336Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_complex64 PASSED [0.0037s] [ 5%] 2025-09-07T09:47:12.5965619Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_float16 PASSED [0.0067s] [ 5%] 2025-09-07T09:47:12.5965930Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_float32 PASSED [0.0029s] [ 5%] 2025-09-07T09:47:12.5966213Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_float64 PASSED [0.0031s] [ 5%] 2025-09-07T09:47:12.5966512Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_int64 PASSED [0.0026s] [ 5%] 2025-09-07T09:47:12.5966789Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_atanh_cuda_int8 PASSED [0.0025s] [ 5%] 2025-09-07T09:47:12.5967065Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_bfloat16 PASSED [0.0127s] [ 5%] 2025-09-07T09:47:12.5967344Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_float16 PASSED [0.0031s] [ 5%] 2025-09-07T09:47:12.5967618Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_int64 PASSED [0.0028s] [ 5%] 2025-09-07T09:47:12.5968875Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_int8 PASSED [0.0027s] [ 5%] 2025-09-07T09:47:12.5969154Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_ceil_cuda_uint8 PASSED [0.0027s] [ 5%] 2025-09-07T09:47:12.5969439Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_bool PASSED [0.0027s] [ 5%] 2025-09-07T09:47:12.5969745Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_complex128 PASSED [0.0058s] [ 5%] 2025-09-07T09:47:12.5970114Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_complex64 PASSED [0.0030s] [ 5%] 2025-09-07T09:47:12.5970426Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_float16 PASSED [0.0027s] [ 5%] 2025-09-07T09:47:12.5970732Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_float64 PASSED [0.0027s] [ 5%] 2025-09-07T09:47:12.5971034Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_int32 PASSED [0.0027s] [ 6%] 2025-09-07T09:47:12.5971361Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_conj_physical_cuda_uint8 PASSED [0.0027s] [ 6%] 2025-09-07T09:47:12.5971654Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_float32 PASSED [0.0031s] [ 6%] 2025-09-07T09:47:12.5971939Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_int32 PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5973270Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_int64 PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5973552Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_deg2rad_cuda_uint8 PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5973830Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_float16 PASSED [0.0097s] [ 6%] 2025-09-07T09:47:12.5974105Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_float64 PASSED [0.0029s] [ 6%] 2025-09-07T09:47:12.5974408Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_int64 PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5974679Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erf_cuda_int8 PASSED [0.0027s] [ 6%] 2025-09-07T09:47:12.5974961Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_bfloat16 PASSED [0.0037s] [ 6%] 2025-09-07T09:47:12.5975245Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_bool PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5975527Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_float32 PASSED [0.0034s] [ 6%] 2025-09-07T09:47:12.5975809Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_erfinv_cuda_uint8 PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5976086Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_bool PASSED [0.0229s] [ 6%] 2025-09-07T09:47:12.5977398Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_complex128 PASSED [0.0036s] [ 6%] 2025-09-07T09:47:12.5977686Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_float16 PASSED [0.0029s] [ 6%] 2025-09-07T09:47:12.5977987Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_int32 PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5978263Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_int8 PASSED [0.0030s] [ 6%] 2025-09-07T09:47:12.5978536Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_expm1_cuda_uint8 PASSED [0.0026s] [ 6%] 2025-09-07T09:47:12.5978812Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_int16 PASSED [0.0028s] [ 6%] 2025-09-07T09:47:12.5979087Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_int32 PASSED [0.0026s] [ 7%] 2025-09-07T09:47:12.5979366Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_int64 PASSED [0.0028s] [ 7%] 2025-09-07T09:47:12.5979642Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_floor_cuda_uint8 PASSED [0.0030s] [ 7%] 2025-09-07T09:47:12.5979919Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_frac_cuda_float16 PASSED [0.0030s] [ 7%] 2025-09-07T09:47:12.5981216Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_frac_cuda_float32 PASSED [0.0028s] [ 7%] 2025-09-07T09:47:12.5981500Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_frac_cuda_float64 PASSED [0.0028s] [ 7%] 2025-09-07T09:47:12.5981839Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_bfloat16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5982235Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_complex32 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5982633Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_complex64 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5983049Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_float16 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5983493Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_float32 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5983882Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_float64 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5984265Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_int32 SKIPPED [0.0022s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5984647Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isinf_cuda_int64 SKIPPED [0.0022s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5985061Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_bfloat16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5986492Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_bool SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5986889Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_complex128 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5987283Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_float32 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5987666Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_int16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5988076Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isnan_cuda_int64 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5988469Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_bfloat16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5988891Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_bool SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 7%] 2025-09-07T09:47:12.5989282Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_float16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5989679Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_float32 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5990076Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isneginf_cuda_float64 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5990480Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_bfloat16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5991860Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_float16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5992256Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_int32 SKIPPED [0.0022s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5992650Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_isposinf_cuda_uint8 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5992992Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_bfloat16 PASSED [0.0106s] [ 8%] 2025-09-07T09:47:12.5993324Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_bool PASSED [0.0028s] [ 8%] 2025-09-07T09:47:12.5993639Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_complex128 PASSED [0.0030s] [ 8%] 2025-09-07T09:47:12.5993924Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_float64 PASSED [0.0029s] [ 8%] 2025-09-07T09:47:12.5994206Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_int16 PASSED [0.0025s] [ 8%] 2025-09-07T09:47:12.5994483Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_log1p_cuda_int64 PASSED [0.0026s] [ 8%] 2025-09-07T09:47:12.5994760Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_bfloat16 PASSED [0.0155s] [ 8%] 2025-09-07T09:47:12.5995041Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_complex128 PASSED [0.0046s] [ 8%] 2025-09-07T09:47:12.5996292Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_float16 PASSED [0.0030s] [ 8%] 2025-09-07T09:47:12.5996596Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_float32 PASSED [0.0029s] [ 8%] 2025-09-07T09:47:12.5996877Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_float64 PASSED [0.0029s] [ 8%] 2025-09-07T09:47:12.5997152Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_neg_cuda_int32 PASSED [0.0028s] [ 8%] 2025-09-07T09:47:12.5997507Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_nn_functional_relu_cuda_bfloat16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5997929Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_complex128 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 8%] 2025-09-07T09:47:12.5998340Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_complex64 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 9%] 2025-09-07T09:47:12.5998762Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_int16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 9%] 2025-09-07T09:47:12.5999156Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_int32 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 9%] 2025-09-07T09:47:12.5999567Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_int8 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 9%] 2025-09-07T09:47:12.6000916Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_positive_cuda_uint8 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 9%] 2025-09-07T09:47:12.6001265Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_bfloat16 PASSED [0.0028s] [ 9%] 2025-09-07T09:47:12.6001557Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_float16 PASSED [0.0029s] [ 9%] 2025-09-07T09:47:12.6001848Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_float32 PASSED [0.0029s] [ 9%] 2025-09-07T09:47:12.6002135Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_rad2deg_cuda_int32 PASSED [0.0027s] [ 9%] 2025-09-07T09:47:12.6002418Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_float16 PASSED [0.0029s] [ 9%] 2025-09-07T09:47:12.6002698Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_float32 PASSED [0.0029s] [ 9%] 2025-09-07T09:47:12.6002977Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_int16 PASSED [0.0028s] [ 9%] 2025-09-07T09:47:12.6003316Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_int32 PASSED [0.0027s] [ 9%] 2025-09-07T09:47:12.6003591Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_round_cuda_uint8 PASSED [0.0027s] [ 9%] 2025-09-07T09:47:12.6003868Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_bool PASSED [0.0027s] [ 9%] 2025-09-07T09:47:12.6005135Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_complex64 PASSED [0.0041s] [ 9%] 2025-09-07T09:47:12.6005419Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_float16 PASSED [0.0029s] [ 9%] 2025-09-07T09:47:12.6005697Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_float32 PASSED [0.0029s] [ 9%] 2025-09-07T09:47:12.6005971Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int16 PASSED [0.0027s] [ 9%] 2025-09-07T09:47:12.6006242Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int32 PASSED [0.0027s] [ 9%] 2025-09-07T09:47:12.6006513Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int64 PASSED [0.0027s] [ 9%] 2025-09-07T09:47:12.6006782Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sgn_cuda_int8 PASSED [0.0028s] [ 9%] 2025-09-07T09:47:12.6007083Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sign_cuda_float16 PASSED [0.0028s] [ 10%] 2025-09-07T09:47:12.6007361Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sign_cuda_int8 PASSED [0.0026s] [ 10%] 2025-09-07T09:47:12.6007691Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_bool SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 10%] 2025-09-07T09:47:12.6008084Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_float32 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 10%] 2025-09-07T09:47:12.6009458Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_int16 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 10%] 2025-09-07T09:47:12.6009851Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_int64 SKIPPED [0.0019s] (Skipped! Inplace variant not supported!) [ 10%] 2025-09-07T09:47:12.6010317Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_signbit_cuda_uint8 SKIPPED [0.0020s] (Skipped! Inplace variant not supported!) [ 10%] 2025-09-07T09:47:12.6010654Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sin_cuda_complex64 PASSED [0.0039s] [ 10%] 2025-09-07T09:47:12.6010957Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sin_cuda_float16 PASSED [0.0077s] [ 10%] 2025-09-07T09:47:12.6011232Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sin_cuda_int32 PASSED [0.0026s] [ 10%] 2025-09-07T09:47:12.6011504Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_bool PASSED [0.0065s] [ 10%] 2025-09-07T09:47:12.6011776Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_int16 PASSED [0.0026s] [ 10%] 2025-09-07T09:47:12.6012047Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_int32 PASSED [0.0026s] [ 10%] 2025-09-07T09:47:12.6012321Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sinh_cuda_int8 PASSED [0.0026s] [ 10%] 2025-09-07T09:47:12.6012592Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_bool PASSED [0.0026s] [ 10%] 2025-09-07T09:47:12.6013932Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_complex128 PASSED [0.0038s] [ 10%] 2025-09-07T09:47:12.6014219Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_complex32 PASSED [0.0038s] [ 10%] 2025-09-07T09:47:12.6014502Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_complex64 PASSED [0.0037s] [ 10%] 2025-09-07T09:47:12.6014784Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_float32 PASSED [0.0028s] [ 10%] 2025-09-07T09:47:12.6015063Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_float64 PASSED [0.0028s] [ 10%] 2025-09-07T09:47:12.6015340Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_int16 PASSED [0.0026s] [ 10%] 2025-09-07T09:47:12.6015643Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_sqrt_cuda_int32 PASSED [0.0026s] [ 11%] 2025-09-07T09:47:12.6015920Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_float16 PASSED [0.0074s] [ 11%] 2025-09-07T09:47:12.6016196Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_int32 PASSED [0.0027s] [ 11%] 2025-09-07T09:47:12.6016466Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_int64 PASSED [0.0029s] [ 11%] 2025-09-07T09:47:12.6016737Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tan_cuda_uint8 PASSED [0.0026s] [ 11%] 2025-09-07T09:47:12.6017989Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_bfloat16 PASSED [0.0071s] [ 11%] 2025-09-07T09:47:12.6018272Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_complex32 PASSED [0.0038s] [ 11%] 2025-09-07T09:47:12.6018582Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_complex64 PASSED [0.0038s] [ 11%] 2025-09-07T09:47:12.6018864Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_float32 PASSED [0.0029s] [ 11%] 2025-09-07T09:47:12.6019141Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int16 PASSED [0.0027s] [ 11%] 2025-09-07T09:47:12.6019414Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int32 PASSED [0.0026s] [ 11%] 2025-09-07T09:47:12.6019685Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int64 PASSED [0.0025s] [ 11%] 2025-09-07T09:47:12.6019955Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_tanh_cuda_int8 PASSED [0.0026s] [ 11%] 2025-09-07T09:47:12.6020231Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_bfloat16 PASSED [0.0030s] [ 11%] 2025-09-07T09:47:12.6020535Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_float64 PASSED [0.0029s] [ 11%] 2025-09-07T09:47:12.6021784Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_int64 PASSED [0.0027s] [ 11%] 2025-09-07T09:47:12.6022090Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_inplace_trunc_cuda_uint8 PASSED [0.0027s] [ 11%] 2025-09-07T09:47:12.6022366Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_complex128 PASSED [0.0060s] [ 11%] 2025-09-07T09:47:12.6022636Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_complex32 PASSED [0.0059s] [ 11%] 2025-09-07T09:47:12.6022905Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_int64 PASSED [0.0055s] [ 11%] 2025-09-07T09:47:12.6023234Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_abs_cuda_int8 PASSED [0.0055s] [ 11%] 2025-09-07T09:47:12.6023496Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_bool PASSED [0.0058s] [ 11%] 2025-09-07T09:47:12.6023771Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_complex32 PASSED [0.0066s] [ 12%] 2025-09-07T09:47:12.6024043Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_float32 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6024312Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_angle_cuda_int64 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6024578Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_bfloat16 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6025821Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_bool PASSED [0.0049s] [ 12%] 2025-09-07T09:47:12.6026095Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_complex128 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6026370Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_complex32 PASSED [0.0058s] [ 12%] 2025-09-07T09:47:12.6026647Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_complex64 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6026943Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_float64 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6027211Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_int32 PASSED [0.0056s] [ 12%] 2025-09-07T09:47:12.6027472Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asin_cuda_int8 PASSED [0.0056s] [ 12%] 2025-09-07T09:47:12.6027735Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_bool PASSED [0.0056s] [ 12%] 2025-09-07T09:47:12.6028004Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_complex64 PASSED [0.0056s] [ 12%] 2025-09-07T09:47:12.6028277Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_float16 PASSED [0.0056s] [ 12%] 2025-09-07T09:47:12.6028546Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_float64 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6029815Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_asinh_cuda_int64 PASSED [0.0058s] [ 12%] 2025-09-07T09:47:12.6030085Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_bfloat16 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6030360Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_complex128 PASSED [0.0057s] [ 12%] 2025-09-07T09:47:12.6030634Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_complex32 PASSED [0.0068s] [ 12%] 2025-09-07T09:47:12.6030901Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_int16 PASSED [0.0058s] [ 12%] 2025-09-07T09:47:12.6031164Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atan_cuda_uint8 PASSED [0.0056s] [ 12%] 2025-09-07T09:47:12.6031424Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_bool PASSED [0.0049s] [ 13%] 2025-09-07T09:47:12.6031714Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int16 PASSED [0.0063s] [ 13%] 2025-09-07T09:47:12.6031980Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int32 PASSED [0.0057s] [ 13%] 2025-09-07T09:47:12.6032262Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int64 PASSED [0.0057s] [ 13%] 2025-09-07T09:47:12.6032526Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_atanh_cuda_int8 PASSED [0.0056s] [ 13%] 2025-09-07T09:47:12.6033840Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_ceil_cuda_bfloat16 PASSED [0.0057s] [ 13%] 2025-09-07T09:47:12.6034107Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_ceil_cuda_int64 PASSED [0.0058s] [ 13%] 2025-09-07T09:47:12.6034369Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_ceil_cuda_int8 PASSED [0.0054s] [ 13%] 2025-09-07T09:47:12.6034648Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_bfloat16 PASSED [0.0055s] [ 13%] 2025-09-07T09:47:12.6034946Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_bool PASSED [0.0054s] [ 13%] 2025-09-07T09:47:12.6035235Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_float64 PASSED [0.0056s] [ 13%] 2025-09-07T09:47:12.6035524Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_int32 PASSED [0.0055s] [ 13%] 2025-09-07T09:47:12.6035808Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_conj_physical_cuda_uint8 PASSED [0.0054s] [ 13%] 2025-09-07T09:47:12.6036089Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_bfloat16 PASSED [0.0056s] [ 13%] 2025-09-07T09:47:12.6036364Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_bool PASSED [0.0056s] [ 13%] 2025-09-07T09:47:12.6036636Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_float16 PASSED [0.0057s] [ 13%] 2025-09-07T09:47:12.6037895Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_float32 PASSED [0.0057s] [ 13%] 2025-09-07T09:47:12.6038200Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_float64 PASSED [0.0056s] [ 13%] 2025-09-07T09:47:12.6038473Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int16 PASSED [0.0056s] [ 13%] 2025-09-07T09:47:12.6038742Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int32 PASSED [0.0057s] [ 13%] 2025-09-07T09:47:12.6039010Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int64 PASSED [0.0057s] [ 13%] 2025-09-07T09:47:12.6039279Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_int8 PASSED [0.0060s] [ 13%] 2025-09-07T09:47:12.6039545Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_deg2rad_cuda_uint8 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6039833Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_bfloat16 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6040100Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_float32 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6040363Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_int32 PASSED [0.0058s] [ 14%] 2025-09-07T09:47:12.6040624Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erf_cuda_int64 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6041884Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_bfloat16 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6042160Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_bool PASSED [0.0050s] [ 14%] 2025-09-07T09:47:12.6042430Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_float32 PASSED [0.0057s] [ 14%] 2025-09-07T09:47:12.6042700Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_int16 PASSED [0.0066s] [ 14%] 2025-09-07T09:47:12.6042992Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_int32 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6043339Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_int64 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6043625Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_erfinv_cuda_uint8 PASSED [0.0050s] [ 14%] 2025-09-07T09:47:12.6043891Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_expm1_cuda_int8 PASSED [0.0057s] [ 14%] 2025-09-07T09:47:12.6044153Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_expm1_cuda_uint8 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6044419Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_float16 PASSED [0.0055s] [ 14%] 2025-09-07T09:47:12.6045695Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_float32 PASSED [0.0060s] [ 14%] 2025-09-07T09:47:12.6045972Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_int64 PASSED [0.0057s] [ 14%] 2025-09-07T09:47:12.6046237Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_int8 PASSED [0.0055s] [ 14%] 2025-09-07T09:47:12.6046501Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_floor_cuda_uint8 PASSED [0.0055s] [ 14%] 2025-09-07T09:47:12.6046769Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_bfloat16 PASSED [0.0057s] [ 14%] 2025-09-07T09:47:12.6047038Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_float16 PASSED [0.0056s] [ 14%] 2025-09-07T09:47:12.6047303Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_float32 PASSED [0.0056s] [ 15%] 2025-09-07T09:47:12.6047572Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_frac_cuda_float64 PASSED [0.0056s] [ 15%] 2025-09-07T09:47:12.6047880Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_bool SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6048260Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_complex128 SKIPPED [0.0021s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6048619Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_complex64 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6049967Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_float16 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6050368Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_float32 SKIPPED [0.0019s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6050713Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_float64 SKIPPED [0.0019s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6051059Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_int32 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6051429Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isinf_cuda_int64 SKIPPED [0.0022s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6051778Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_bfloat16 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6052125Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_bool SKIPPED [0.0019s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6052473Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_complex128 SKIPPED [0.0019s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6052825Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_float16 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6053227Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_float32 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6053599Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_float64 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6054982Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_int16 SKIPPED [0.0019s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6055348Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_int32 SKIPPED [0.0019s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6055690Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_int64 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6056029Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isnan_cuda_uint8 SKIPPED [0.0020s] (Skipped! Out not supported) [ 15%] 2025-09-07T09:47:12.6056342Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isneginf_cuda_bfloat16 PASSED [0.0267s] [ 15%] 2025-09-07T09:47:12.6056626Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isneginf_cuda_int8 PASSED [0.0059s] [ 15%] 2025-09-07T09:47:12.6056900Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isneginf_cuda_uint8 PASSED [0.0055s] [ 16%] 2025-09-07T09:47:12.6057177Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_bfloat16 PASSED [0.0057s] [ 16%] 2025-09-07T09:47:12.6057460Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_float16 PASSED [0.0060s] [ 16%] 2025-09-07T09:47:12.6057739Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_float32 PASSED [0.0057s] [ 16%] 2025-09-07T09:47:12.6058017Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_float64 PASSED [0.0056s] [ 16%] 2025-09-07T09:47:12.6059315Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_int64 PASSED [0.0056s] [ 16%] 2025-09-07T09:47:12.6059586Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_isposinf_cuda_int8 PASSED [0.0057s] [ 16%] 2025-09-07T09:47:12.6059857Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_bool PASSED [0.0059s] [ 16%] 2025-09-07T09:47:12.6060154Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_complex128 PASSED [0.0062s] [ 16%] 2025-09-07T09:47:12.6060435Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_complex64 PASSED [0.0057s] [ 16%] 2025-09-07T09:47:12.6060708Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_float16 PASSED [0.0058s] [ 16%] 2025-09-07T09:47:12.6060976Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_int32 PASSED [0.0058s] [ 16%] 2025-09-07T09:47:12.6061240Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_int64 PASSED [0.0058s] [ 16%] 2025-09-07T09:47:12.6061503Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_int8 PASSED [0.0058s] [ 16%] 2025-09-07T09:47:12.6061787Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_log1p_cuda_uint8 PASSED [0.0059s] [ 16%] 2025-09-07T09:47:12.6062056Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_bfloat16 PASSED [0.0059s] [ 16%] 2025-09-07T09:47:12.6063364Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_float16 PASSED [0.0058s] [ 16%] 2025-09-07T09:47:12.6063631Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_float32 PASSED [0.0057s] [ 16%] 2025-09-07T09:47:12.6063897Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_int16 PASSED [0.0056s] [ 16%] 2025-09-07T09:47:12.6064159Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_int64 PASSED [0.0057s] [ 16%] 2025-09-07T09:47:12.6064420Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_int8 PASSED [0.0056s] [ 16%] 2025-09-07T09:47:12.6064679Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_neg_cuda_uint8 PASSED [0.0056s] [ 17%] 2025-09-07T09:47:12.6065033Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_nn_functional_relu_cuda_float16 SKIPPED [0.0019s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6065419Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_nn_functional_relu_cuda_float64 SKIPPED [0.0020s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6065816Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_nn_functional_relu_cuda_uint8 SKIPPED [0.0020s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6066185Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_bfloat16 SKIPPED [0.0020s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6067524Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_complex128 SKIPPED [0.0020s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6067893Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_complex32 SKIPPED [0.0019s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6068256Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_float64 SKIPPED [0.0020s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6068611Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_positive_cuda_int32 SKIPPED [0.0020s] (Skipped! Out not supported) [ 17%] 2025-09-07T09:47:12.6068928Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_bfloat16 PASSED [0.0057s] [ 17%] 2025-09-07T09:47:12.6069209Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_float16 PASSED [0.0057s] [ 17%] 2025-09-07T09:47:12.6069485Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_float32 PASSED [0.0057s] [ 17%] 2025-09-07T09:47:12.6069758Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_int16 PASSED [0.0059s] [ 17%] 2025-09-07T09:47:12.6070027Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_rad2deg_cuda_int64 PASSED [0.0057s] [ 17%] 2025-09-07T09:47:12.6070328Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_bfloat16 PASSED [0.0057s] [ 17%] 2025-09-07T09:47:12.6070598Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_float16 PASSED [0.0056s] [ 17%] 2025-09-07T09:47:12.6071827Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_float32 PASSED [0.0056s] [ 17%] 2025-09-07T09:47:12.6072097Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_int16 PASSED [0.0055s] [ 17%] 2025-09-07T09:47:12.6072361Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_int64 PASSED [0.0055s] [ 17%] 2025-09-07T09:47:12.6072623Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_round_cuda_int8 PASSED [0.0056s] [ 17%] 2025-09-07T09:47:12.6072886Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_bool PASSED [0.0056s] [ 17%] 2025-09-07T09:47:12.6073237Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_complex32 PASSED [0.0070s] [ 17%] 2025-09-07T09:47:12.6073509Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_complex64 PASSED [0.0057s] [ 18%] 2025-09-07T09:47:12.6073778Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_float32 PASSED [0.0057s] [ 18%] 2025-09-07T09:47:12.6074041Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_int16 PASSED [0.0055s] [ 18%] 2025-09-07T09:47:12.6074303Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_int32 PASSED [0.0055s] [ 18%] 2025-09-07T09:47:12.6074562Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_int64 PASSED [0.0055s] [ 18%] 2025-09-07T09:47:12.6075808Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sgn_cuda_uint8 PASSED [0.0059s] [ 18%] 2025-09-07T09:47:12.6076072Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_float16 PASSED [0.0057s] [ 18%] 2025-09-07T09:47:12.6076369Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_float32 PASSED [0.0056s] [ 18%] 2025-09-07T09:47:12.6076637Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_float64 PASSED [0.0058s] [ 18%] 2025-09-07T09:47:12.6076922Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_int16 PASSED [0.0056s] [ 18%] 2025-09-07T09:47:12.6077185Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sign_cuda_int32 PASSED [0.0056s] [ 18%] 2025-09-07T09:47:12.6077455Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_bfloat16 PASSED [0.0056s] [ 18%] 2025-09-07T09:47:12.6077729Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_bool PASSED [0.0055s] [ 18%] 2025-09-07T09:47:12.6078000Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_float16 PASSED [0.0056s] [ 18%] 2025-09-07T09:47:12.6078274Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_int8 PASSED [0.0057s] [ 18%] 2025-09-07T09:47:12.6078542Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_signbit_cuda_uint8 PASSED [0.0056s] [ 18%] 2025-09-07T09:47:12.6079778Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_bfloat16 PASSED [0.0057s] [ 18%] 2025-09-07T09:47:12.6080045Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_bool PASSED [0.0058s] [ 18%] 2025-09-07T09:47:12.6080312Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_complex128 PASSED [0.0071s] [ 18%] 2025-09-07T09:47:12.6080583Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_complex32 PASSED [0.0066s] [ 18%] 2025-09-07T09:47:12.6080852Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_float16 PASSED [0.0055s] [ 18%] 2025-09-07T09:47:12.6081117Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_float32 PASSED [0.0056s] [ 19%] 2025-09-07T09:47:12.6081383Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_float64 PASSED [0.0056s] [ 19%] 2025-09-07T09:47:12.6081671Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_int32 PASSED [0.0056s] [ 19%] 2025-09-07T09:47:12.6081934Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sin_cuda_int64 PASSED [0.0056s] [ 19%] 2025-09-07T09:47:12.6082198Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_bfloat16 PASSED [0.0056s] [ 19%] 2025-09-07T09:47:12.6082463Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_bool PASSED [0.0056s] [ 19%] 2025-09-07T09:47:12.6083768Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_complex128 PASSED [0.0067s] [ 19%] 2025-09-07T09:47:12.6084045Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_complex64 PASSED [0.0066s] [ 19%] 2025-09-07T09:47:12.6084315Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_float16 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6084608Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sinh_cuda_int16 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6084878Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_complex128 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6085156Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_complex32 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6085431Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_complex64 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6085700Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_float16 PASSED [0.0055s] [ 19%] 2025-09-07T09:47:12.6085967Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_float64 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6086230Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_int32 PASSED [0.0061s] [ 19%] 2025-09-07T09:47:12.6087492Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_sqrt_cuda_uint8 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6087760Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_bool PASSED [0.0056s] [ 19%] 2025-09-07T09:47:12.6088050Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_complex128 PASSED [0.0068s] [ 19%] 2025-09-07T09:47:12.6088320Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_complex32 PASSED [0.0066s] [ 19%] 2025-09-07T09:47:12.6088588Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_complex64 PASSED [0.0066s] [ 19%] 2025-09-07T09:47:12.6088856Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_float32 PASSED [0.0057s] [ 19%] 2025-09-07T09:47:12.6089119Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_int64 PASSED [0.0056s] [ 20%] 2025-09-07T09:47:12.6089382Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tan_cuda_uint8 PASSED [0.0057s] [ 20%] 2025-09-07T09:47:12.6089646Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_bool PASSED [0.0057s] [ 20%] 2025-09-07T09:47:12.6089914Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_complex128 PASSED [0.0069s] [ 20%] 2025-09-07T09:47:12.6090247Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_complex64 PASSED [0.0057s] [ 20%] 2025-09-07T09:47:12.6091506Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_float16 PASSED [0.0056s] [ 20%] 2025-09-07T09:47:12.6091775Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_float64 PASSED [0.0057s] [ 20%] 2025-09-07T09:47:12.6092040Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_int64 PASSED [0.0058s] [ 20%] 2025-09-07T09:47:12.6092302Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_tanh_cuda_uint8 PASSED [0.0060s] [ 20%] 2025-09-07T09:47:12.6092572Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_bfloat16 PASSED [0.0057s] [ 20%] 2025-09-07T09:47:12.6092869Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_float32 PASSED [0.0058s] [ 20%] 2025-09-07T09:47:12.6093204Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_float64 PASSED [0.0057s] [ 20%] 2025-09-07T09:47:12.6093471Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_int16 PASSED [0.0060s] [ 20%] 2025-09-07T09:47:12.6093735Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_int64 PASSED [0.0055s] [ 20%] 2025-09-07T09:47:12.6093999Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_csr_unary_out_trunc_cuda_int8 PASSED [0.0054s] [ 20%] 2025-09-07T09:47:12.6094253Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_mm_cuda_complex128 PASSED [0.5388s] [ 20%] 2025-09-07T09:47:12.6095523Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_mm_reduce_cuda_float64 SKIPPED [0.0009s] (Only runs on cpu) [ 20%] 2025-09-07T09:47:12.6095860Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_mm_reduce_sum_cuda_float64 SKIPPED [0.0004s] (Only runs on cpu) [ 20%] 2025-09-07T09:47:12.6096169Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_to_sparse_compressed_SparseBSC_cuda_float64 PASSED [0.0522s] [ 20%] 2025-09-07T09:47:12.6096477Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_to_sparse_compressed_SparseCSR_cuda_float64 PASSED [0.0415s] [ 20%] 2025-09-07T09:47:12.6096823Z test_sparse_csr.py::TestSparseCSRCUDA::test_sparse_triangular_solve_cuda_float32 SKIPPED [0.0007s] (cuSparse Generic API SpSV is not available) [ 20%] 2025-09-07T09:47:12.6097131Z test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_bool PASSED [0.0247s] [ 21%] 2025-09-07T09:47:12.6097351Z test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_float32 PASSED [0.0227s] [ 21%] 2025-09-07T09:47:12.6097569Z test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_int16 PASSED [0.0147s] [ 21%] 2025-09-07T09:47:12.6097802Z test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_int64 PASSED [0.0142s] [ 21%] 2025-09-07T09:47:12.6098014Z test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_int8 PASSED [0.0143s] [ 21%] 2025-09-07T09:47:12.6098224Z test_sparse_csr.py::TestSparseCSRCUDA::test_sum_cuda_uint8 PASSED [0.0144s] [ 21%] 2025-09-07T09:47:12.6099471Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_complex128 PASSED [0.7527s] [ 21%] 2025-09-07T09:47:12.6099743Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_complex64 PASSED [0.6954s] [ 21%] 2025-09-07T09:47:12.6100007Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_float16 PASSED [0.7287s] [ 21%] 2025-09-07T09:47:12.6100268Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSC_cuda_int64 PASSED [0.6666s] [ 21%] 2025-09-07T09:47:12.6100529Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_bfloat16 PASSED [0.7835s] [ 21%] 2025-09-07T09:47:12.6100796Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_complex64 PASSED [0.8034s] [ 21%] 2025-09-07T09:47:12.6101058Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_float16 PASSED [0.7781s] [ 21%] 2025-09-07T09:47:12.6101315Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_int16 PASSED [0.7185s] [ 21%] 2025-09-07T09:47:12.6101569Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_int32 PASSED [0.7175s] [ 21%] 2025-09-07T09:47:12.6101821Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_int64 PASSED [0.7133s] [ 21%] 2025-09-07T09:47:12.6102073Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseBSR_cuda_uint8 PASSED [0.7125s] [ 21%] 2025-09-07T09:47:12.6103374Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_bfloat16 PASSED [0.4601s] [ 21%] 2025-09-07T09:47:12.6103634Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_bool PASSED [0.4239s] [ 21%] 2025-09-07T09:47:12.6103896Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_complex128 PASSED [0.4554s] [ 21%] 2025-09-07T09:47:12.6104190Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_complex64 PASSED [0.4618s] [ 21%] 2025-09-07T09:47:12.6104453Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_float16 PASSED [0.4536s] [ 21%] 2025-09-07T09:47:12.6104714Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_float32 PASSED [0.4543s] [ 22%] 2025-09-07T09:47:12.6104971Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_float64 PASSED [0.4494s] [ 22%] 2025-09-07T09:47:12.6105226Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_int16 PASSED [0.4192s] [ 22%] 2025-09-07T09:47:12.6105478Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_int64 PASSED [0.4312s] [ 22%] 2025-09-07T09:47:12.6105731Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSC_cuda_uint8 PASSED [0.4075s] [ 22%] 2025-09-07T09:47:12.6106016Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_complex128 PASSED [0.4887s] [ 22%] 2025-09-07T09:47:12.6107279Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_float32 PASSED [0.4839s] [ 22%] 2025-09-07T09:47:12.6107540Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_float64 PASSED [0.4687s] [ 22%] 2025-09-07T09:47:12.6107799Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_int16 PASSED [0.4571s] [ 22%] 2025-09-07T09:47:12.6108052Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_int8 PASSED [0.4641s] [ 22%] 2025-09-07T09:47:12.6108304Z test_sparse_csr.py::TestSparseCSRCUDA::test_transpose_SparseCSR_cuda_uint8 PASSED [0.4607s] [ 22%] 2025-09-07T09:47:12.6108579Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_bool PASSED [0.0021s] [ 22%] 2025-09-07T09:47:12.6108884Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_complex128 PASSED [0.0022s] [ 22%] 2025-09-07T09:47:12.6109222Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_complex32 PASSED [0.0021s] [ 22%] 2025-09-07T09:47:12.6109530Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_complex64 PASSED [0.0021s] [ 22%] 2025-09-07T09:47:12.6109853Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_float16 PASSED [0.0021s] [ 22%] 2025-09-07T09:47:12.6111138Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_float32 PASSED [0.0020s] [ 22%] 2025-09-07T09:47:12.6111446Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_float64 PASSED [0.0020s] [ 22%] 2025-09-07T09:47:12.6111744Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_int32 PASSED [0.0022s] [ 22%] 2025-09-07T09:47:12.6112037Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_abs_cuda_int64 PASSED [0.0018s] [ 22%] 2025-09-07T09:47:12.6112349Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_complex128 PASSED [0.1317s] [ 22%] 2025-09-07T09:47:12.6112665Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_complex32 PASSED [0.0025s] [ 23%] 2025-09-07T09:47:12.6112978Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_complex64 PASSED [0.0034s] [ 23%] 2025-09-07T09:47:12.6113454Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_float64 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6113756Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_int64 PASSED [0.0022s] [ 23%] 2025-09-07T09:47:12.6114054Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_angle_cuda_int8 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6114355Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_complex32 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6115714Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_complex64 PASSED [0.0021s] [ 23%] 2025-09-07T09:47:12.6116027Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_float32 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6116337Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_float64 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6116639Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_int32 PASSED [0.0021s] [ 23%] 2025-09-07T09:47:12.6116936Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asin_cuda_int8 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6117240Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_bfloat16 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6117579Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_complex32 PASSED [0.0021s] [ 23%] 2025-09-07T09:47:12.6117893Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_complex64 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6118202Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_float32 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6118509Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_float64 PASSED [0.0021s] [ 23%] 2025-09-07T09:47:12.6118810Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_asinh_cuda_int8 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6120104Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_bool PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6120410Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_complex32 PASSED [0.0022s] [ 23%] 2025-09-07T09:47:12.6120746Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_float32 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6121051Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int16 PASSED [0.0020s] [ 23%] 2025-09-07T09:47:12.6121365Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int32 PASSED [0.0021s] [ 23%] 2025-09-07T09:47:12.6121663Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int64 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6121960Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atan_cuda_int8 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6122253Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_bool PASSED [0.0021s] [ 24%] 2025-09-07T09:47:12.6122557Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_complex32 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6122868Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_complex64 PASSED [0.0021s] [ 24%] 2025-09-07T09:47:12.6123236Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_float32 PASSED [0.0021s] [ 24%] 2025-09-07T09:47:12.6124723Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_float64 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6125030Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_int32 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6125332Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_atanh_cuda_int64 PASSED [0.0021s] [ 24%] 2025-09-07T09:47:12.6125638Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_bfloat16 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6125944Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_float16 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6126256Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_float32 PASSED [0.0023s] [ 24%] 2025-09-07T09:47:12.6126589Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_float64 PASSED [0.0020s] [ 24%] 2025-09-07T09:47:12.6126892Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_ceil_cuda_uint8 PASSED [0.0018s] [ 24%] 2025-09-07T09:47:12.6127202Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_bool PASSED [0.0018s] [ 24%] 2025-09-07T09:47:12.6127530Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_complex128 PASSED [0.0021s] [ 24%] 2025-09-07T09:47:12.6127864Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_complex32 PASSED [0.0030s] [ 24%] 2025-09-07T09:47:12.6129342Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_complex64 PASSED [0.0021s] [ 24%] 2025-09-07T09:47:12.6129704Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_float16 PASSED [0.0019s] [ 24%] 2025-09-07T09:47:12.6130083Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_float64 PASSED [0.0019s] [ 24%] 2025-09-07T09:47:12.6130410Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_int16 PASSED [0.0018s] [ 24%] 2025-09-07T09:47:12.6130735Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_int32 PASSED [0.0017s] [ 25%] 2025-09-07T09:47:12.6131056Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_conj_physical_cuda_uint8 PASSED [0.0017s] [ 25%] 2025-09-07T09:47:12.6131372Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_float16 PASSED [0.0021s] [ 25%] 2025-09-07T09:47:12.6131705Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_float32 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6132014Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_int8 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6132338Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_deg2rad_cuda_uint8 PASSED [0.0021s] [ 25%] 2025-09-07T09:47:12.6133707Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_bfloat16 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6134018Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_bool PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6134319Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_float64 PASSED [0.0021s] [ 25%] 2025-09-07T09:47:12.6134618Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_int16 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6134920Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_int8 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6135219Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erf_cuda_uint8 PASSED [0.0021s] [ 25%] 2025-09-07T09:47:12.6135525Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_bfloat16 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6135832Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_bool PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6136138Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_float16 PASSED [0.0029s] [ 25%] 2025-09-07T09:47:12.6136446Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_int32 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6136751Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_int8 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6138024Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_erfinv_cuda_uint8 PASSED [0.0021s] [ 25%] 2025-09-07T09:47:12.6138364Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_bfloat16 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6138682Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_complex128 PASSED [0.0021s] [ 25%] 2025-09-07T09:47:12.6138998Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_complex64 PASSED [0.0021s] [ 25%] 2025-09-07T09:47:12.6139309Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_float32 PASSED [0.0020s] [ 25%] 2025-09-07T09:47:12.6139615Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_float64 PASSED [0.0020s] [ 26%] 2025-09-07T09:47:12.6139918Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_expm1_cuda_int64 PASSED [0.0021s] [ 26%] 2025-09-07T09:47:12.6140246Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_bfloat16 PASSED [0.0020s] [ 26%] 2025-09-07T09:47:12.6140555Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_float16 PASSED [0.0020s] [ 26%] 2025-09-07T09:47:12.6140860Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_float32 PASSED [0.0023s] [ 26%] 2025-09-07T09:47:12.6141164Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_float64 PASSED [0.0020s] [ 26%] 2025-09-07T09:47:12.6142434Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_int64 PASSED [0.0018s] [ 26%] 2025-09-07T09:47:12.6142737Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_floor_cuda_int8 PASSED [0.0019s] [ 26%] 2025-09-07T09:47:12.6143040Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_frac_cuda_bfloat16 PASSED [0.0020s] [ 26%] 2025-09-07T09:47:12.6143431Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_frac_cuda_float16 PASSED [0.0020s] [ 26%] 2025-09-07T09:47:12.6143739Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_frac_cuda_float64 PASSED [0.0021s] [ 26%] 2025-09-07T09:47:12.6144066Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isinf_cuda_float32 PASSED [0.0019s] [ 26%] 2025-09-07T09:47:12.6144370Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isinf_cuda_int64 PASSED [0.0018s] [ 26%] 2025-09-07T09:47:12.6144672Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isinf_cuda_int8 PASSED [0.0019s] [ 26%] 2025-09-07T09:47:12.6144975Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_bfloat16 PASSED [0.0018s] [ 26%] 2025-09-07T09:47:12.6145278Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_bool PASSED [0.0019s] [ 26%] 2025-09-07T09:47:12.6145588Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_float16 PASSED [0.0021s] [ 26%] 2025-09-07T09:47:12.6146876Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_int16 PASSED [0.0018s] [ 26%] 2025-09-07T09:47:12.6147182Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_int64 PASSED [0.0018s] [ 26%] 2025-09-07T09:47:12.6147484Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isnan_cuda_uint8 PASSED [0.0019s] [ 26%] 2025-09-07T09:47:12.6147788Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isneginf_cuda_int16 PASSED [0.0019s] [ 26%] 2025-09-07T09:47:12.6148096Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isneginf_cuda_int32 PASSED [0.0018s] [ 27%] 2025-09-07T09:47:12.6148405Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isneginf_cuda_uint8 PASSED [0.0019s] [ 27%] 2025-09-07T09:47:12.6148742Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isposinf_cuda_int16 PASSED [0.0018s] [ 27%] 2025-09-07T09:47:12.6149051Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isposinf_cuda_int32 PASSED [0.0018s] [ 27%] 2025-09-07T09:47:12.6149356Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_isposinf_cuda_int8 PASSED [0.0019s] [ 27%] 2025-09-07T09:47:12.6149657Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_bool PASSED [0.0020s] [ 27%] 2025-09-07T09:47:12.6149963Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_complex128 PASSED [0.0021s] [ 27%] 2025-09-07T09:47:12.6156636Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_int32 PASSED [0.0021s] [ 27%] 2025-09-07T09:47:12.6157026Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_int64 PASSED [0.0021s] [ 27%] 2025-09-07T09:47:12.6157338Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_log1p_cuda_int8 PASSED [0.0021s] [ 27%] 2025-09-07T09:47:12.6157649Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_complex32 PASSED [0.0031s] [ 27%] 2025-09-07T09:47:12.6157961Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_complex64 PASSED [0.0029s] [ 27%] 2025-09-07T09:47:12.6158268Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_float16 PASSED [0.0020s] [ 27%] 2025-09-07T09:47:12.6158573Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_float64 PASSED [0.0021s] [ 27%] 2025-09-07T09:47:12.6158875Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_int16 PASSED [0.0018s] [ 27%] 2025-09-07T09:47:12.6159195Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_int32 PASSED [0.0025s] [ 27%] 2025-09-07T09:47:12.6159493Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_neg_cuda_uint8 PASSED [0.0019s] [ 27%] 2025-09-07T09:47:12.6161241Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_nn_functional_relu_cuda_int16 PASSED [0.0019s] [ 27%] 2025-09-07T09:47:12.6161594Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_complex128 PASSED [0.0020s] [ 27%] 2025-09-07T09:47:12.6161921Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_float16 PASSED [0.0022s] [ 27%] 2025-09-07T09:47:12.6162242Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_float32 PASSED [0.0019s] [ 27%] 2025-09-07T09:47:12.6162557Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_positive_cuda_int16 PASSED [0.0017s] [ 27%] 2025-09-07T09:47:12.6162877Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_bfloat16 PASSED [0.0021s] [ 28%] 2025-09-07T09:47:12.6163266Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_float16 PASSED [0.0020s] [ 28%] 2025-09-07T09:47:12.6163581Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_float32 PASSED [0.0020s] [ 28%] 2025-09-07T09:47:12.6163892Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_float64 PASSED [0.0021s] [ 28%] 2025-09-07T09:47:12.6164202Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_int32 PASSED [0.0020s] [ 28%] 2025-09-07T09:47:12.6164512Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_int64 PASSED [0.0020s] [ 28%] 2025-09-07T09:47:12.6166062Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_int8 PASSED [0.0021s] [ 28%] 2025-09-07T09:47:12.6166422Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_rad2deg_cuda_uint8 PASSED [0.0026s] [ 28%] 2025-09-07T09:47:12.6166733Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_round_cuda_float16 PASSED [0.0021s] [ 28%] 2025-09-07T09:47:12.6167042Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_round_cuda_int16 PASSED [0.0019s] [ 28%] 2025-09-07T09:47:12.6167347Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_round_cuda_int64 PASSED [0.0018s] [ 28%] 2025-09-07T09:47:12.6167658Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_bfloat16 PASSED [0.0021s] [ 28%] 2025-09-07T09:47:12.6167965Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_bool PASSED [0.0019s] [ 28%] 2025-09-07T09:47:12.6168266Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_float64 PASSED [0.0020s] [ 28%] 2025-09-07T09:47:12.6168592Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_int16 PASSED [0.0018s] [ 28%] 2025-09-07T09:47:12.6168890Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_int64 PASSED [0.0019s] [ 28%] 2025-09-07T09:47:12.6169188Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sgn_cuda_uint8 PASSED [0.0018s] [ 28%] 2025-09-07T09:47:12.6170736Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sign_cuda_float32 PASSED [0.0020s] [ 28%] 2025-09-07T09:47:12.6171049Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sign_cuda_float64 PASSED [0.0021s] [ 28%] 2025-09-07T09:47:12.6171357Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sign_cuda_int16 PASSED [0.0018s] [ 28%] 2025-09-07T09:47:12.6171666Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_signbit_cuda_bool PASSED [0.0018s] [ 28%] 2025-09-07T09:47:12.6172009Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_signbit_cuda_int16 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6172318Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_signbit_cuda_uint8 PASSED [0.0018s] [ 29%] 2025-09-07T09:47:12.6172648Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_bfloat16 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6172955Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_bool PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6173331Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_complex128 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6173641Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_float16 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6173948Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_float32 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6175417Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_int16 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6175720Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_int64 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6196625Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sin_cuda_uint8 PASSED [0.0022s] [ 29%] 2025-09-07T09:47:12.6196958Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_bfloat16 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6197263Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_bool PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6197571Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_complex128 PASSED [0.0024s] [ 29%] 2025-09-07T09:47:12.6197890Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_complex64 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6198257Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_float32 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6198565Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sinh_cuda_uint8 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6198873Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_complex64 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6200503Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_int16 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6200815Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_int32 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6201114Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_sqrt_cuda_int8 PASSED [0.0020s] [ 29%] 2025-09-07T09:47:12.6201454Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_complex128 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6201759Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_int32 PASSED [0.0021s] [ 29%] 2025-09-07T09:47:12.6202055Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_int8 PASSED [0.0021s] [ 30%] 2025-09-07T09:47:12.6202350Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tan_cuda_uint8 PASSED [0.0020s] [ 30%] 2025-09-07T09:47:12.6202645Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_bool PASSED [0.0022s] [ 30%] 2025-09-07T09:47:12.6202946Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_complex32 PASSED [0.0021s] [ 30%] 2025-09-07T09:47:12.6203398Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_float16 PASSED [0.0020s] [ 30%] 2025-09-07T09:47:12.6203726Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_float32 PASSED [0.0021s] [ 30%] 2025-09-07T09:47:12.6205123Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_float64 PASSED [0.0020s] [ 30%] 2025-09-07T09:47:12.6205458Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_int32 PASSED [0.0020s] [ 30%] 2025-09-07T09:47:12.6205757Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_tanh_cuda_uint8 PASSED [0.0022s] [ 30%] 2025-09-07T09:47:12.6206222Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_trunc_cuda_bfloat16 PASSED [0.0020s] [ 30%] 2025-09-07T09:47:12.6206582Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_trunc_cuda_float64 PASSED [0.0020s] [ 30%] 2025-09-07T09:47:12.6206888Z test_sparse_csr.py::TestSparseCSRCUDA::test_zero_to_zero_correspondence_unary_trunc_cuda_uint8 PASSED [0.0019s] [ 30%] 2025-09-07T09:47:12.6207181Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_bool PASSED [0.0170s] [ 30%] 2025-09-07T09:47:12.6207458Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_float32 PASSED [0.0230s] [ 30%] 2025-09-07T09:47:12.6207730Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_int8 PASSED [0.0160s] [ 30%] 2025-09-07T09:47:12.6207996Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSC_cuda_uint8 PASSED [0.0159s] [ 30%] 2025-09-07T09:47:12.6208262Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_bool PASSED [0.0161s] [ 30%] 2025-09-07T09:47:12.6209704Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_float32 PASSED [0.0229s] [ 30%] 2025-09-07T09:47:12.6209976Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_float64 PASSED [0.0229s] [ 30%] 2025-09-07T09:47:12.6210292Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_int16 PASSED [0.0160s] [ 30%] 2025-09-07T09:47:12.6210561Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_int32 PASSED [0.0158s] [ 30%] 2025-09-07T09:47:12.6210875Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseBSR_cuda_int64 PASSED [0.0160s] [ 31%] 2025-09-07T09:47:12.6211153Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSC_cuda_bfloat16 PASSED [0.0223s] [ 31%] 2025-09-07T09:47:12.6211428Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSC_cuda_float64 PASSED [0.0222s] [ 31%] 2025-09-07T09:47:12.6211697Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSC_cuda_int16 PASSED [0.0154s] [ 31%] 2025-09-07T09:47:12.6211961Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_bool PASSED [0.0155s] [ 31%] 2025-09-07T09:47:12.6212227Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_float16 PASSED [0.0223s] [ 31%] 2025-09-07T09:47:12.6212495Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_float64 PASSED [0.0221s] [ 31%] 2025-09-07T09:47:12.6213935Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_int16 PASSED [0.0154s] [ 31%] 2025-09-07T09:47:12.6214202Z test_sparse_csr.py::TestSparseCompressedCUDA::test_clone_SparseCSR_cuda_int64 PASSED [0.0155s] [ 31%] 2025-09-07T09:47:12.6214490Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_bfloat16 PASSED [0.0027s] [ 31%] 2025-09-07T09:47:12.6214791Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_bool PASSED [0.0026s] [ 31%] 2025-09-07T09:47:12.6214928Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_complex128 PASSED [0.0029s] [ 31%] 2025-09-07T09:47:12.6215063Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_float32 PASSED [0.0026s] [ 31%] 2025-09-07T09:47:12.6215196Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_float64 PASSED [0.0026s] [ 31%] 2025-09-07T09:47:12.6215354Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_int16 PASSED [0.0024s] [ 31%] 2025-09-07T09:47:12.6215485Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_int32 PASSED [0.0025s] [ 31%] 2025-09-07T09:47:12.6215654Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_abs_cuda_int64 PASSED [0.0025s] [ 31%] 2025-09-07T09:47:12.6215796Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_complex128 PASSED [0.0027s] [ 31%] 2025-09-07T09:47:12.6215935Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_complex32 PASSED [0.0027s] [ 31%] 2025-09-07T09:47:12.6216073Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_complex64 PASSED [0.0026s] [ 31%] 2025-09-07T09:47:12.6216209Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_float64 PASSED [0.0026s] [ 31%] 2025-09-07T09:47:12.6216343Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_int32 PASSED [0.0027s] [ 31%] 2025-09-07T09:47:12.6216476Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_angle_cuda_uint8 PASSED [0.0027s] [ 32%] 2025-09-07T09:47:12.6216606Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_bool PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6217765Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_complex64 PASSED [0.0027s] [ 32%] 2025-09-07T09:47:12.6217902Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_float16 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6218035Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_float32 PASSED [0.0028s] [ 32%] 2025-09-07T09:47:12.6218167Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_float64 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6218301Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int16 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6218457Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int32 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6218590Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int64 PASSED [0.0025s] [ 32%] 2025-09-07T09:47:12.6218719Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asin_cuda_int8 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6218856Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_complex32 PASSED [0.0027s] [ 32%] 2025-09-07T09:47:12.6218991Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_float32 PASSED [0.0027s] [ 32%] 2025-09-07T09:47:12.6219125Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_float64 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6219274Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_int16 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6219407Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_int32 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6219539Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_asinh_cuda_uint8 PASSED [0.0027s] [ 32%] 2025-09-07T09:47:12.6219676Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_complex128 PASSED [0.0027s] [ 32%] 2025-09-07T09:47:12.6219811Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_complex64 PASSED [0.0027s] [ 32%] 2025-09-07T09:47:12.6219944Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_float32 PASSED [0.0029s] [ 32%] 2025-09-07T09:47:12.6220072Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_int64 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6220201Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atan_cuda_uint8 PASSED [0.0026s] [ 32%] 2025-09-07T09:47:12.6220354Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_bfloat16 PASSED [0.0027s] [ 33%] 2025-09-07T09:47:12.6220484Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_bool PASSED [0.0026s] [ 33%] 2025-09-07T09:47:12.6220631Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_float64 PASSED [0.0026s] [ 33%] 2025-09-07T09:47:12.6221734Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_int64 PASSED [0.0026s] [ 33%] 2025-09-07T09:47:12.6221867Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_atanh_cuda_int8 PASSED [0.0026s] [ 33%] 2025-09-07T09:47:12.6221999Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_float16 PASSED [0.0027s] [ 33%] 2025-09-07T09:47:12.6222131Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_float64 PASSED [0.0027s] [ 33%] 2025-09-07T09:47:12.6222266Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_int16 PASSED [0.0025s] [ 33%] 2025-09-07T09:47:12.6222397Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_int64 PASSED [0.0025s] [ 33%] 2025-09-07T09:47:12.6222527Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_int8 PASSED [0.0024s] [ 33%] 2025-09-07T09:47:12.6222656Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_ceil_cuda_uint8 PASSED [0.0024s] [ 33%] 2025-09-07T09:47:12.6222800Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_bool PASSED [0.0025s] [ 33%] 2025-09-07T09:47:12.6222949Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_complex64 PASSED [0.0029s] [ 33%] 2025-09-07T09:47:12.6223195Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_float16 PASSED [0.0026s] [ 33%] 2025-09-07T09:47:12.6223367Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_int16 PASSED [0.0025s] [ 33%] 2025-09-07T09:47:12.6223509Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_int32 PASSED [0.0024s] [ 33%] 2025-09-07T09:47:12.6223651Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_conj_physical_cuda_int64 PASSED [0.0025s] [ 33%] 2025-09-07T09:47:12.6223789Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_float16 PASSED [0.0027s] [ 33%] 2025-09-07T09:47:12.6223928Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_float64 PASSED [0.0027s] [ 33%] 2025-09-07T09:47:12.6224064Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_int16 PASSED [0.0027s] [ 33%] 2025-09-07T09:47:12.6224199Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_int32 PASSED [0.0026s] [ 33%] 2025-09-07T09:47:12.6224359Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_int8 PASSED [0.0026s] [ 33%] 2025-09-07T09:47:12.6224493Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_deg2rad_cuda_uint8 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6224626Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_bfloat16 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6225732Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_float16 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6225864Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_int64 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6225992Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erf_cuda_uint8 PASSED [0.0026s] [ 34%] 2025-09-07T09:47:12.6226124Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_bool PASSED [0.0029s] [ 34%] 2025-09-07T09:47:12.6226287Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_float32 PASSED [0.0026s] [ 34%] 2025-09-07T09:47:12.6226420Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int16 PASSED [0.0026s] [ 34%] 2025-09-07T09:47:12.6226576Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int32 PASSED [0.0026s] [ 34%] 2025-09-07T09:47:12.6226709Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int64 PASSED [0.0025s] [ 34%] 2025-09-07T09:47:12.6226840Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_int8 PASSED [0.0025s] [ 34%] 2025-09-07T09:47:12.6226972Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_erfinv_cuda_uint8 PASSED [0.0026s] [ 34%] 2025-09-07T09:47:12.6227102Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_bool PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6227246Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_complex128 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6227384Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_complex64 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6227520Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_float16 PASSED [0.0026s] [ 34%] 2025-09-07T09:47:12.6227653Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_float32 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6227784Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_int16 PASSED [0.0027s] [ 34%] 2025-09-07T09:47:12.6227915Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_int32 PASSED [0.0026s] [ 34%] 2025-09-07T09:47:12.6228046Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_expm1_cuda_int64 PASSED [0.0029s] [ 34%] 2025-09-07T09:47:12.6228181Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_float16 PASSED [0.0025s] [ 34%] 2025-09-07T09:47:12.6228331Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_int16 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6228462Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_int32 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6229555Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_floor_cuda_int8 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6229690Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_frac_cuda_float16 PASSED [0.0027s] [ 35%] 2025-09-07T09:47:12.6229822Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_frac_cuda_float32 PASSED [0.0027s] [ 35%] 2025-09-07T09:47:12.6229960Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_complex128 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6230114Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_float16 PASSED [0.0027s] [ 35%] 2025-09-07T09:47:12.6230251Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_float32 PASSED [0.0026s] [ 35%] 2025-09-07T09:47:12.6230389Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_float64 PASSED [0.0026s] [ 35%] 2025-09-07T09:47:12.6230519Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isinf_cuda_int32 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6230650Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_bool PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6230790Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_complex128 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6230927Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_complex64 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6231078Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_float32 PASSED [0.0027s] [ 35%] 2025-09-07T09:47:12.6231210Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isnan_cuda_int32 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6231368Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_bfloat16 PASSED [0.0026s] [ 35%] 2025-09-07T09:47:12.6231504Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_bool PASSED [0.0024s] [ 35%] 2025-09-07T09:47:12.6231642Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_float16 PASSED [0.0027s] [ 35%] 2025-09-07T09:47:12.6231777Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_int16 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6231911Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isneginf_cuda_int8 PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6232047Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_bool PASSED [0.0025s] [ 35%] 2025-09-07T09:47:12.6232185Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_float16 PASSED [0.0027s] [ 35%] 2025-09-07T09:47:12.6232324Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_float32 PASSED [0.0025s] [ 36%] 2025-09-07T09:47:12.6233491Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_int16 PASSED [0.0025s] [ 36%] 2025-09-07T09:47:12.6233633Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_int32 PASSED [0.0025s] [ 36%] 2025-09-07T09:47:12.6233768Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_isposinf_cuda_uint8 PASSED [0.0025s] [ 36%] 2025-09-07T09:47:12.6233905Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_log1p_cuda_complex128 PASSED [0.0027s] [ 36%] 2025-09-07T09:47:12.6234043Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_log1p_cuda_float16 PASSED [0.0026s] [ 36%] 2025-09-07T09:47:12.6234206Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_log1p_cuda_float32 PASSED [0.0029s] [ 36%] 2025-09-07T09:47:12.6234446Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_bfloat16 SKIPPED [0.0011s] (masked.amax does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6234673Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_float32 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6234899Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_float64 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6235142Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_int16 SKIPPED [0.0011s] (masked.amax does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6235367Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_int32 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6235588Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_int64 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6235813Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amax_cuda_uint8 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6236043Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_float16 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6236293Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_float32 SKIPPED [0.0011s] (masked.amin does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6236538Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_float64 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6236758Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_int8 SKIPPED [0.0011s] (masked.amin does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6236979Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_amin_cuda_uint8 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6237211Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_complex128 SKIPPED [0.0010s] (masked.mean does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6237442Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_complex64 SKIPPED [0.0011s] (masked.mean does not support input with torch.sparse_bsc layout) [ 36%] 2025-09-07T09:47:12.6237667Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_float16 SKIPPED [0.0010s] (masked.mean does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6238879Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_float32 SKIPPED [0.0011s] (masked.mean does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6239109Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_mean_cuda_float64 SKIPPED [0.0010s] (masked.mean does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6239340Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_bfloat16 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6239593Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_complex128 SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6239821Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_float32 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6240044Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_int64 SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6240265Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_prod_cuda_int8 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6240502Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_bool SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6240735Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_complex128 SKIPPED [0.0011s] (masked.sum does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6240957Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_float64 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6241175Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_int64 SKIPPED [0.0011s] (masked.sum does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6241393Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_masked_sum_cuda_uint8 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_bsc layout) [ 37%] 2025-09-07T09:47:12.6241551Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_complex128 PASSED [0.0053s] [ 37%] 2025-09-07T09:47:12.6241689Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_complex32 PASSED [0.0074s] [ 37%] 2025-09-07T09:47:12.6241840Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_complex64 PASSED [0.0050s] [ 37%] 2025-09-07T09:47:12.6241972Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_float16 PASSED [0.0049s] [ 37%] 2025-09-07T09:47:12.6242100Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_int16 PASSED [0.0042s] [ 37%] 2025-09-07T09:47:12.6242229Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_int32 PASSED [0.0042s] [ 37%] 2025-09-07T09:47:12.6242357Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_int8 PASSED [0.0042s] [ 37%] 2025-09-07T09:47:12.6242487Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_mul_cuda_uint8 PASSED [0.0042s] [ 37%] 2025-09-07T09:47:12.6242624Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_complex128 PASSED [0.0026s] [ 37%] 2025-09-07T09:47:12.6243801Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_complex32 PASSED [0.0026s] [ 38%] 2025-09-07T09:47:12.6243938Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_complex64 PASSED [0.0027s] [ 38%] 2025-09-07T09:47:12.6244070Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_float16 PASSED [0.0027s] [ 38%] 2025-09-07T09:47:12.6244200Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_float32 PASSED [0.0027s] [ 38%] 2025-09-07T09:47:12.6244332Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_float64 PASSED [0.0027s] [ 38%] 2025-09-07T09:47:12.6244463Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_int16 PASSED [0.0024s] [ 38%] 2025-09-07T09:47:12.6244620Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_neg_cuda_int32 PASSED [0.0025s] [ 38%] 2025-09-07T09:47:12.6244778Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_nn_functional_relu_cuda_float16 PASSED [0.0032s] [ 38%] 2025-09-07T09:47:12.6244933Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_nn_functional_relu_cuda_float64 PASSED [0.0036s] [ 38%] 2025-09-07T09:47:12.6245084Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_nn_functional_relu_cuda_int32 PASSED [0.0030s] [ 38%] 2025-09-07T09:47:12.6245228Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_bfloat16 PASSED [0.0027s] [ 38%] 2025-09-07T09:47:12.6245374Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_complex128 PASSED [0.0026s] [ 38%] 2025-09-07T09:47:12.6245538Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_complex32 PASSED [0.0027s] [ 38%] 2025-09-07T09:47:12.6245675Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_int16 PASSED [0.0025s] [ 38%] 2025-09-07T09:47:12.6245812Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_int32 PASSED [0.0025s] [ 38%] 2025-09-07T09:47:12.6245945Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_int8 PASSED [0.0025s] [ 38%] 2025-09-07T09:47:12.6246080Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_positive_cuda_uint8 PASSED [0.0024s] [ 38%] 2025-09-07T09:47:12.6246212Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_bool PASSED [0.0026s] [ 38%] 2025-09-07T09:47:12.6246348Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_float16 PASSED [0.0027s] [ 38%] 2025-09-07T09:47:12.6246506Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_float32 PASSED [0.0029s] [ 38%] 2025-09-07T09:47:12.6246648Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_float64 PASSED [0.0026s] [ 38%] 2025-09-07T09:47:12.6246801Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_int16 PASSED [0.0025s] [ 39%] 2025-09-07T09:47:12.6247910Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_rad2deg_cuda_uint8 PASSED [0.0025s] [ 39%] 2025-09-07T09:47:12.6248053Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_bfloat16 PASSED [0.0055s] [ 39%] 2025-09-07T09:47:12.6248200Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_complex32 PASSED [0.0043s] [ 39%] 2025-09-07T09:47:12.6248341Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_float16 PASSED [0.0041s] [ 39%] 2025-09-07T09:47:12.6248485Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_randn_like_cuda_float64 PASSED [0.0041s] [ 39%] 2025-09-07T09:47:12.6248622Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_bfloat16 PASSED [0.0027s] [ 39%] 2025-09-07T09:47:12.6248759Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_float16 PASSED [0.0026s] [ 39%] 2025-09-07T09:47:12.6248893Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_float64 PASSED [0.0027s] [ 39%] 2025-09-07T09:47:12.6249024Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_int32 PASSED [0.0025s] [ 39%] 2025-09-07T09:47:12.6249156Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_int64 PASSED [0.0025s] [ 39%] 2025-09-07T09:47:12.6249286Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_round_cuda_int8 PASSED [0.0025s] [ 39%] 2025-09-07T09:47:12.6249420Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_bfloat16 PASSED [0.0026s] [ 39%] 2025-09-07T09:47:12.6249577Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_complex128 PASSED [0.0038s] [ 39%] 2025-09-07T09:47:12.6249711Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_complex32 PASSED [0.0027s] [ 39%] 2025-09-07T09:47:12.6249843Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_float16 PASSED [0.0026s] [ 39%] 2025-09-07T09:47:12.6249972Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_float32 PASSED [0.0026s] [ 39%] 2025-09-07T09:47:12.6250158Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sgn_cuda_int32 PASSED [0.0024s] [ 39%] 2025-09-07T09:47:12.6250286Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sign_cuda_bool PASSED [0.0024s] [ 39%] 2025-09-07T09:47:12.6250439Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sign_cuda_int32 PASSED [0.0025s] [ 39%] 2025-09-07T09:47:12.6250569Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sign_cuda_int8 PASSED [0.0025s] [ 39%] 2025-09-07T09:47:12.6250710Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_bfloat16 PASSED [0.0026s] [ 39%] 2025-09-07T09:47:12.6251804Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_bool PASSED [0.0025s] [ 40%] 2025-09-07T09:47:12.6251944Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_float16 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6252080Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_int32 PASSED [0.0025s] [ 40%] 2025-09-07T09:47:12.6252213Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_int8 PASSED [0.0025s] [ 40%] 2025-09-07T09:47:12.6252368Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_signbit_cuda_uint8 PASSED [0.0025s] [ 40%] 2025-09-07T09:47:12.6252507Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_complex32 PASSED [0.0029s] [ 40%] 2025-09-07T09:47:12.6252654Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_complex64 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6252787Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_float16 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6252917Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_float32 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6253046Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_int16 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6253230Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_int64 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6253361Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_int8 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6253490Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sin_cuda_uint8 PASSED [0.0025s] [ 40%] 2025-09-07T09:47:12.6253625Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_bfloat16 PASSED [0.0027s] [ 40%] 2025-09-07T09:47:12.6253753Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_bool PASSED [0.0027s] [ 40%] 2025-09-07T09:47:12.6253889Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_complex64 PASSED [0.0027s] [ 40%] 2025-09-07T09:47:12.6254020Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_float32 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6254151Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_int16 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6254280Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_int32 PASSED [0.0026s] [ 40%] 2025-09-07T09:47:12.6254431Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_int8 PASSED [0.0027s] [ 40%] 2025-09-07T09:47:12.6254561Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sinh_cuda_uint8 PASSED [0.0028s] [ 40%] 2025-09-07T09:47:12.6255668Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_complex32 PASSED [0.0027s] [ 41%] 2025-09-07T09:47:12.6255807Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_complex64 PASSED [0.0027s] [ 41%] 2025-09-07T09:47:12.6255940Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_float64 PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6256071Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_int32 PASSED [0.0027s] [ 41%] 2025-09-07T09:47:12.6256199Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_int8 PASSED [0.0027s] [ 41%] 2025-09-07T09:47:12.6256360Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sqrt_cuda_uint8 PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6256488Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_bool PASSED [0.0059s] [ 41%] 2025-09-07T09:47:12.6256620Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_float16 PASSED [0.0066s] [ 41%] 2025-09-07T09:47:12.6256752Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_float32 PASSED [0.0065s] [ 41%] 2025-09-07T09:47:12.6256881Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_sum_cuda_int16 PASSED [0.0057s] [ 41%] 2025-09-07T09:47:12.6257013Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_bfloat16 PASSED [0.0027s] [ 41%] 2025-09-07T09:47:12.6257142Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_bool PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6257298Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_complex32 PASSED [0.0027s] [ 41%] 2025-09-07T09:47:12.6257428Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_int16 PASSED [0.0029s] [ 41%] 2025-09-07T09:47:12.6257572Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_int32 PASSED [0.0027s] [ 41%] 2025-09-07T09:47:12.6257701Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_int8 PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6257828Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tan_cuda_uint8 PASSED [0.0025s] [ 41%] 2025-09-07T09:47:12.6257957Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_bool PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6258089Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_float32 PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6258221Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_int16 PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6258351Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_tanh_cuda_uint8 PASSED [0.0026s] [ 41%] 2025-09-07T09:47:12.6259535Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_bfloat16 SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsc layout) [ 41%] 2025-09-07T09:47:12.6259763Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_complex128 SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsc layout) [ 42%] 2025-09-07T09:47:12.6259987Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_complex64 SKIPPED [0.0009s] (to_sparse does not support input with torch.sparse_bsc layout) [ 42%] 2025-09-07T09:47:12.6260208Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_float32 SKIPPED [0.0009s] (to_sparse does not support input with torch.sparse_bsc layout) [ 42%] 2025-09-07T09:47:12.6260446Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_float64 SKIPPED [0.0011s] (to_sparse does not support input with torch.sparse_bsc layout) [ 42%] 2025-09-07T09:47:12.6260662Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_int16 SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsc layout) [ 42%] 2025-09-07T09:47:12.6260878Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_to_sparse_cuda_uint8 SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsc layout) [ 42%] 2025-09-07T09:47:12.6261015Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_bfloat16 PASSED [0.0027s] [ 42%] 2025-09-07T09:47:12.6261151Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_float32 PASSED [0.0027s] [ 42%] 2025-09-07T09:47:12.6261298Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_int16 PASSED [0.0025s] [ 42%] 2025-09-07T09:47:12.6261432Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_int64 PASSED [0.0027s] [ 42%] 2025-09-07T09:47:12.6261564Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_trunc_cuda_uint8 PASSED [0.0025s] [ 42%] 2025-09-07T09:47:12.6261710Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_zeros_like_cuda_complex32 PASSED [0.0036s] [ 42%] 2025-09-07T09:47:12.6261851Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_zeros_like_cuda_float32 PASSED [0.0036s] [ 42%] 2025-09-07T09:47:12.6261993Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSC_zeros_like_cuda_float64 PASSED [0.0036s] [ 42%] 2025-09-07T09:47:12.6262128Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_abs_cuda_bfloat16 PASSED [0.0026s] [ 42%] 2025-09-07T09:47:12.6262283Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_abs_cuda_complex128 PASSED [0.0026s] [ 42%] 2025-09-07T09:47:12.6262421Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_complex32 PASSED [0.0027s] [ 42%] 2025-09-07T09:47:12.6262574Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_complex64 PASSED [0.0026s] [ 42%] 2025-09-07T09:47:12.6262708Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_float64 PASSED [0.0027s] [ 42%] 2025-09-07T09:47:12.6262840Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_angle_cuda_int64 PASSED [0.0027s] [ 42%] 2025-09-07T09:47:12.6264038Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_bool PASSED [0.0026s] [ 42%] 2025-09-07T09:47:12.6264179Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_complex64 PASSED [0.0027s] [ 43%] 2025-09-07T09:47:12.6264314Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_int16 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6264445Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_int32 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6264575Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_int64 PASSED [0.0029s] [ 43%] 2025-09-07T09:47:12.6264705Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asin_cuda_uint8 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6264844Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_complex128 PASSED [0.0027s] [ 43%] 2025-09-07T09:47:12.6264981Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_complex32 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6265117Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_complex64 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6265252Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_float16 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6265418Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_float32 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6265551Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_int16 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6265682Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_int32 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6265813Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_asinh_cuda_uint8 PASSED [0.0025s] [ 43%] 2025-09-07T09:47:12.6265946Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_bfloat16 PASSED [0.0027s] [ 43%] 2025-09-07T09:47:12.6266082Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_complex128 PASSED [0.0027s] [ 43%] 2025-09-07T09:47:12.6266237Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_complex32 PASSED [0.0027s] [ 43%] 2025-09-07T09:47:12.6266370Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_float16 PASSED [0.0027s] [ 43%] 2025-09-07T09:47:12.6266503Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_float64 PASSED [0.0028s] [ 43%] 2025-09-07T09:47:12.6266632Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_int32 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6266762Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_int64 PASSED [0.0027s] [ 43%] 2025-09-07T09:47:12.6266889Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_int8 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6267986Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atan_cuda_uint8 PASSED [0.0026s] [ 43%] 2025-09-07T09:47:12.6268149Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_complex32 PASSED [0.0027s] [ 44%] 2025-09-07T09:47:12.6268289Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_complex64 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6268441Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_float16 PASSED [0.0027s] [ 44%] 2025-09-07T09:47:12.6268575Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_int32 PASSED [0.0027s] [ 44%] 2025-09-07T09:47:12.6268708Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_int8 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6268841Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_atanh_cuda_uint8 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6268972Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_ceil_cuda_float64 PASSED [0.0027s] [ 44%] 2025-09-07T09:47:12.6269101Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_ceil_cuda_int16 PASSED [0.0025s] [ 44%] 2025-09-07T09:47:12.6269246Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_bool PASSED [0.0025s] [ 44%] 2025-09-07T09:47:12.6269401Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_complex128 PASSED [0.0027s] [ 44%] 2025-09-07T09:47:12.6269550Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_complex32 PASSED [0.0029s] [ 44%] 2025-09-07T09:47:12.6269698Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_float16 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6269844Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_float64 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6269987Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_int32 PASSED [0.0025s] [ 44%] 2025-09-07T09:47:12.6270130Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_int64 PASSED [0.0025s] [ 44%] 2025-09-07T09:47:12.6270287Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_conj_physical_cuda_int8 PASSED [0.0025s] [ 44%] 2025-09-07T09:47:12.6270426Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_deg2rad_cuda_float64 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6270561Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_deg2rad_cuda_int16 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6270694Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_deg2rad_cuda_int8 PASSED [0.0025s] [ 44%] 2025-09-07T09:47:12.6270829Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erf_cuda_float16 PASSED [0.0027s] [ 44%] 2025-09-07T09:47:12.6271955Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erf_cuda_uint8 PASSED [0.0026s] [ 44%] 2025-09-07T09:47:12.6272115Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_bfloat16 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6272253Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_float64 PASSED [0.0038s] [ 45%] 2025-09-07T09:47:12.6272387Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_int16 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6272518Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_int32 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6272650Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_erfinv_cuda_int8 PASSED [0.0028s] [ 45%] 2025-09-07T09:47:12.6272785Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_bfloat16 PASSED [0.0027s] [ 45%] 2025-09-07T09:47:12.6272915Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_bool PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6273145Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_float32 PASSED [0.0027s] [ 45%] 2025-09-07T09:47:12.6273278Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_int8 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6273431Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_expm1_cuda_uint8 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6273568Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_bfloat16 PASSED [0.0027s] [ 45%] 2025-09-07T09:47:12.6273701Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_float32 PASSED [0.0027s] [ 45%] 2025-09-07T09:47:12.6273835Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_float64 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6273965Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_int8 PASSED [0.0024s] [ 45%] 2025-09-07T09:47:12.6274101Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_floor_cuda_uint8 PASSED [0.0025s] [ 45%] 2025-09-07T09:47:12.6274235Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_frac_cuda_float16 PASSED [0.0027s] [ 45%] 2025-09-07T09:47:12.6274368Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_frac_cuda_float64 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6274498Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_bool PASSED [0.0025s] [ 45%] 2025-09-07T09:47:12.6274638Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_complex128 PASSED [0.0028s] [ 45%] 2025-09-07T09:47:12.6274771Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_float16 PASSED [0.0026s] [ 45%] 2025-09-07T09:47:12.6275881Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_float32 PASSED [0.0025s] [ 45%] 2025-09-07T09:47:12.6276017Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_float64 PASSED [0.0025s] [ 45%] 2025-09-07T09:47:12.6276183Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_int64 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6276313Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isinf_cuda_uint8 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6276446Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_bool PASSED [0.0024s] [ 46%] 2025-09-07T09:47:12.6276584Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_complex64 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6276718Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_float16 PASSED [0.0026s] [ 46%] 2025-09-07T09:47:12.6276848Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isnan_cuda_int32 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6276991Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_bfloat16 PASSED [0.0027s] [ 46%] 2025-09-07T09:47:12.6277152Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_float32 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6277289Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_int16 PASSED [0.0024s] [ 46%] 2025-09-07T09:47:12.6277425Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isneginf_cuda_int32 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6277567Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_bfloat16 PASSED [0.0027s] [ 46%] 2025-09-07T09:47:12.6277705Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_float32 PASSED [0.0027s] [ 46%] 2025-09-07T09:47:12.6277840Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_int32 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6277974Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_isposinf_cuda_int64 PASSED [0.0024s] [ 46%] 2025-09-07T09:47:12.6278136Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_bfloat16 PASSED [0.0026s] [ 46%] 2025-09-07T09:47:12.6278274Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_complex128 PASSED [0.0027s] [ 46%] 2025-09-07T09:47:12.6278427Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_complex64 PASSED [0.0027s] [ 46%] 2025-09-07T09:47:12.6278561Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_float32 PASSED [0.0027s] [ 46%] 2025-09-07T09:47:12.6278695Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_float64 PASSED [0.0026s] [ 46%] 2025-09-07T09:47:12.6278826Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int16 PASSED [0.0025s] [ 46%] 2025-09-07T09:47:12.6279935Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int32 PASSED [0.0026s] [ 46%] 2025-09-07T09:47:12.6280071Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int64 PASSED [0.0027s] [ 47%] 2025-09-07T09:47:12.6280201Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_int8 PASSED [0.0026s] [ 47%] 2025-09-07T09:47:12.6280333Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_log1p_cuda_uint8 PASSED [0.0026s] [ 47%] 2025-09-07T09:47:12.6280566Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_float32 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6280796Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_float64 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6281019Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_int32 SKIPPED [0.0011s] (masked.amax does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6281264Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_int64 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6281488Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amax_cuda_uint8 SKIPPED [0.0013s] (masked.amax does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6281715Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_bfloat16 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6281939Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_float32 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6282181Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_int64 SKIPPED [0.0011s] (masked.amin does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6282404Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_amin_cuda_uint8 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6282631Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_mean_cuda_bfloat16 SKIPPED [0.0011s] (masked.mean does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6282862Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_mean_cuda_complex128 SKIPPED [0.0010s] (masked.mean does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6283181Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_complex128 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6283429Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_float16 SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6283673Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_float32 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6283899Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_float64 SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6284122Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_int16 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6285319Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_int32 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6285545Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_prod_cuda_uint8 SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6285773Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_complex64 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_bsr layout) [ 47%] 2025-09-07T09:47:12.6285995Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_float16 SKIPPED [0.0011s] (masked.sum does not support input with torch.sparse_bsr layout) [ 48%] 2025-09-07T09:47:12.6286214Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_int16 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_bsr layout) [ 48%] 2025-09-07T09:47:12.6286433Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_masked_sum_cuda_uint8 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_bsr layout) [ 48%] 2025-09-07T09:47:12.6286593Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_bfloat16 PASSED [0.0049s] [ 48%] 2025-09-07T09:47:12.6286729Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_complex32 PASSED [0.0049s] [ 48%] 2025-09-07T09:47:12.6286862Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_float16 PASSED [0.0048s] [ 48%] 2025-09-07T09:47:12.6286993Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_float32 PASSED [0.0048s] [ 48%] 2025-09-07T09:47:12.6287124Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_float64 PASSED [0.0048s] [ 48%] 2025-09-07T09:47:12.6287252Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_int16 PASSED [0.0043s] [ 48%] 2025-09-07T09:47:12.6287399Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_mul_cuda_int8 PASSED [0.0042s] [ 48%] 2025-09-07T09:47:12.6287533Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_bfloat16 PASSED [0.0027s] [ 48%] 2025-09-07T09:47:12.6287670Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_complex128 PASSED [0.0027s] [ 48%] 2025-09-07T09:47:12.6287805Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_complex32 PASSED [0.0027s] [ 48%] 2025-09-07T09:47:12.6287939Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_float16 PASSED [0.0026s] [ 48%] 2025-09-07T09:47:12.6288069Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_float32 PASSED [0.0026s] [ 48%] 2025-09-07T09:47:12.6288202Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_float64 PASSED [0.0027s] [ 48%] 2025-09-07T09:47:12.6288347Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_int64 PASSED [0.0025s] [ 48%] 2025-09-07T09:47:12.6288478Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_int8 PASSED [0.0025s] [ 48%] 2025-09-07T09:47:12.6288626Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_neg_cuda_uint8 PASSED [0.0025s] [ 48%] 2025-09-07T09:47:12.6289747Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_bfloat16 PASSED [0.0032s] [ 48%] 2025-09-07T09:47:12.6289901Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_float16 PASSED [0.0031s] [ 48%] 2025-09-07T09:47:12.6290121Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_float64 PASSED [0.0032s] [ 49%] 2025-09-07T09:47:12.6290270Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_int8 PASSED [0.0032s] [ 49%] 2025-09-07T09:47:12.6290424Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_nn_functional_relu_cuda_uint8 PASSED [0.0030s] [ 49%] 2025-09-07T09:47:12.6290568Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_bfloat16 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6290718Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_complex128 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6290861Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_complex32 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6291003Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_complex64 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6291143Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_float16 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6291284Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_float32 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6291422Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_int16 PASSED [0.0025s] [ 49%] 2025-09-07T09:47:12.6291580Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_int64 PASSED [0.0024s] [ 49%] 2025-09-07T09:47:12.6291718Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_positive_cuda_uint8 PASSED [0.0025s] [ 49%] 2025-09-07T09:47:12.6291857Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_bfloat16 PASSED [0.0027s] [ 49%] 2025-09-07T09:47:12.6291994Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_float32 PASSED [0.0027s] [ 49%] 2025-09-07T09:47:12.6292130Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_int16 PASSED [0.0027s] [ 49%] 2025-09-07T09:47:12.6292264Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_int32 PASSED [0.0028s] [ 49%] 2025-09-07T09:47:12.6292417Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_rad2deg_cuda_int8 PASSED [0.0025s] [ 49%] 2025-09-07T09:47:12.6292562Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_randn_like_cuda_bfloat16 PASSED [0.0041s] [ 49%] 2025-09-07T09:47:12.6292708Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_randn_like_cuda_complex64 PASSED [0.0041s] [ 49%] 2025-09-07T09:47:12.6293880Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_bfloat16 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6294017Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_float16 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6294153Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_float32 PASSED [0.0026s] [ 49%] 2025-09-07T09:47:12.6294286Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_int32 PASSED [0.0024s] [ 50%] 2025-09-07T09:47:12.6294448Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_round_cuda_int8 PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6294581Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_bfloat16 PASSED [0.0027s] [ 50%] 2025-09-07T09:47:12.6294738Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_complex32 PASSED [0.0027s] [ 50%] 2025-09-07T09:47:12.6294870Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_float16 PASSED [0.0026s] [ 50%] 2025-09-07T09:47:12.6295002Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_float32 PASSED [0.0026s] [ 50%] 2025-09-07T09:47:12.6295132Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_float64 PASSED [0.0026s] [ 50%] 2025-09-07T09:47:12.6295260Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_int64 PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6295391Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sgn_cuda_uint8 PASSED [0.0027s] [ 50%] 2025-09-07T09:47:12.6295520Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_bool PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6295652Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_float32 PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6295781Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_int16 PASSED [0.0024s] [ 50%] 2025-09-07T09:47:12.6295910Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sign_cuda_int64 PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6296049Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_bfloat16 PASSED [0.0027s] [ 50%] 2025-09-07T09:47:12.6296185Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_float64 PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6296321Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_int32 PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6296474Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_int8 PASSED [0.0024s] [ 50%] 2025-09-07T09:47:12.6296608Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_signbit_cuda_uint8 PASSED [0.0025s] [ 50%] 2025-09-07T09:47:12.6297704Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_bfloat16 PASSED [0.0027s] [ 50%] 2025-09-07T09:47:12.6297840Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_complex32 PASSED [0.0027s] [ 50%] 2025-09-07T09:47:12.6297974Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_complex64 PASSED [0.0027s] [ 50%] 2025-09-07T09:47:12.6298106Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_float32 PASSED [0.0026s] [ 50%] 2025-09-07T09:47:12.6298257Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sin_cuda_int16 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6298393Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_bfloat16 PASSED [0.0028s] [ 51%] 2025-09-07T09:47:12.6298529Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_complex32 PASSED [0.0039s] [ 51%] 2025-09-07T09:47:12.6298664Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_complex64 PASSED [0.0027s] [ 51%] 2025-09-07T09:47:12.6298798Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_float32 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6298929Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_float64 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6299060Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_int32 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6299207Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_int64 PASSED [0.0027s] [ 51%] 2025-09-07T09:47:12.6299339Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sinh_cuda_uint8 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6299468Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_bool PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6299622Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_complex32 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6299754Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_float64 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6299883Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_int16 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6300012Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sqrt_cuda_int64 PASSED [0.0026s] [ 51%] 2025-09-07T09:47:12.6300143Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_bfloat16 PASSED [0.0065s] [ 51%] 2025-09-07T09:47:12.6300279Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_float64 PASSED [0.0067s] [ 51%] 2025-09-07T09:47:12.6300408Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_int64 PASSED [0.0056s] [ 51%] 2025-09-07T09:47:12.6301486Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_sum_cuda_uint8 PASSED [0.0055s] [ 51%] 2025-09-07T09:47:12.6301621Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_bfloat16 PASSED [0.0027s] [ 51%] 2025-09-07T09:47:12.6301756Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_complex128 PASSED [0.0027s] [ 51%] 2025-09-07T09:47:12.6301891Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_complex32 PASSED [0.0027s] [ 51%] 2025-09-07T09:47:12.6302025Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_complex64 PASSED [0.0026s] [ 52%] 2025-09-07T09:47:12.6302177Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_float16 PASSED [0.0027s] [ 52%] 2025-09-07T09:47:12.6302308Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_float64 PASSED [0.0027s] [ 52%] 2025-09-07T09:47:12.6302438Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_int16 PASSED [0.0027s] [ 52%] 2025-09-07T09:47:12.6302567Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_int32 PASSED [0.0026s] [ 52%] 2025-09-07T09:47:12.6302694Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tan_cuda_int64 PASSED [0.0025s] [ 52%] 2025-09-07T09:47:12.6302831Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_complex128 PASSED [0.0029s] [ 52%] 2025-09-07T09:47:12.6302962Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_float16 PASSED [0.0026s] [ 52%] 2025-09-07T09:47:12.6303167Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_int8 PASSED [0.0029s] [ 52%] 2025-09-07T09:47:12.6303298Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_tanh_cuda_uint8 PASSED [0.0026s] [ 52%] 2025-09-07T09:47:12.6303520Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_bool SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsr layout) [ 52%] 2025-09-07T09:47:12.6303745Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_complex128 SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsr layout) [ 52%] 2025-09-07T09:47:12.6303963Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_float64 SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsr layout) [ 52%] 2025-09-07T09:47:12.6304178Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_int16 SKIPPED [0.0009s] (to_sparse does not support input with torch.sparse_bsr layout) [ 52%] 2025-09-07T09:47:12.6304411Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_to_sparse_cuda_int32 SKIPPED [0.0010s] (to_sparse does not support input with torch.sparse_bsr layout) [ 52%] 2025-09-07T09:47:12.6304567Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_trunc_cuda_float32 PASSED [0.0025s] [ 52%] 2025-09-07T09:47:12.6304700Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_trunc_cuda_int64 PASSED [0.0024s] [ 52%] 2025-09-07T09:47:12.6305814Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_bfloat16 PASSED [0.0036s] [ 52%] 2025-09-07T09:47:12.6305964Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_complex128 PASSED [0.0036s] [ 52%] 2025-09-07T09:47:12.6306109Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_complex32 PASSED [0.0037s] [ 52%] 2025-09-07T09:47:12.6306258Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_complex64 PASSED [0.0037s] [ 52%] 2025-09-07T09:47:12.6306399Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_float64 PASSED [0.0035s] [ 52%] 2025-09-07T09:47:12.6306539Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_int16 PASSED [0.0033s] [ 53%] 2025-09-07T09:47:12.6306680Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_int32 PASSED [0.0034s] [ 53%] 2025-09-07T09:47:12.6306819Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseBSR_zeros_like_cuda_int64 PASSED [0.0034s] [ 53%] 2025-09-07T09:47:12.6306948Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_bool PASSED [0.0033s] [ 53%] 2025-09-07T09:47:12.6307083Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_complex128 PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6307241Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_int16 PASSED [0.0030s] [ 53%] 2025-09-07T09:47:12.6307369Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_int32 PASSED [0.0029s] [ 53%] 2025-09-07T09:47:12.6307498Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_abs_cuda_uint8 PASSED [0.0030s] [ 53%] 2025-09-07T09:47:12.6307628Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_bool PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6307763Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_float64 PASSED [0.0030s] [ 53%] 2025-09-07T09:47:12.6307893Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_int32 PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6308024Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_angle_cuda_uint8 PASSED [0.0030s] [ 53%] 2025-09-07T09:47:12.6308178Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_complex128 PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6308315Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_complex32 PASSED [0.0032s] [ 53%] 2025-09-07T09:47:12.6308447Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_float32 PASSED [0.0033s] [ 53%] 2025-09-07T09:47:12.6308577Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_int32 PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6308706Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_int64 PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6309806Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asin_cuda_int8 PASSED [0.0030s] [ 53%] 2025-09-07T09:47:12.6309945Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_bfloat16 PASSED [0.0033s] [ 53%] 2025-09-07T09:47:12.6310104Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_complex128 PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6310244Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_complex32 PASSED [0.0031s] [ 53%] 2025-09-07T09:47:12.6310395Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_complex64 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6310530Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_float16 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6310661Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_int64 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6310791Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_asinh_cuda_uint8 PASSED [0.0034s] [ 54%] 2025-09-07T09:47:12.6310920Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_bool PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6311057Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_complex32 PASSED [0.0032s] [ 54%] 2025-09-07T09:47:12.6311190Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_float16 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6311322Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_float64 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6311451Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atan_cuda_int16 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6311585Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_bfloat16 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6311721Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_complex64 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6311854Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_float32 PASSED [0.0033s] [ 54%] 2025-09-07T09:47:12.6311989Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int16 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6312138Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int32 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6312270Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int64 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6312400Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_atanh_cuda_int8 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6312531Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_float16 PASSED [0.0031s] [ 54%] 2025-09-07T09:47:12.6313703Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_float32 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6313840Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_float64 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6313998Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_int32 PASSED [0.0029s] [ 54%] 2025-09-07T09:47:12.6314128Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_ceil_cuda_int8 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6314278Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_bfloat16 PASSED [0.0030s] [ 54%] 2025-09-07T09:47:12.6314430Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_complex128 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6314579Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_complex64 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6314727Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_float16 PASSED [0.0029s] [ 55%] 2025-09-07T09:47:12.6314872Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_float32 PASSED [0.0030s] [ 55%] 2025-09-07T09:47:12.6315041Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int16 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6315183Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int32 PASSED [0.0029s] [ 55%] 2025-09-07T09:47:12.6315343Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int64 PASSED [0.0029s] [ 55%] 2025-09-07T09:47:12.6315485Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_int8 PASSED [0.0028s] [ 55%] 2025-09-07T09:47:12.6315627Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_conj_physical_cuda_uint8 PASSED [0.0029s] [ 55%] 2025-09-07T09:47:12.6315766Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_bfloat16 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6315904Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_float64 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6316040Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_int16 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6316174Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_deg2rad_cuda_int8 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6316306Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erf_cuda_float16 PASSED [0.0030s] [ 55%] 2025-09-07T09:47:12.6316434Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erf_cuda_int32 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6316561Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erf_cuda_int64 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6317677Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_erfinv_cuda_float32 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6317814Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_expm1_cuda_float64 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6317950Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_expm1_cuda_int8 PASSED [0.0033s] [ 55%] 2025-09-07T09:47:12.6318104Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_expm1_cuda_uint8 PASSED [0.0029s] [ 55%] 2025-09-07T09:47:12.6318243Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_bfloat16 PASSED [0.0031s] [ 55%] 2025-09-07T09:47:12.6318376Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int16 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6318508Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int32 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6318639Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int64 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6318769Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_int8 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6318920Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_floor_cuda_uint8 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6319056Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_frac_cuda_float32 PASSED [0.0031s] [ 56%] 2025-09-07T09:47:12.6319194Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_complex32 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6319332Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_complex64 PASSED [0.0031s] [ 56%] 2025-09-07T09:47:12.6319465Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_float16 PASSED [0.0031s] [ 56%] 2025-09-07T09:47:12.6319600Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_float64 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6319730Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_int32 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6319879Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isinf_cuda_uint8 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6320009Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_bool PASSED [0.0032s] [ 56%] 2025-09-07T09:47:12.6320163Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_complex128 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6320294Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_int16 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6320426Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isnan_cuda_int64 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6321527Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_bfloat16 PASSED [0.0031s] [ 56%] 2025-09-07T09:47:12.6321668Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_float16 PASSED [0.0031s] [ 56%] 2025-09-07T09:47:12.6321810Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_float32 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6321948Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_int16 PASSED [0.0030s] [ 56%] 2025-09-07T09:47:12.6322085Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_int64 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6322218Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isneginf_cuda_uint8 PASSED [0.0029s] [ 56%] 2025-09-07T09:47:12.6322360Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_bfloat16 PASSED [0.0031s] [ 57%] 2025-09-07T09:47:12.6322495Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_bool PASSED [0.0029s] [ 57%] 2025-09-07T09:47:12.6322633Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_float16 PASSED [0.0031s] [ 57%] 2025-09-07T09:47:12.6322773Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_isposinf_cuda_float32 PASSED [0.0030s] [ 57%] 2025-09-07T09:47:12.6322930Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_bfloat16 PASSED [0.0030s] [ 57%] 2025-09-07T09:47:12.6323133Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_float32 PASSED [0.0033s] [ 57%] 2025-09-07T09:47:12.6323265Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_int16 PASSED [0.0031s] [ 57%] 2025-09-07T09:47:12.6323395Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_int8 PASSED [0.0031s] [ 57%] 2025-09-07T09:47:12.6323526Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_log1p_cuda_uint8 PASSED [0.0031s] [ 57%] 2025-09-07T09:47:12.6323755Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_bfloat16 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6324005Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_float16 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6324235Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_float64 SKIPPED [0.0011s] (masked.amax does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6324461Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_int32 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6324680Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amax_cuda_int8 SKIPPED [0.0011s] (masked.amax does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6324906Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_float32 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6325151Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_float64 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6326357Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_int16 SKIPPED [0.0011s] (masked.amin does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6326579Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_amin_cuda_int32 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6326809Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_mean_cuda_complex64 SKIPPED [0.0011s] (masked.mean does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6327038Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_mean_cuda_float16 SKIPPED [0.0010s] (masked.mean does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6327264Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_mean_cuda_float32 SKIPPED [0.0010s] (masked.mean does not support input with torch.sparse_csc layout) [ 57%] 2025-09-07T09:47:12.6327485Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_bool SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6327715Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_complex64 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6327942Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_float16 SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6328165Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_int16 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6328406Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_int64 SKIPPED [0.0010s] (masked.prod does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6328627Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_prod_cuda_uint8 SKIPPED [0.0011s] (masked.prod does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6328856Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_bfloat16 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6329096Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_float32 SKIPPED [0.0011s] (masked.sum does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6329321Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_float64 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6329539Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_int16 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6329758Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_int32 SKIPPED [0.0013s] (masked.sum does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6329976Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_int8 SKIPPED [0.0010s] (masked.sum does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6330244Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_masked_sum_cuda_uint8 SKIPPED [0.0011s] (masked.sum does not support input with torch.sparse_csc layout) [ 58%] 2025-09-07T09:47:12.6330401Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_complex128 PASSED [0.0092s] [ 58%] 2025-09-07T09:47:12.6330553Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_complex32 PASSED [0.0061s] [ 58%] 2025-09-07T09:47:12.6331646Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_float32 PASSED [0.0061s] [ 58%] 2025-09-07T09:47:12.6331778Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_int64 PASSED [0.0062s] [ 58%] 2025-09-07T09:47:12.6331907Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_mul_cuda_int8 PASSED [0.0061s] [ 58%] 2025-09-07T09:47:12.6332041Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_complex128 PASSED [0.0031s] [ 58%] 2025-09-07T09:47:12.6332179Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_complex32 PASSED [0.0031s] [ 58%] 2025-09-07T09:47:12.6332314Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_complex64 PASSED [0.0031s] [ 58%] 2025-09-07T09:47:12.6332447Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_float16 PASSED [0.0030s] [ 58%] 2025-09-07T09:47:12.6332579Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_float32 PASSED [0.0031s] [ 59%] 2025-09-07T09:47:12.6332708Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int16 PASSED [0.0030s] [ 59%] 2025-09-07T09:47:12.6332835Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int32 PASSED [0.0030s] [ 59%] 2025-09-07T09:47:12.6332963Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int64 PASSED [0.0031s] [ 59%] 2025-09-07T09:47:12.6333147Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_int8 PASSED [0.0029s] [ 59%] 2025-09-07T09:47:12.6333303Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_neg_cuda_uint8 PASSED [0.0030s] [ 59%] 2025-09-07T09:47:12.6333460Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_bfloat16 PASSED [0.0041s] [ 59%] 2025-09-07T09:47:12.6333613Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_float16 PASSED [0.0041s] [ 59%] 2025-09-07T09:47:12.6333765Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_float32 PASSED [0.0041s] [ 59%] 2025-09-07T09:47:12.6333917Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_float64 PASSED [0.0041s] [ 59%] 2025-09-07T09:47:12.6334069Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_int16 PASSED [0.0037s] [ 59%] 2025-09-07T09:47:12.6334243Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_int64 PASSED [0.0038s] [ 59%] 2025-09-07T09:47:12.6334393Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_int8 PASSED [0.0039s] [ 59%] 2025-09-07T09:47:12.6334544Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_nn_functional_relu_cuda_uint8 PASSED [0.0038s] [ 59%] 2025-09-07T09:47:12.6334688Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_complex128 PASSED [0.0031s] [ 59%] 2025-09-07T09:47:12.6335796Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_complex32 PASSED [0.0031s] [ 59%] 2025-09-07T09:47:12.6335939Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_float32 PASSED [0.0029s] [ 59%] 2025-09-07T09:47:12.6336075Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_int64 PASSED [0.0029s] [ 59%] 2025-09-07T09:47:12.6336237Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_int8 PASSED [0.0031s] [ 59%] 2025-09-07T09:47:12.6336374Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_positive_cuda_uint8 PASSED [0.0029s] [ 59%] 2025-09-07T09:47:12.6336528Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_float16 PASSED [0.0031s] [ 59%] 2025-09-07T09:47:12.6336666Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_float32 PASSED [0.0030s] [ 60%] 2025-09-07T09:47:12.6336799Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_int16 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6336933Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_int8 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6337066Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_rad2deg_cuda_uint8 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6337211Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_bfloat16 PASSED [0.0048s] [ 60%] 2025-09-07T09:47:12.6337356Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_complex32 PASSED [0.0049s] [ 60%] 2025-09-07T09:47:12.6337501Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_complex64 PASSED [0.0047s] [ 60%] 2025-09-07T09:47:12.6337642Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_randn_like_cuda_float32 PASSED [0.0048s] [ 60%] 2025-09-07T09:47:12.6337776Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_round_cuda_float32 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6337908Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_round_cuda_int64 PASSED [0.0030s] [ 60%] 2025-09-07T09:47:12.6338040Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_round_cuda_uint8 PASSED [0.0030s] [ 60%] 2025-09-07T09:47:12.6338172Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_bool PASSED [0.0032s] [ 60%] 2025-09-07T09:47:12.6338321Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_complex128 PASSED [0.0030s] [ 60%] 2025-09-07T09:47:12.6338455Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_complex64 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6338586Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_float16 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6339668Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_float32 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6339801Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_int64 PASSED [0.0030s] [ 60%] 2025-09-07T09:47:12.6339929Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sgn_cuda_uint8 PASSED [0.0029s] [ 60%] 2025-09-07T09:47:12.6340083Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_bfloat16 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6340216Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_float16 PASSED [0.0031s] [ 60%] 2025-09-07T09:47:12.6340347Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_int32 PASSED [0.0029s] [ 60%] 2025-09-07T09:47:12.6340476Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sign_cuda_int64 PASSED [0.0029s] [ 60%] 2025-09-07T09:47:12.6340614Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_signbit_cuda_float64 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6340747Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_signbit_cuda_int16 PASSED [0.0028s] [ 61%] 2025-09-07T09:47:12.6340882Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_signbit_cuda_int8 PASSED [0.0029s] [ 61%] 2025-09-07T09:47:12.6341030Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_bfloat16 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6341160Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_bool PASSED [0.0033s] [ 61%] 2025-09-07T09:47:12.6341313Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_complex128 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6341448Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_complex64 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6341578Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_float16 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6341709Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_float64 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6341836Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_int16 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6341969Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_int32 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6342100Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sin_cuda_int64 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6342239Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_complex128 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6342370Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_float32 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6343559Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_float64 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6343692Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sinh_cuda_int64 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6343823Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_float16 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6343957Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_float32 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6344110Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_int64 PASSED [0.0031s] [ 61%] 2025-09-07T09:47:12.6344239Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_int8 PASSED [0.0033s] [ 61%] 2025-09-07T09:47:12.6344371Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sqrt_cuda_uint8 PASSED [0.0030s] [ 61%] 2025-09-07T09:47:12.6344499Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_bool PASSED [0.0073s] [ 62%] 2025-09-07T09:47:12.6344634Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_complex128 PASSED [0.0076s] [ 62%] 2025-09-07T09:47:12.6344765Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_float64 PASSED [0.0076s] [ 62%] 2025-09-07T09:47:12.6344892Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_sum_cuda_int32 PASSED [0.0073s] [ 62%] 2025-09-07T09:47:12.6345044Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_bfloat16 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6345173Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_bool PASSED [0.0030s] [ 62%] 2025-09-07T09:47:12.6345308Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_complex64 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6345438Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_float32 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6345566Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_int32 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6345695Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_int64 PASSED [0.0030s] [ 62%] 2025-09-07T09:47:12.6345823Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tan_cuda_int8 PASSED [0.0029s] [ 62%] 2025-09-07T09:47:12.6345978Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_complex32 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6346114Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_complex64 PASSED [0.0032s] [ 62%] 2025-09-07T09:47:12.6346264Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_float16 PASSED [0.0030s] [ 62%] 2025-09-07T09:47:12.6347346Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_float32 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6347479Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int16 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6347611Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int32 PASSED [0.0030s] [ 62%] 2025-09-07T09:47:12.6347739Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int64 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6347870Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_tanh_cuda_int8 PASSED [0.0031s] [ 62%] 2025-09-07T09:47:12.6348011Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_float32 PASSED [0.0147s] [ 62%] 2025-09-07T09:47:12.6348154Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_float64 PASSED [0.0040s] [ 62%] 2025-09-07T09:47:12.6348291Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_int64 PASSED [0.0036s] [ 62%] 2025-09-07T09:47:12.6348427Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_to_sparse_cuda_int8 PASSED [0.0034s] [ 63%] 2025-09-07T09:47:12.6348561Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_bfloat16 PASSED [0.0031s] [ 63%] 2025-09-07T09:47:12.6348696Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_float32 PASSED [0.0031s] [ 63%] 2025-09-07T09:47:12.6348828Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_int16 PASSED [0.0030s] [ 63%] 2025-09-07T09:47:12.6348977Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_int32 PASSED [0.0033s] [ 63%] 2025-09-07T09:47:12.6349107Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_int8 PASSED [0.0029s] [ 63%] 2025-09-07T09:47:12.6349238Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_trunc_cuda_uint8 PASSED [0.0028s] [ 63%] 2025-09-07T09:47:12.6349375Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_bool PASSED [0.0039s] [ 63%] 2025-09-07T09:47:12.6349524Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_complex128 PASSED [0.0042s] [ 63%] 2025-09-07T09:47:12.6349665Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_float64 PASSED [0.0041s] [ 63%] 2025-09-07T09:47:12.6349821Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_int16 PASSED [0.0039s] [ 63%] 2025-09-07T09:47:12.6349960Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSC_zeros_like_cuda_int32 PASSED [0.0040s] [ 63%] 2025-09-07T09:47:12.6350093Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_bfloat16 PASSED [0.0030s] [ 63%] 2025-09-07T09:47:12.6350222Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_bool PASSED [0.0029s] [ 63%] 2025-09-07T09:47:12.6351309Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_complex128 PASSED [0.0031s] [ 63%] 2025-09-07T09:47:12.6351446Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_complex32 PASSED [0.0031s] [ 63%] 2025-09-07T09:47:12.6351580Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_complex64 PASSED [0.0031s] [ 63%] 2025-09-07T09:47:12.6351730Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_float16 PASSED [0.0030s] [ 63%] 2025-09-07T09:47:12.6351866Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_float32 PASSED [0.0029s] [ 63%] 2025-09-07T09:47:12.6352009Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_float64 PASSED [0.0032s] [ 63%] 2025-09-07T09:47:12.6352137Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_int16 PASSED [0.0029s] [ 63%] 2025-09-07T09:47:12.6352264Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_int32 PASSED [0.0029s] [ 64%] 2025-09-07T09:47:12.6352392Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_abs_cuda_uint8 PASSED [0.0029s] [ 64%] 2025-09-07T09:47:12.6352521Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_bool PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6352657Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_float32 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6352791Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_float64 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6352925Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_int16 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6353055Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_int32 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6353274Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_int8 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6353405Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_angle_cuda_uint8 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6353538Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_bfloat16 PASSED [0.0031s] [ 64%] 2025-09-07T09:47:12.6353670Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_bool PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6353862Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_complex128 PASSED [0.0031s] [ 64%] 2025-09-07T09:47:12.6353999Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_complex32 PASSED [0.0034s] [ 64%] 2025-09-07T09:47:12.6354131Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_float32 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6355232Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asin_cuda_float64 PASSED [0.0029s] [ 64%] 2025-09-07T09:47:12.6355373Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asinh_cuda_complex128 PASSED [0.0031s] [ 64%] 2025-09-07T09:47:12.6355504Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_asinh_cuda_uint8 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6355664Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_complex32 PASSED [0.0031s] [ 64%] 2025-09-07T09:47:12.6355801Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_complex64 PASSED [0.0031s] [ 64%] 2025-09-07T09:47:12.6355934Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_float32 PASSED [0.0029s] [ 64%] 2025-09-07T09:47:12.6356063Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_int32 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6356192Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_int8 PASSED [0.0030s] [ 64%] 2025-09-07T09:47:12.6356322Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atan_cuda_uint8 PASSED [0.0030s] [ 65%] 2025-09-07T09:47:12.6356452Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_bool PASSED [0.0030s] [ 65%] 2025-09-07T09:47:12.6356590Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_complex128 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6356749Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_complex64 PASSED [0.0030s] [ 65%] 2025-09-07T09:47:12.6356883Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_float16 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6357038Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_float32 PASSED [0.0032s] [ 65%] 2025-09-07T09:47:12.6357172Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_float64 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6357303Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_int32 PASSED [0.0030s] [ 65%] 2025-09-07T09:47:12.6357433Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_int64 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6357565Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_int8 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6357697Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_atanh_cuda_uint8 PASSED [0.0030s] [ 65%] 2025-09-07T09:47:12.6357830Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_float64 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6357960Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_int16 PASSED [0.0029s] [ 65%] 2025-09-07T09:47:12.6359055Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_int64 PASSED [0.0029s] [ 65%] 2025-09-07T09:47:12.6359187Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_ceil_cuda_uint8 PASSED [0.0029s] [ 65%] 2025-09-07T09:47:12.6359336Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_bfloat16 PASSED [0.0030s] [ 65%] 2025-09-07T09:47:12.6359486Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_complex32 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6359656Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_complex64 PASSED [0.0031s] [ 65%] 2025-09-07T09:47:12.6359798Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_conj_physical_cuda_int32 PASSED [0.0029s] [ 65%] 2025-09-07T09:47:12.6359940Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_deg2rad_cuda_bfloat16 PASSED [0.0032s] [ 65%] 2025-09-07T09:47:12.6360074Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_deg2rad_cuda_int16 PASSED [0.0029s] [ 65%] 2025-09-07T09:47:12.6360208Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_deg2rad_cuda_int8 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6360336Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_bool PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6360467Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_float16 PASSED [0.0031s] [ 66%] 2025-09-07T09:47:12.6360610Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_int16 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6360740Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_int32 PASSED [0.0029s] [ 66%] 2025-09-07T09:47:12.6360868Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_int64 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6360996Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erf_cuda_uint8 PASSED [0.0031s] [ 66%] 2025-09-07T09:47:12.6361126Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_bool PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6361262Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_float16 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6361396Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_float32 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6361548Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_float64 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6361681Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_int16 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6361828Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_int64 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6362902Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_erfinv_cuda_int8 PASSED [0.0033s] [ 66%] 2025-09-07T09:47:12.6363041Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_bfloat16 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6363243Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_complex128 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6363381Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_complex64 PASSED [0.0031s] [ 66%] 2025-09-07T09:47:12.6363518Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_float16 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6363654Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_float32 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6363791Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_float64 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6363920Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_int32 PASSED [0.0030s] [ 66%] 2025-09-07T09:47:12.6364052Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_int64 PASSED [0.0029s] [ 66%] 2025-09-07T09:47:12.6364181Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_int8 PASSED [0.0031s] [ 67%] 2025-09-07T09:47:12.6364312Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_expm1_cuda_uint8 PASSED [0.0031s] [ 67%] 2025-09-07T09:47:12.6364450Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_bfloat16 PASSED [0.0030s] [ 67%] 2025-09-07T09:47:12.6364608Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_float16 PASSED [0.0030s] [ 67%] 2025-09-07T09:47:12.6364742Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_float32 PASSED [0.0030s] [ 67%] 2025-09-07T09:47:12.6364873Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_int8 PASSED [0.0028s] [ 67%] 2025-09-07T09:47:12.6365002Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_floor_cuda_uint8 PASSED [0.0031s] [ 67%] 2025-09-07T09:47:12.6365136Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_frac_cuda_bfloat16 PASSED [0.0030s] [ 67%] 2025-09-07T09:47:12.6365267Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_frac_cuda_float64 PASSED [0.0030s] [ 67%] 2025-09-07T09:47:12.6365416Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_bool PASSED [0.0029s] [ 67%] 2025-09-07T09:47:12.6365549Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_int32 PASSED [0.0028s] [ 67%] 2025-09-07T09:47:12.6365680Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_int8 PASSED [0.0029s] [ 67%] 2025-09-07T09:47:12.6365812Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isinf_cuda_uint8 PASSED [0.0029s] [ 67%] 2025-09-07T09:47:12.6366909Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_bfloat16 PASSED [0.0030s] [ 67%] 2025-09-07T09:47:12.6367041Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_bool PASSED [0.0029s] [ 67%] 2025-09-07T09:47:12.6367172Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_int64 PASSED [0.0029s] [ 67%] 2025-09-07T09:47:12.6367329Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isnan_cuda_uint8 PASSED [0.0028s] [ 67%] 2025-09-07T09:47:12.6367473Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_bfloat16 PASSED [0.0030s] [ 67%] 2025-09-07T09:47:12.6367626Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_bool PASSED [0.0029s] [ 67%] 2025-09-07T09:47:12.6367766Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_float32 PASSED [0.0029s] [ 67%] 2025-09-07T09:47:12.6367903Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_float64 PASSED [0.0032s] [ 67%] 2025-09-07T09:47:12.6368037Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_int32 PASSED [0.0028s] [ 68%] 2025-09-07T09:47:12.6368171Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_int64 PASSED [0.0028s] [ 68%] 2025-09-07T09:47:12.6368308Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_int8 PASSED [0.0029s] [ 68%] 2025-09-07T09:47:12.6368443Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isneginf_cuda_uint8 PASSED [0.0029s] [ 68%] 2025-09-07T09:47:12.6368579Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_bool PASSED [0.0029s] [ 68%] 2025-09-07T09:47:12.6368714Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_int32 PASSED [0.0029s] [ 68%] 2025-09-07T09:47:12.6368849Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_int64 PASSED [0.0028s] [ 68%] 2025-09-07T09:47:12.6368984Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_isposinf_cuda_uint8 PASSED [0.0029s] [ 68%] 2025-09-07T09:47:12.6369119Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_bfloat16 PASSED [0.0031s] [ 68%] 2025-09-07T09:47:12.6369254Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_float16 PASSED [0.0030s] [ 68%] 2025-09-07T09:47:12.6369401Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_int16 PASSED [0.0031s] [ 68%] 2025-09-07T09:47:12.6369533Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_int64 PASSED [0.0031s] [ 68%] 2025-09-07T09:47:12.6369663Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_log1p_cuda_int8 PASSED [0.0029s] [ 68%] 2025-09-07T09:47:12.6370814Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_bfloat16 PASSED [0.0753s] [ 68%] 2025-09-07T09:47:12.6370960Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_float16 PASSED [0.0495s] [ 68%] 2025-09-07T09:47:12.6371102Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_float64 PASSED [0.0487s] [ 68%] 2025-09-07T09:47:12.6371380Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_int8 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_csr layout and torch.int8 dtype) [ 68%] 2025-09-07T09:47:12.6371636Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amax_cuda_uint8 SKIPPED [0.0010s] (masked.amax does not support input with torch.sparse_csr layout and torch.uint8 dtype) [ 68%] 2025-09-07T09:47:12.6371783Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_bfloat16 PASSED [0.0500s] [ 68%] 2025-09-07T09:47:12.6371925Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_float64 PASSED [0.0494s] [ 68%] 2025-09-07T09:47:12.6372175Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_int16 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_csr layout and torch.int16 dtype) [ 68%] 2025-09-07T09:47:12.6372442Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_int64 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_csr layout and torch.int64 dtype) [ 68%] 2025-09-07T09:47:12.6372714Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_amin_cuda_uint8 SKIPPED [0.0010s] (masked.amin does not support input with torch.sparse_csr layout and torch.uint8 dtype) [ 69%] 2025-09-07T09:47:12.6372980Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_mean_cuda_complex64 SKIPPED [0.0010s] (masked.mean does not support input with torch.sparse_csr layout and torch.complex64 dtype) [ 69%] 2025-09-07T09:47:12.6373188Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_mean_cuda_float64 PASSED [0.0688s] [ 69%] 2025-09-07T09:47:12.6373336Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_complex64 PASSED [0.0347s] [ 69%] 2025-09-07T09:47:12.6373479Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_int32 PASSED [0.0342s] [ 69%] 2025-09-07T09:47:12.6373622Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_int64 PASSED [0.0327s] [ 69%] 2025-09-07T09:47:12.6373762Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_prod_cuda_int8 PASSED [0.0331s] [ 69%] 2025-09-07T09:47:12.6373910Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_complex128 PASSED [0.0339s] [ 69%] 2025-09-07T09:47:12.6374051Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_float64 PASSED [0.0506s] [ 69%] 2025-09-07T09:47:12.6374189Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_int16 PASSED [0.0366s] [ 69%] 2025-09-07T09:47:12.6374327Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_int32 PASSED [0.0346s] [ 69%] 2025-09-07T09:47:12.6374467Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_int8 PASSED [0.0342s] [ 69%] 2025-09-07T09:47:12.6375602Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_masked_sum_cuda_uint8 PASSED [0.0342s] [ 69%] 2025-09-07T09:47:12.6375741Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_bfloat16 PASSED [0.0134s] [ 69%] 2025-09-07T09:47:12.6375876Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_complex128 PASSED [0.0070s] [ 69%] 2025-09-07T09:47:12.6376011Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_complex32 PASSED [0.0070s] [ 69%] 2025-09-07T09:47:12.6376142Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_float16 PASSED [0.0068s] [ 69%] 2025-09-07T09:47:12.6376275Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_float32 PASSED [0.0070s] [ 69%] 2025-09-07T09:47:12.6376428Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_float64 PASSED [0.0066s] [ 69%] 2025-09-07T09:47:12.6376559Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_int32 PASSED [0.0065s] [ 69%] 2025-09-07T09:47:12.6376687Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_mul_cuda_int64 PASSED [0.0064s] [ 69%] 2025-09-07T09:47:12.6376820Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_bfloat16 PASSED [0.0032s] [ 70%] 2025-09-07T09:47:12.6376955Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_complex128 PASSED [0.0031s] [ 70%] 2025-09-07T09:47:12.6377089Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_complex32 PASSED [0.0031s] [ 70%] 2025-09-07T09:47:12.6377224Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_complex64 PASSED [0.0031s] [ 70%] 2025-09-07T09:47:12.6377374Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_float32 PASSED [0.0030s] [ 70%] 2025-09-07T09:47:12.6377506Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_float64 PASSED [0.0030s] [ 70%] 2025-09-07T09:47:12.6377653Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_int64 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6377781Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_int8 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6377909Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_neg_cuda_uint8 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6378065Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_bfloat16 PASSED [0.0040s] [ 70%] 2025-09-07T09:47:12.6378217Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_float32 PASSED [0.0042s] [ 70%] 2025-09-07T09:47:12.6378370Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_int16 PASSED [0.0037s] [ 70%] 2025-09-07T09:47:12.6379475Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_nn_functional_relu_cuda_int8 PASSED [0.0038s] [ 70%] 2025-09-07T09:47:12.6379622Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_complex32 PASSED [0.0030s] [ 70%] 2025-09-07T09:47:12.6379764Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_complex64 PASSED [0.0031s] [ 70%] 2025-09-07T09:47:12.6379903Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_float16 PASSED [0.0030s] [ 70%] 2025-09-07T09:47:12.6380041Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_float32 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6380179Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_float64 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6380316Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_int16 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6380469Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_int64 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6380606Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_int8 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6380741Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_positive_cuda_uint8 PASSED [0.0029s] [ 70%] 2025-09-07T09:47:12.6380879Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_bfloat16 PASSED [0.0029s] [ 71%] 2025-09-07T09:47:12.6381014Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_bool PASSED [0.0030s] [ 71%] 2025-09-07T09:47:12.6381149Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_int16 PASSED [0.0030s] [ 71%] 2025-09-07T09:47:12.6381298Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_int32 PASSED [0.0032s] [ 71%] 2025-09-07T09:47:12.6381434Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_rad2deg_cuda_uint8 PASSED [0.0030s] [ 71%] 2025-09-07T09:47:12.6381577Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_bfloat16 PASSED [0.0047s] [ 71%] 2025-09-07T09:47:12.6381727Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_complex128 PASSED [0.0047s] [ 71%] 2025-09-07T09:47:12.6381868Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_float16 PASSED [0.0047s] [ 71%] 2025-09-07T09:47:12.6382010Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_randn_like_cuda_float64 PASSED [0.0047s] [ 71%] 2025-09-07T09:47:12.6382144Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_float64 PASSED [0.0031s] [ 71%] 2025-09-07T09:47:12.6382293Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_int32 PASSED [0.0029s] [ 71%] 2025-09-07T09:47:12.6382424Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_int64 PASSED [0.0029s] [ 71%] 2025-09-07T09:47:12.6383616Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_int8 PASSED [0.0028s] [ 71%] 2025-09-07T09:47:12.6383751Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_round_cuda_uint8 PASSED [0.0029s] [ 71%] 2025-09-07T09:47:12.6383890Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_complex64 PASSED [0.0031s] [ 71%] 2025-09-07T09:47:12.6384022Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_float64 PASSED [0.0030s] [ 71%] 2025-09-07T09:47:12.6384152Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_int16 PASSED [0.0029s] [ 71%] 2025-09-07T09:47:12.6384283Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sgn_cuda_int8 PASSED [0.0028s] [ 71%] 2025-09-07T09:47:12.6384419Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_bfloat16 PASSED [0.0032s] [ 71%] 2025-09-07T09:47:12.6384552Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_float16 PASSED [0.0030s] [ 71%] 2025-09-07T09:47:12.6384686Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_float32 PASSED [0.0031s] [ 71%] 2025-09-07T09:47:12.6384815Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_int32 PASSED [0.0029s] [ 72%] 2025-09-07T09:47:12.6384946Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_int8 PASSED [0.0029s] [ 72%] 2025-09-07T09:47:12.6385076Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sign_cuda_uint8 PASSED [0.0028s] [ 72%] 2025-09-07T09:47:12.6385211Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_bool PASSED [0.0029s] [ 72%] 2025-09-07T09:47:12.6385364Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_int16 PASSED [0.0029s] [ 72%] 2025-09-07T09:47:12.6385498Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_int32 PASSED [0.0029s] [ 72%] 2025-09-07T09:47:12.6385629Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_int8 PASSED [0.0029s] [ 72%] 2025-09-07T09:47:12.6385763Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_signbit_cuda_uint8 PASSED [0.0028s] [ 72%] 2025-09-07T09:47:12.6385891Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_bool PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6386025Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_complex32 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6386155Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_float64 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6386304Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sin_cuda_int32 PASSED [0.0033s] [ 72%] 2025-09-07T09:47:12.6387403Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_bool PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6387543Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_complex128 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6387679Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_complex64 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6387810Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_float32 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6387940Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_int32 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6388070Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sinh_cuda_int8 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6388238Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_bfloat16 PASSED [0.0029s] [ 72%] 2025-09-07T09:47:12.6388368Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_float64 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6388514Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_int16 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6388644Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sqrt_cuda_int32 PASSED [0.0030s] [ 72%] 2025-09-07T09:47:12.6388776Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_bfloat16 PASSED [0.0081s] [ 73%] 2025-09-07T09:47:12.6388911Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_complex128 PASSED [0.0082s] [ 73%] 2025-09-07T09:47:12.6389040Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_int64 PASSED [0.0077s] [ 73%] 2025-09-07T09:47:12.6389171Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_sum_cuda_uint8 PASSED [0.0079s] [ 73%] 2025-09-07T09:47:12.6389304Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_complex64 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6389435Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_float16 PASSED [0.0029s] [ 73%] 2025-09-07T09:47:12.6389565Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_float32 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6389695Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_float64 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6389822Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tan_cuda_int32 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6389953Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_bfloat16 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6390083Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_bool PASSED [0.0029s] [ 73%] 2025-09-07T09:47:12.6391197Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_complex128 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6391336Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_complex64 PASSED [0.0031s] [ 73%] 2025-09-07T09:47:12.6391468Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_float16 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6391600Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_float32 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6391731Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_float64 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6391860Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_tanh_cuda_int32 PASSED [0.0030s] [ 73%] 2025-09-07T09:47:12.6392021Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_complex64 PASSED [0.0035s] [ 73%] 2025-09-07T09:47:12.6392164Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_float32 PASSED [0.0037s] [ 73%] 2025-09-07T09:47:12.6392306Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_float64 PASSED [0.0034s] [ 73%] 2025-09-07T09:47:12.6392443Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_int16 PASSED [0.0034s] [ 73%] 2025-09-07T09:47:12.6392579Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_int32 PASSED [0.0034s] [ 74%] 2025-09-07T09:47:12.6392715Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_to_sparse_cuda_int64 PASSED [0.0032s] [ 74%] 2025-09-07T09:47:12.6392848Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_float16 PASSED [0.0030s] [ 74%] 2025-09-07T09:47:12.6393005Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_float32 PASSED [0.0030s] [ 74%] 2025-09-07T09:47:12.6393211Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_int16 PASSED [0.0029s] [ 74%] 2025-09-07T09:47:12.6393364Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_trunc_cuda_uint8 PASSED [0.0029s] [ 74%] 2025-09-07T09:47:12.6393502Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_bool PASSED [0.0038s] [ 74%] 2025-09-07T09:47:12.6393645Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_float16 PASSED [0.0040s] [ 74%] 2025-09-07T09:47:12.6393785Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_float32 PASSED [0.0040s] [ 74%] 2025-09-07T09:47:12.6393923Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_int32 PASSED [0.0039s] [ 74%] 2025-09-07T09:47:12.6394062Z test_sparse_csr.py::TestSparseCompressedCUDA::test_consistency_SparseCSR_zeros_like_cuda_uint8 PASSED [0.0039s] [ 74%] 2025-09-07T09:47:12.6395154Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_bool PASSED [0.0069s] [ 74%] 2025-09-07T09:47:12.6395282Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_complex128 PASSED [0.0071s] [ 74%] 2025-09-07T09:47:12.6395404Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_complex64 PASSED [0.0072s] [ 74%] 2025-09-07T09:47:12.6395522Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_float64 PASSED [0.0071s] [ 74%] 2025-09-07T09:47:12.6395638Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSC_cuda_int64 PASSED [0.0067s] [ 74%] 2025-09-07T09:47:12.6395752Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_bool PASSED [0.0067s] [ 74%] 2025-09-07T09:47:12.6395877Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_complex128 PASSED [0.0072s] [ 74%] 2025-09-07T09:47:12.6396023Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_complex64 PASSED [0.0072s] [ 74%] 2025-09-07T09:47:12.6396140Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_float64 PASSED [0.0070s] [ 74%] 2025-09-07T09:47:12.6396256Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int16 PASSED [0.0067s] [ 74%] 2025-09-07T09:47:12.6396370Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int32 PASSED [0.0070s] [ 74%] 2025-09-07T09:47:12.6396483Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int64 PASSED [0.0067s] [ 75%] 2025-09-07T09:47:12.6396595Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseBSR_cuda_int8 PASSED [0.0066s] [ 75%] 2025-09-07T09:47:12.6396709Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_bool PASSED [0.0146s] [ 75%] 2025-09-07T09:47:12.6396851Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_complex128 PASSED [0.0150s] [ 75%] 2025-09-07T09:47:12.6396968Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_float16 PASSED [0.0149s] [ 75%] 2025-09-07T09:47:12.6397081Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSC_cuda_uint8 PASSED [0.0144s] [ 75%] 2025-09-07T09:47:12.6397202Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_complex128 PASSED [0.0150s] [ 75%] 2025-09-07T09:47:12.6397322Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_complex64 PASSED [0.0150s] [ 75%] 2025-09-07T09:47:12.6397439Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_float32 PASSED [0.0148s] [ 75%] 2025-09-07T09:47:12.6397556Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_float64 PASSED [0.0147s] [ 75%] 2025-09-07T09:47:12.6397668Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_int64 PASSED [0.0144s] [ 75%] 2025-09-07T09:47:12.6398761Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_SparseCSR_cuda_uint8 PASSED [0.0144s] [ 75%] 2025-09-07T09:47:12.6398890Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_bfloat16 PASSED [0.0077s] [ 75%] 2025-09-07T09:47:12.6399037Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_complex128 PASSED [0.0070s] [ 75%] 2025-09-07T09:47:12.6399162Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_float32 PASSED [0.0070s] [ 75%] 2025-09-07T09:47:12.6399286Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSC_cuda_float64 PASSED [0.0070s] [ 75%] 2025-09-07T09:47:12.6399408Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_bool PASSED [0.0071s] [ 75%] 2025-09-07T09:47:12.6399535Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_complex64 PASSED [0.0071s] [ 75%] 2025-09-07T09:47:12.6399658Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_float32 PASSED [0.0069s] [ 75%] 2025-09-07T09:47:12.6399784Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseBSR_cuda_int32 PASSED [0.0071s] [ 75%] 2025-09-07T09:47:12.6399910Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_bfloat16 PASSED [0.0032s] [ 75%] 2025-09-07T09:47:12.6400031Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_bool PASSED [0.0032s] [ 76%] 2025-09-07T09:47:12.6400158Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_complex128 PASSED [0.0033s] [ 76%] 2025-09-07T09:47:12.6400282Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_float32 PASSED [0.0032s] [ 76%] 2025-09-07T09:47:12.6400405Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_float64 PASSED [0.0032s] [ 76%] 2025-09-07T09:47:12.6400526Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSC_cuda_int16 PASSED [0.0032s] [ 76%] 2025-09-07T09:47:12.6400651Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_float32 PASSED [0.0030s] [ 76%] 2025-09-07T09:47:12.6400786Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_int16 PASSED [0.0031s] [ 76%] 2025-09-07T09:47:12.6400907Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_int32 PASSED [0.0030s] [ 76%] 2025-09-07T09:47:12.6401027Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_int8 PASSED [0.0030s] [ 76%] 2025-09-07T09:47:12.6401146Z test_sparse_csr.py::TestSparseCompressedCUDA::test_copy_errors_SparseCSR_cuda_uint8 PASSED [0.0030s] [ 76%] 2025-09-07T09:47:12.6401276Z test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseBSC_cuda SKIPPED [0.0005s] (Only runs on cpu) [ 76%] 2025-09-07T09:47:12.6402371Z test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseBSR_cuda SKIPPED [0.0004s] (Only runs on cpu) [ 76%] 2025-09-07T09:47:12.6402520Z test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseCSC_cuda SKIPPED [0.0005s] (Only runs on cpu) [ 76%] 2025-09-07T09:47:12.6402651Z test_sparse_csr.py::TestSparseCompressedCUDA::test_dim_SparseCSR_cuda SKIPPED [0.0004s] (Only runs on cpu) [ 76%] 2025-09-07T09:47:12.6402773Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_bfloat16 PASSED [0.0066s] [ 76%] 2025-09-07T09:47:12.6402887Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_bool PASSED [0.0064s] [ 76%] 2025-09-07T09:47:12.6403007Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_complex64 PASSED [0.0065s] [ 76%] 2025-09-07T09:47:12.6403189Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_float64 PASSED [0.0064s] [ 76%] 2025-09-07T09:47:12.6403304Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int16 PASSED [0.0064s] [ 76%] 2025-09-07T09:47:12.6403421Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int32 PASSED [0.0064s] [ 76%] 2025-09-07T09:47:12.6403559Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int64 PASSED [0.0064s] [ 76%] 2025-09-07T09:47:12.6403673Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_int8 PASSED [0.0064s] [ 76%] 2025-09-07T09:47:12.6403805Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSC_cuda_uint8 PASSED [0.0064s] [ 77%] 2025-09-07T09:47:12.6403926Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSR_cuda_complex64 PASSED [0.0064s] [ 77%] 2025-09-07T09:47:12.6404040Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSR_cuda_int32 PASSED [0.0064s] [ 77%] 2025-09-07T09:47:12.6404153Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_SparseCSR_cuda_int8 PASSED [0.0064s] [ 77%] 2025-09-07T09:47:12.6404283Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_complex64 PASSED [0.0006s] [ 77%] 2025-09-07T09:47:12.6404408Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_float32 PASSED [0.0005s] [ 77%] 2025-09-07T09:47:12.6404538Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_float64 PASSED [0.0004s] [ 77%] 2025-09-07T09:47:12.6404660Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_int32 PASSED [0.0004s] [ 77%] 2025-09-07T09:47:12.6404783Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSC_cuda_int8 PASSED [0.0005s] [ 77%] 2025-09-07T09:47:12.6404912Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_complex128 PASSED [0.0004s] [ 77%] 2025-09-07T09:47:12.6406004Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_float16 PASSED [0.0005s] [ 77%] 2025-09-07T09:47:12.6406132Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_float32 PASSED [0.0005s] [ 77%] 2025-09-07T09:47:12.6406255Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_int16 PASSED [0.0004s] [ 77%] 2025-09-07T09:47:12.6406381Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_int32 PASSED [0.0004s] [ 77%] 2025-09-07T09:47:12.6406524Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_int64 PASSED [0.0004s] [ 77%] 2025-09-07T09:47:12.6406646Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_errors_SparseCSR_cuda_uint8 PASSED [0.0004s] [ 77%] 2025-09-07T09:47:12.6406788Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_bfloat16 PASSED [0.0079s] [ 77%] 2025-09-07T09:47:12.6406924Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_bool PASSED [0.0076s] [ 77%] 2025-09-07T09:47:12.6407070Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_complex128 PASSED [0.0076s] [ 77%] 2025-09-07T09:47:12.6407209Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_float32 PASSED [0.0075s] [ 77%] 2025-09-07T09:47:12.6407362Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_int64 PASSED [0.0076s] [ 77%] 2025-09-07T09:47:12.6407496Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSC_cuda_int8 PASSED [0.0076s] [ 78%] 2025-09-07T09:47:12.6407634Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSR_cuda_float32 PASSED [0.0062s] [ 78%] 2025-09-07T09:47:12.6407766Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSR_cuda_int16 PASSED [0.0062s] [ 78%] 2025-09-07T09:47:12.6407899Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseBSR_cuda_int32 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6408039Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_bfloat16 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6408173Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_bool PASSED [0.0060s] [ 78%] 2025-09-07T09:47:12.6408330Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_complex128 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6408468Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_float16 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6408620Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_float64 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6408753Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_int16 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6408885Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_int32 PASSED [0.0060s] [ 78%] 2025-09-07T09:47:12.6409969Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSC_cuda_int8 PASSED [0.0063s] [ 78%] 2025-09-07T09:47:12.6410163Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSR_cuda_complex128 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6410308Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSR_cuda_complex64 PASSED [0.0060s] [ 78%] 2025-09-07T09:47:12.6410441Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSC_SparseCSR_cuda_int8 PASSED [0.0060s] [ 78%] 2025-09-07T09:47:12.6410583Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_bfloat16 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6410718Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_bool PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6410859Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_complex64 PASSED [0.0060s] [ 78%] 2025-09-07T09:47:12.6410995Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_float64 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6411130Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int16 PASSED [0.0060s] [ 78%] 2025-09-07T09:47:12.6411265Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int32 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6411417Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int64 PASSED [0.0061s] [ 78%] 2025-09-07T09:47:12.6411549Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_int8 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6411682Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSC_cuda_uint8 PASSED [0.0061s] [ 79%] 2025-09-07T09:47:12.6411813Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_bool PASSED [0.0075s] [ 79%] 2025-09-07T09:47:12.6411955Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_complex128 PASSED [0.0076s] [ 79%] 2025-09-07T09:47:12.6412088Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_int16 PASSED [0.0076s] [ 79%] 2025-09-07T09:47:12.6412244Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_int64 PASSED [0.0076s] [ 79%] 2025-09-07T09:47:12.6412379Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseBSR_cuda_uint8 PASSED [0.0075s] [ 79%] 2025-09-07T09:47:12.6412521Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_bfloat16 PASSED [0.0061s] [ 79%] 2025-09-07T09:47:12.6412662Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_complex128 PASSED [0.0061s] [ 79%] 2025-09-07T09:47:12.6412799Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_float16 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6414028Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_int16 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6414165Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_int32 PASSED [0.0061s] [ 79%] 2025-09-07T09:47:12.6414328Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_int64 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6414462Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSC_cuda_uint8 PASSED [0.0061s] [ 79%] 2025-09-07T09:47:12.6414624Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_bfloat16 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6414765Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_complex64 PASSED [0.0061s] [ 79%] 2025-09-07T09:47:12.6414902Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_float32 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6415037Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_float64 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6415170Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_int16 PASSED [0.0060s] [ 79%] 2025-09-07T09:47:12.6415305Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseBSR_SparseCSR_cuda_int32 PASSED [0.0062s] [ 79%] 2025-09-07T09:47:12.6415446Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_complex128 PASSED [0.0056s] [ 79%] 2025-09-07T09:47:12.6415583Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_float32 PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6415721Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_float64 PASSED [0.0057s] [ 80%] 2025-09-07T09:47:12.6415854Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_int32 PASSED [0.0057s] [ 80%] 2025-09-07T09:47:12.6415987Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_int64 PASSED [0.0057s] [ 80%] 2025-09-07T09:47:12.6416119Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_int8 PASSED [0.0057s] [ 80%] 2025-09-07T09:47:12.6416273Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSC_cuda_uint8 PASSED [0.0057s] [ 80%] 2025-09-07T09:47:12.6416412Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_bfloat16 PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6416545Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_bool PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6416682Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_float32 PASSED [0.0059s] [ 80%] 2025-09-07T09:47:12.6416817Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_float64 PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6417913Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_int16 PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6418051Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_int32 PASSED [0.0055s] [ 80%] 2025-09-07T09:47:12.6418208Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseBSR_cuda_uint8 PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6418348Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_bfloat16 PASSED [0.0071s] [ 80%] 2025-09-07T09:47:12.6418490Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_complex128 PASSED [0.2206s] [ 80%] 2025-09-07T09:47:12.6418627Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_float16 PASSED [0.0074s] [ 80%] 2025-09-07T09:47:12.6418763Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_float64 PASSED [0.0072s] [ 80%] 2025-09-07T09:47:12.6418898Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSC_cuda_int16 PASSED [0.0071s] [ 80%] 2025-09-07T09:47:12.6419038Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_bfloat16 PASSED [0.0057s] [ 80%] 2025-09-07T09:47:12.6419188Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_bool PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6419331Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_complex128 PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6419496Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_complex64 PASSED [0.0056s] [ 80%] 2025-09-07T09:47:12.6419632Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_float16 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6419769Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_float32 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6419903Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSC_SparseCSR_cuda_uint8 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6420042Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_bfloat16 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6420185Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_complex64 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6420321Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_float32 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6420454Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_int16 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6420589Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_int64 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6420720Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSC_cuda_int8 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6421808Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_bool PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6421951Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_complex64 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6422109Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_float16 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6422245Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_float32 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6422382Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_float64 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6422514Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseBSR_cuda_int32 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6422654Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_bfloat16 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6422785Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_bool PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6422955Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_complex128 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6423152Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_int16 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6423288Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_int32 PASSED [0.0056s] [ 81%] 2025-09-07T09:47:12.6423419Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSC_cuda_int8 PASSED [0.0055s] [ 81%] 2025-09-07T09:47:12.6423559Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_bfloat16 PASSED [0.0072s] [ 82%] 2025-09-07T09:47:12.6423698Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_complex64 PASSED [0.0070s] [ 82%] 2025-09-07T09:47:12.6423836Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_float16 PASSED [0.0070s] [ 82%] 2025-09-07T09:47:12.6423997Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_float32 PASSED [0.0070s] [ 82%] 2025-09-07T09:47:12.6424129Z test_sparse_csr.py::TestSparseCompressedCUDA::test_empty_like_SparseCSR_SparseCSR_cuda_int8 PASSED [0.0071s] [ 82%] 2025-09-07T09:47:12.6424317Z test_sparse_csr.py::TestSparseCompressedCUDA::test_invalid_input_SparseBSC_target_sparse_compressed_tensor_no_size_cuda PASSED [0.0023s] [ 82%] 2025-09-07T09:47:12.6424482Z test_sparse_csr.py::TestSparseCompressedCUDA::test_invalid_input_SparseBSR_target_sparse_compressed_tensor_cuda PASSED [0.0021s] [ 82%] 2025-09-07T09:47:12.6424653Z test_sparse_csr.py::TestSparseCompressedCUDA::test_invalid_input_SparseBSR_target_sparse_compressed_tensor_no_size_cuda PASSED [0.0015s] [ 82%] 2025-09-07T09:47:12.6424788Z test_sparse_csr.py::TestSparseCompressedCUDA::test_layout_SparseBSR_cuda SKIPPED [0.0005s] (Only runs on cpu) [ 82%] 2025-09-07T09:47:12.6424923Z test_sparse_csr.py::TestSparseCompressedCUDA::test_layout_SparseCSR_cuda SKIPPED [0.0004s] (Only runs on cpu) [ 82%] 2025-09-07T09:47:12.6426022Z test_sparse_csr.py::TestSparseCompressedCUDA::test_pickle_SparseBSC_cuda_float64 PASSED [0.0490s] [ 82%] 2025-09-07T09:47:12.6426143Z test_sparse_csr.py::TestSparseCompressedCUDA::test_pickle_SparseBSR_cuda_float64 PASSED [0.0472s] [ 82%] 2025-09-07T09:47:12.6426263Z test_sparse_csr.py::TestSparseCompressedCUDA::test_pickle_SparseCSR_cuda_float64 PASSED [0.0461s] [ 82%] 2025-09-07T09:47:12.6426376Z test_sparse_csr.py::TestSparseCompressedCUDA::test_print_SparseBSR_cuda PASSED [0.3147s] [ 82%] 2025-09-07T09:47:12.6426487Z test_sparse_csr.py::TestSparseCompressedCUDA::test_print_SparseCSR_cuda PASSED [0.2558s] [ 82%] 2025-09-07T09:47:12.6426616Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_bool PASSED [0.0836s] [ 82%] 2025-09-07T09:47:12.6426754Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_complex128 PASSED [0.1291s] [ 82%] 2025-09-07T09:47:12.6426889Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_complex64 PASSED [0.1289s] [ 82%] 2025-09-07T09:47:12.6427047Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_float32 PASSED [0.1223s] [ 82%] 2025-09-07T09:47:12.6427178Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_float64 PASSED [0.1226s] [ 82%] 2025-09-07T09:47:12.6427309Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_int16 PASSED [0.0839s] [ 82%] 2025-09-07T09:47:12.6427437Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_int32 PASSED [0.0827s] [ 82%] 2025-09-07T09:47:12.6427566Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_int8 PASSED [0.0832s] [ 83%] 2025-09-07T09:47:12.6427695Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int32_cuda_uint8 PASSED [0.0840s] [ 83%] 2025-09-07T09:47:12.6427822Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_bool PASSED [0.0822s] [ 83%] 2025-09-07T09:47:12.6427980Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_complex64 PASSED [0.1268s] [ 83%] 2025-09-07T09:47:12.6428113Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_float16 PASSED [0.1207s] [ 83%] 2025-09-07T09:47:12.6428245Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_float64 PASSED [0.1198s] [ 83%] 2025-09-07T09:47:12.6428373Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_int16 PASSED [0.0820s] [ 83%] 2025-09-07T09:47:12.6428501Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_int32 PASSED [0.0815s] [ 83%] 2025-09-07T09:47:12.6428628Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSC_int64_cuda_int8 PASSED [0.0816s] [ 83%] 2025-09-07T09:47:12.6429746Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_complex64 PASSED [0.1305s] [ 83%] 2025-09-07T09:47:12.6429906Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_float16 PASSED [0.1229s] [ 83%] 2025-09-07T09:47:12.6430037Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_int16 PASSED [0.0828s] [ 83%] 2025-09-07T09:47:12.6430184Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_int32 PASSED [0.0822s] [ 83%] 2025-09-07T09:47:12.6430313Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int32_cuda_uint8 PASSED [0.0832s] [ 83%] 2025-09-07T09:47:12.6430450Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_complex128 PASSED [0.1283s] [ 83%] 2025-09-07T09:47:12.6430587Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_float16 PASSED [0.1202s] [ 83%] 2025-09-07T09:47:12.6430718Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_float64 PASSED [0.1211s] [ 83%] 2025-09-07T09:47:12.6430852Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_int32 PASSED [0.0828s] [ 83%] 2025-09-07T09:47:12.6430980Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseBSR_int64_cuda_uint8 PASSED [0.0825s] [ 83%] 2025-09-07T09:47:12.6431119Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_float32 PASSED [0.1203s] [ 83%] 2025-09-07T09:47:12.6431247Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_int32 PASSED [0.0812s] [ 83%] 2025-09-07T09:47:12.6431376Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_int8 PASSED [0.0823s] [ 84%] 2025-09-07T09:47:12.6431503Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int32_cuda_uint8 PASSED [0.0851s] [ 84%] 2025-09-07T09:47:12.6431635Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_float16 PASSED [0.1201s] [ 84%] 2025-09-07T09:47:12.6431765Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_int32 PASSED [0.0806s] [ 84%] 2025-09-07T09:47:12.6431915Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_int64 PASSED [0.0805s] [ 84%] 2025-09-07T09:47:12.6432042Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_int8 PASSED [0.0810s] [ 84%] 2025-09-07T09:47:12.6432172Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSC_int64_cuda_uint8 PASSED [0.0807s] [ 84%] 2025-09-07T09:47:12.6432306Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int32_cuda_float16 PASSED [0.1205s] [ 84%] 2025-09-07T09:47:12.6432435Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int32_cuda_int16 PASSED [0.0832s] [ 84%] 2025-09-07T09:47:12.6433597Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_bfloat16 PASSED [0.1189s] [ 84%] 2025-09-07T09:47:12.6433755Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_bool PASSED [0.0804s] [ 84%] 2025-09-07T09:47:12.6433892Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_complex128 PASSED [0.1250s] [ 84%] 2025-09-07T09:47:12.6434027Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_complex64 PASSED [0.1257s] [ 84%] 2025-09-07T09:47:12.6434158Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_float32 PASSED [0.1190s] [ 84%] 2025-09-07T09:47:12.6434289Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_float64 PASSED [0.1200s] [ 84%] 2025-09-07T09:47:12.6434416Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_int16 PASSED [0.0916s] [ 84%] 2025-09-07T09:47:12.6434545Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_int32 PASSED [0.0927s] [ 84%] 2025-09-07T09:47:12.6434691Z test_sparse_csr.py::TestSparseCompressedCUDA::test_select_copy_SparseCSR_int64_cuda_int8 PASSED [0.0923s] [ 84%] 2025-09-07T09:47:12.6434864Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSC_cuda_complex128 PASSED [0.0566s] [ 84%] 2025-09-07T09:47:12.6435043Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSC_cuda_int64 PASSED [0.0266s] [ 84%] 2025-09-07T09:47:12.6435208Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_float16 PASSED [0.0576s] [ 84%] 2025-09-07T09:47:12.6435372Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_float64 PASSED [0.0531s] [ 84%] 2025-09-07T09:47:12.6435537Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_int32 PASSED [0.0267s] [ 85%] 2025-09-07T09:47:12.6435704Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_int64 PASSED [0.0262s] [ 85%] 2025-09-07T09:47:12.6435866Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseBSR_cuda_uint8 PASSED [0.0265s] [ 85%] 2025-09-07T09:47:12.6436030Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_float32 PASSED [0.0517s] [ 85%] 2025-09-07T09:47:12.6436190Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_int16 PASSED [0.0262s] [ 85%] 2025-09-07T09:47:12.6436350Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_int32 PASSED [0.0260s] [ 85%] 2025-09-07T09:47:12.6436510Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_int64 PASSED [0.0259s] [ 85%] 2025-09-07T09:47:12.6436672Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSC_cuda_uint8 PASSED [0.0260s] [ 85%] 2025-09-07T09:47:12.6437818Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_bfloat16 PASSED [0.0516s] [ 85%] 2025-09-07T09:47:12.6437992Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_complex128 PASSED [0.0545s] [ 85%] 2025-09-07T09:47:12.6438156Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_float16 PASSED [0.0519s] [ 85%] 2025-09-07T09:47:12.6438318Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_float32 PASSED [0.0517s] [ 85%] 2025-09-07T09:47:12.6438481Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_list_SparseCSR_cuda_float64 PASSED [0.0518s] [ 85%] 2025-09-07T09:47:12.6438663Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_bool PASSED [0.0401s] [ 85%] 2025-09-07T09:47:12.6438836Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_complex64 PASSED [0.0962s] [ 85%] 2025-09-07T09:47:12.6439004Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_float16 PASSED [0.0916s] [ 85%] 2025-09-07T09:47:12.6439170Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_float32 PASSED [0.0920s] [ 85%] 2025-09-07T09:47:12.6439334Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_int16 PASSED [0.0403s] [ 85%] 2025-09-07T09:47:12.6439495Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSC_cuda_int8 PASSED [0.0407s] [ 85%] 2025-09-07T09:47:12.6439679Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_bfloat16 PASSED [0.0908s] [ 85%] 2025-09-07T09:47:12.6439841Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_bool PASSED [0.0405s] [ 85%] 2025-09-07T09:47:12.6440022Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_float64 PASSED [0.0914s] [ 86%] 2025-09-07T09:47:12.6440185Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_int16 PASSED [0.0405s] [ 86%] 2025-09-07T09:47:12.6440348Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseBSR_cuda_int64 PASSED [0.0405s] [ 86%] 2025-09-07T09:47:12.6440515Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_bfloat16 PASSED [0.0890s] [ 86%] 2025-09-07T09:47:12.6440682Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_bool PASSED [0.0394s] [ 86%] 2025-09-07T09:47:12.6440855Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_complex128 PASSED [0.0938s] [ 86%] 2025-09-07T09:47:12.6441027Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_float16 PASSED [0.0897s] [ 86%] 2025-09-07T09:47:12.6441190Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_int16 PASSED [0.0410s] [ 86%] 2025-09-07T09:47:12.6442315Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_int32 PASSED [0.0393s] [ 86%] 2025-09-07T09:47:12.6442479Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSC_cuda_int8 PASSED [0.0391s] [ 86%] 2025-09-07T09:47:12.6442644Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_bool PASSED [0.0389s] [ 86%] 2025-09-07T09:47:12.6442832Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_complex64 PASSED [0.0872s] [ 86%] 2025-09-07T09:47:12.6442998Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_float16 PASSED [0.0828s] [ 86%] 2025-09-07T09:47:12.6443215Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_float32 PASSED [0.0828s] [ 86%] 2025-09-07T09:47:12.6443380Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_float64 PASSED [0.0825s] [ 86%] 2025-09-07T09:47:12.6443542Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_int64 PASSED [0.0369s] [ 86%] 2025-09-07T09:47:12.6443729Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_____from_tensor_SparseCSR_cuda_uint8 PASSED [0.0368s] [ 86%] 2025-09-07T09:47:12.6443907Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_bfloat16 PASSED [0.0491s] [ 86%] 2025-09-07T09:47:12.6444087Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_complex128 PASSED [0.0513s] [ 86%] 2025-09-07T09:47:12.6444266Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_complex64 PASSED [0.0513s] [ 86%] 2025-09-07T09:47:12.6444442Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_float32 PASSED [0.0497s] [ 86%] 2025-09-07T09:47:12.6444617Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_float64 PASSED [0.0495s] [ 86%] 2025-09-07T09:47:12.6444805Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_int16 PASSED [0.0251s] [ 87%] 2025-09-07T09:47:12.6444994Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_int32 PASSED [0.0248s] [ 87%] 2025-09-07T09:47:12.6445164Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSC_cuda_int64 PASSED [0.0248s] [ 87%] 2025-09-07T09:47:12.6445340Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_bfloat16 PASSED [0.0497s] [ 87%] 2025-09-07T09:47:12.6445508Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_bool PASSED [0.0249s] [ 87%] 2025-09-07T09:47:12.6445685Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_complex128 PASSED [0.0519s] [ 87%] 2025-09-07T09:47:12.6445861Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_float16 PASSED [0.0505s] [ 87%] 2025-09-07T09:47:12.6447005Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_float64 PASSED [0.0494s] [ 87%] 2025-09-07T09:47:12.6447179Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_int16 PASSED [0.0250s] [ 87%] 2025-09-07T09:47:12.6447349Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseBSR_cuda_int32 PASSED [0.0258s] [ 87%] 2025-09-07T09:47:12.6447526Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_bfloat16 PASSED [0.0483s] [ 87%] 2025-09-07T09:47:12.6447705Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_complex128 PASSED [0.0510s] [ 87%] 2025-09-07T09:47:12.6447897Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_int8 PASSED [0.0243s] [ 87%] 2025-09-07T09:47:12.6448068Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSC_cuda_uint8 PASSED [0.0246s] [ 87%] 2025-09-07T09:47:12.6448238Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_bool PASSED [0.0245s] [ 87%] 2025-09-07T09:47:12.6448415Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_complex64 PASSED [0.0505s] [ 87%] 2025-09-07T09:47:12.6448588Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_float16 PASSED [0.0486s] [ 87%] 2025-09-07T09:47:12.6448777Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_float32 PASSED [0.0488s] [ 87%] 2025-09-07T09:47:12.6448948Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_list_SparseCSR_cuda_uint8 PASSED [0.0244s] [ 87%] 2025-09-07T09:47:12.6449121Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_bool PASSED [0.0383s] [ 87%] 2025-09-07T09:47:12.6449297Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_float16 PASSED [0.0858s] [ 87%] 2025-09-07T09:47:12.6449477Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_float64 PASSED [0.0862s] [ 88%] 2025-09-07T09:47:12.6449648Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSC_cuda_int8 PASSED [0.0395s] [ 88%] 2025-09-07T09:47:12.6449838Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_bool PASSED [0.0393s] [ 88%] 2025-09-07T09:47:12.6450020Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_complex128 PASSED [0.0894s] [ 88%] 2025-09-07T09:47:12.6450291Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_complex64 PASSED [0.0897s] [ 88%] 2025-09-07T09:47:12.6450468Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_float16 PASSED [0.0852s] [ 88%] 2025-09-07T09:47:12.6450643Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_float64 PASSED [0.0857s] [ 88%] 2025-09-07T09:47:12.6451780Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseBSR_cuda_int8 PASSED [0.0384s] [ 88%] 2025-09-07T09:47:12.6451962Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSC_cuda_float16 PASSED [0.0833s] [ 88%] 2025-09-07T09:47:12.6452137Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSC_cuda_int32 PASSED [0.0372s] [ 88%] 2025-09-07T09:47:12.6452318Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_complex128 PASSED [0.0873s] [ 88%] 2025-09-07T09:47:12.6452498Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_complex64 PASSED [0.0872s] [ 88%] 2025-09-07T09:47:12.6452674Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_float16 PASSED [0.0832s] [ 88%] 2025-09-07T09:47:12.6452851Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_float32 PASSED [0.0831s] [ 88%] 2025-09-07T09:47:12.6453047Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_float64 PASSED [0.0833s] [ 88%] 2025-09-07T09:47:12.6453396Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor___factory_from_tensor_SparseCSR_cuda_uint8 PASSED [0.0371s] [ 88%] 2025-09-07T09:47:12.6453623Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_bfloat16 SKIPPED [0.0005s] (nothing to test) [ 88%] 2025-09-07T09:47:12.6453846Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_bool SKIPPED [0.0004s] (nothing to test) [ 88%] 2025-09-07T09:47:12.6454066Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_float32 SKIPPED [0.0004s] (nothing to test) [ 88%] 2025-09-07T09:47:12.6454312Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_int16 SKIPPED [0.0004s] (nothing to test) [ 88%] 2025-09-07T09:47:12.6454531Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_int8 SKIPPED [0.0005s] (nothing to test) [ 88%] 2025-09-07T09:47:12.6454752Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSC_cuda_uint8 SKIPPED [0.0005s] (nothing to test) [ 88%] 2025-09-07T09:47:12.6454974Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_bfloat16 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6455193Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_bool SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6455439Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_complex128 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6455682Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_complex64 SKIPPED [0.0005s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6455903Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_float16 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6456118Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_int8 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6457334Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseBSR_cuda_uint8 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6457561Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_bfloat16 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6457778Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_bool SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6458003Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_complex128 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6458227Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSC_cuda_complex64 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6458452Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_bfloat16 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6458705Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_complex128 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6458926Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_float32 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6459144Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_int32 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6459363Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_int64 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6459595Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_int8 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6459816Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_list_SparseCSR_cuda_uint8 SKIPPED [0.0004s] (nothing to test) [ 89%] 2025-09-07T09:47:12.6460018Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_bfloat16 PASSED [0.0837s] [ 89%] 2025-09-07T09:47:12.6460216Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_bool PASSED [0.0376s] [ 89%] 2025-09-07T09:47:12.6460420Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_complex128 PASSED [0.0878s] [ 89%] 2025-09-07T09:47:12.6460638Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_complex64 PASSED [0.0916s] [ 90%] 2025-09-07T09:47:12.6460850Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_int8 PASSED [0.0429s] [ 90%] 2025-09-07T09:47:12.6461048Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSC_cuda_uint8 PASSED [0.0379s] [ 90%] 2025-09-07T09:47:12.6461249Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_bfloat16 PASSED [0.0825s] [ 90%] 2025-09-07T09:47:12.6461445Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_bool PASSED [0.0376s] [ 90%] 2025-09-07T09:47:12.6461650Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_complex64 PASSED [0.0865s] [ 90%] 2025-09-07T09:47:12.6462810Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_float64 PASSED [0.0826s] [ 90%] 2025-09-07T09:47:12.6463010Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseBSR_cuda_int32 PASSED [0.0374s] [ 90%] 2025-09-07T09:47:12.6463326Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_complex128 PASSED [0.0851s] [ 90%] 2025-09-07T09:47:12.6463529Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_complex64 PASSED [0.0848s] [ 90%] 2025-09-07T09:47:12.6463730Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_float16 PASSED [0.0805s] [ 90%] 2025-09-07T09:47:12.6463954Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_float32 PASSED [0.0808s] [ 90%] 2025-09-07T09:47:12.6464152Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSC_cuda_uint8 PASSED [0.0360s] [ 90%] 2025-09-07T09:47:12.6464355Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_bfloat16 PASSED [0.0821s] [ 90%] 2025-09-07T09:47:12.6464560Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_complex128 PASSED [0.0863s] [ 90%] 2025-09-07T09:47:12.6464786Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_complex64 PASSED [0.0849s] [ 90%] 2025-09-07T09:47:12.6464986Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_float32 PASSED [0.0816s] [ 90%] 2025-09-07T09:47:12.6465183Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference___from_tensor_SparseCSR_cuda_uint8 PASSED [0.0364s] [ 90%] 2025-09-07T09:47:12.6465417Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_complex64 SKIPPED [0.0005s] (nothing to test) [ 90%] 2025-09-07T09:47:12.6465651Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_float32 SKIPPED [0.0004s] (nothing to test) [ 90%] 2025-09-07T09:47:12.6465902Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_int16 SKIPPED [0.0005s] (nothing to test) [ 90%] 2025-09-07T09:47:12.6466147Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSC_cuda_int64 SKIPPED [0.0004s] (nothing to test) [ 90%] 2025-09-07T09:47:12.6466379Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_complex64 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6466609Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_float16 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6466840Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_float32 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6467071Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_float64 SKIPPED [0.0005s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6467298Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_int8 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6468507Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseBSR_cuda_uint8 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6468740Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_bfloat16 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6468971Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_complex64 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6469222Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_float16 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6469453Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_float32 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6469682Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_float64 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6469912Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_int64 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6470153Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_int8 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6470383Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSC_cuda_uint8 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6470611Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_float32 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6470838Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_int16 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6471065Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_int32 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6471314Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_int64 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6471552Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_list_SparseCSR_cuda_uint8 SKIPPED [0.0004s] (nothing to test) [ 91%] 2025-09-07T09:47:12.6471764Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_bfloat16 PASSED [0.0830s] [ 91%] 2025-09-07T09:47:12.6471974Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_float16 PASSED [0.0826s] [ 91%] 2025-09-07T09:47:12.6472184Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_float64 PASSED [0.0860s] [ 92%] 2025-09-07T09:47:12.6472391Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_int32 PASSED [0.0395s] [ 92%] 2025-09-07T09:47:12.6472599Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSC_cuda_int8 PASSED [0.0395s] [ 92%] 2025-09-07T09:47:12.6472810Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_complex64 PASSED [0.0933s] [ 92%] 2025-09-07T09:47:12.6473018Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_float16 PASSED [0.0916s] [ 92%] 2025-09-07T09:47:12.6474259Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_int64 PASSED [0.0416s] [ 92%] 2025-09-07T09:47:12.6474493Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_int8 PASSED [0.0408s] [ 92%] 2025-09-07T09:47:12.6474701Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseBSR_cuda_uint8 PASSED [0.0402s] [ 92%] 2025-09-07T09:47:12.6474909Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_bfloat16 PASSED [0.0868s] [ 92%] 2025-09-07T09:47:12.6475115Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_bool PASSED [0.0384s] [ 92%] 2025-09-07T09:47:12.6475321Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_float16 PASSED [0.0876s] [ 92%] 2025-09-07T09:47:12.6475552Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_int32 PASSED [0.0389s] [ 92%] 2025-09-07T09:47:12.6475759Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_int64 PASSED [0.0384s] [ 92%] 2025-09-07T09:47:12.6475964Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSC_cuda_uint8 PASSED [0.0383s] [ 92%] 2025-09-07T09:47:12.6476172Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_bfloat16 PASSED [0.0873s] [ 92%] 2025-09-07T09:47:12.6476377Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_bool PASSED [0.0370s] [ 92%] 2025-09-07T09:47:12.6476611Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_complex128 PASSED [0.0851s] [ 92%] 2025-09-07T09:47:12.6476837Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_complex64 PASSED [0.0852s] [ 92%] 2025-09-07T09:47:12.6477041Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_int8 PASSED [0.0364s] [ 92%] 2025-09-07T09:47:12.6477244Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_constructor_shape_and_device_inference_factory_from_tensor_SparseCSR_cuda_uint8 PASSED [0.0363s] [ 92%] 2025-09-07T09:47:12.6477400Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_bool PASSED [0.0436s] [ 92%] 2025-09-07T09:47:12.6477564Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_complex128 PASSED [0.0501s] [ 92%] 2025-09-07T09:47:12.6477722Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_float64 PASSED [0.0490s] [ 93%] 2025-09-07T09:47:12.6477877Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_int16 PASSED [0.0430s] [ 93%] 2025-09-07T09:47:12.6478031Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_int32 PASSED [0.0431s] [ 93%] 2025-09-07T09:47:12.6478182Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_int8 PASSED [0.0436s] [ 93%] 2025-09-07T09:47:12.6479302Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSC_cuda_uint8 PASSED [0.0432s] [ 93%] 2025-09-07T09:47:12.6479463Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_bfloat16 PASSED [0.0494s] [ 93%] 2025-09-07T09:47:12.6479643Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_complex128 PASSED [0.0513s] [ 93%] 2025-09-07T09:47:12.6479798Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_float32 PASSED [0.0511s] [ 93%] 2025-09-07T09:47:12.6479953Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_float64 PASSED [0.0494s] [ 93%] 2025-09-07T09:47:12.6480104Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_int32 PASSED [0.0433s] [ 93%] 2025-09-07T09:47:12.6480255Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_int8 PASSED [0.0429s] [ 93%] 2025-09-07T09:47:12.6480406Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseBSR_cuda_uint8 PASSED [0.0431s] [ 93%] 2025-09-07T09:47:12.6480582Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_bfloat16 PASSED [0.0461s] [ 93%] 2025-09-07T09:47:12.6480741Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_complex128 PASSED [0.0488s] [ 93%] 2025-09-07T09:47:12.6480897Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_float32 PASSED [0.0474s] [ 93%] 2025-09-07T09:47:12.6481046Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSC_cuda_int8 PASSED [0.0455s] [ 93%] 2025-09-07T09:47:12.6481206Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_bfloat16 PASSED [0.0469s] [ 93%] 2025-09-07T09:47:12.6481356Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_bool PASSED [0.0406s] [ 93%] 2025-09-07T09:47:12.6481530Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_complex64 PASSED [0.0473s] [ 93%] 2025-09-07T09:47:12.6481685Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_float32 PASSED [0.0464s] [ 93%] 2025-09-07T09:47:12.6481853Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_float64 PASSED [0.0463s] [ 93%] 2025-09-07T09:47:12.6482005Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_int16 PASSED [0.0405s] [ 94%] 2025-09-07T09:47:12.6482157Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_int32 PASSED [0.0408s] [ 94%] 2025-09-07T09:47:12.6482307Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_int64 PASSED [0.0407s] [ 94%] 2025-09-07T09:47:12.6482459Z test_sparse_csr.py::TestSparseCompressedCUDA::test_sparse_compressed_tensor_with_dims_SparseCSR_cuda_uint8 PASSED [0.0408s] [ 94%] 2025-09-07T09:47:12.6483624Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_bfloat16 PASSED [0.1006s] [ 94%] 2025-09-07T09:47:12.6483755Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_complex128 PASSED [0.1016s] [ 94%] 2025-09-07T09:47:12.6483879Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_float64 PASSED [0.1102s] [ 94%] 2025-09-07T09:47:12.6483996Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_int16 PASSED [0.1125s] [ 94%] 2025-09-07T09:47:12.6484116Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSC_cuda_int32 PASSED [0.1125s] [ 94%] 2025-09-07T09:47:12.6484240Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_complex128 PASSED [0.1127s] [ 94%] 2025-09-07T09:47:12.6484365Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_complex64 PASSED [0.1119s] [ 94%] 2025-09-07T09:47:12.6484486Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_float64 PASSED [0.1108s] [ 94%] 2025-09-07T09:47:12.6484630Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_int8 PASSED [0.1104s] [ 94%] 2025-09-07T09:47:12.6484748Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseBSR_cuda_uint8 PASSED [0.1105s] [ 94%] 2025-09-07T09:47:12.6484870Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_bfloat16 PASSED [0.1116s] [ 94%] 2025-09-07T09:47:12.6484987Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_bool PASSED [0.1114s] [ 94%] 2025-09-07T09:47:12.6485110Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_complex64 PASSED [0.1034s] [ 94%] 2025-09-07T09:47:12.6485228Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_float32 PASSED [0.0994s] [ 94%] 2025-09-07T09:47:12.6485362Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_int16 PASSED [0.0981s] [ 94%] 2025-09-07T09:47:12.6485480Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_int32 PASSED [0.0981s] [ 94%] 2025-09-07T09:47:12.6485595Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSC_cuda_int8 PASSED [0.1022s] [ 94%] 2025-09-07T09:47:12.6485718Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_bfloat16 PASSED [0.0979s] [ 94%] 2025-09-07T09:47:12.6485834Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_bool PASSED [0.0810s] [ 95%] 2025-09-07T09:47:12.6485960Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_complex128 PASSED [0.0852s] [ 95%] 2025-09-07T09:47:12.6486081Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_float16 PASSED [0.0970s] [ 95%] 2025-09-07T09:47:12.6487166Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_int64 PASSED [0.0810s] [ 95%] 2025-09-07T09:47:12.6487308Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_int8 PASSED [0.0816s] [ 95%] 2025-09-07T09:47:12.6487427Z test_sparse_csr.py::TestSparseCompressedCUDA::test_to_dtype_SparseCSR_cuda_uint8 PASSED [0.0819s] [ 95%] 2025-09-07T09:47:12.6487570Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_float16 PASSED [0.0203s] [ 95%] 2025-09-07T09:47:12.6487692Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_float32 PASSED [0.0202s] [ 95%] 2025-09-07T09:47:12.6487813Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_float64 PASSED [0.0201s] [ 95%] 2025-09-07T09:47:12.6487931Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_int16 PASSED [0.0162s] [ 95%] 2025-09-07T09:47:12.6488049Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_int32 PASSED [0.0163s] [ 95%] 2025-09-07T09:47:12.6488167Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSC_cuda_int8 PASSED [0.0171s] [ 95%] 2025-09-07T09:47:12.6488288Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_bool PASSED [0.0171s] [ 95%] 2025-09-07T09:47:12.6488408Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_float32 PASSED [0.0225s] [ 95%] 2025-09-07T09:47:12.6488527Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_int64 PASSED [0.0173s] [ 95%] 2025-09-07T09:47:12.6488645Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseBSR_cuda_uint8 PASSED [0.0162s] [ 95%] 2025-09-07T09:47:12.6488768Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_bfloat16 PASSED [0.0202s] [ 95%] 2025-09-07T09:47:12.6488889Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_float16 PASSED [0.0192s] [ 95%] 2025-09-07T09:47:12.6489013Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_float64 PASSED [0.0189s] [ 95%] 2025-09-07T09:47:12.6489133Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_int16 PASSED [0.0151s] [ 95%] 2025-09-07T09:47:12.6489265Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSC_cuda_int64 PASSED [0.0150s] [ 95%] 2025-09-07T09:47:12.6489391Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_complex64 PASSED [0.0198s] [ 96%] 2025-09-07T09:47:12.6489512Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_float16 PASSED [0.0191s] [ 96%] 2025-09-07T09:47:12.6489630Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int16 PASSED [0.0152s] [ 96%] 2025-09-07T09:47:12.6490777Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int32 PASSED [0.0152s] [ 96%] 2025-09-07T09:47:12.6490899Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int64 PASSED [0.0151s] [ 96%] 2025-09-07T09:47:12.6491016Z test_sparse_csr.py::TestSparseCompressedCUDA::test_validate_SparseCSR_cuda_int8 PASSED [0.0152s] [ 96%] 2025-09-07T09:47:12.6491279Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_16_int64_cuda_bfloat16 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6491504Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_16_int64_cuda_float16 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6491724Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_16_int64_cuda_float32 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6491947Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int32_cuda_bfloat16 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6492166Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int32_cuda_float16 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6492410Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int32_cuda_float32 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6492643Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int64_cuda_bfloat16 SKIPPED [0.0002s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6492865Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_32_int64_cuda_float16 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6493144Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_64_int32_cuda_bfloat16 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6493366Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_64_int32_cuda_float32 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6493585Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_dense_bmm_block_size_64_int64_cuda_float32 SKIPPED [0.0001s] (Skipped for internal with remote GPUs) [ 96%] 2025-09-07T09:47:12.6493757Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_16_cuda_float32 PASSED [13.2130s] [ 96%] 2025-09-07T09:47:12.6493925Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_2_cuda_bfloat16 PASSED [3.1409s] [ 96%] 2025-09-07T09:47:12.6494091Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_2_cuda_float32 PASSED [1.7127s] [ 96%] 2025-09-07T09:47:12.6494259Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_2x3_cuda_float32 PASSED [1.6443s] [ 96%] 2025-09-07T09:47:12.6494428Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_scatter_mm_blocksize_32_cuda_float32 PASSED [24.6948s] [ 96%] 2025-09-07T09:47:12.6494673Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_softmax_cuda_bfloat16 SKIPPED [0.0003s] (test is slow; run with PYTORCH_TEST_WITH_SLOW to enable test) [ 97%] 2025-09-07T09:47:12.6494894Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_softmax_cuda_float16 SKIPPED [0.0002s] (test is slow; run with PYTORCH_TEST_WITH_SLOW to enable test) [ 97%] 2025-09-07T09:47:12.6496098Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_bsr_softmax_cuda_float32 SKIPPED [0.0002s] (test is slow; run with PYTORCH_TEST_WITH_SLOW to enable test) [ 97%] 2025-09-07T09:47:12.6496401Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16_out_dtype_unspecified_cuda_int8 SKIPPED [0.0006s] (triton kernel does not support support int8 blocks smaller than 32) [ 97%] 2025-09-07T09:47:12.6496675Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0004s] (out dtype not implemented) [ 97%] 2025-09-07T09:47:12.6496919Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_float16 SKIPPED [0.0006s] (out dtype not implemented) [ 97%] 2025-09-07T09:47:12.6497216Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_bfloat16 SKIPPED [0.0004s] (Redundant test: _int_bsr_dense_addmm on torch.bfloat16 tensors) [ 97%] 2025-09-07T09:47:12.6497508Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_float16 SKIPPED [0.0004s] (Redundant test: _int_bsr_dense_addmm on torch.float16 tensors) [ 97%] 2025-09-07T09:47:12.6497816Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_float32 SKIPPED [0.0005s] (Redundant test: _int_bsr_dense_addmm on torch.float32 tensors) [ 97%] 2025-09-07T09:47:12.6498129Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_16x32_out_dtype_unspecified_cuda_int8 SKIPPED [0.0005s] (triton kernel does not support support int8 blocks smaller than 32) [ 97%] 2025-09-07T09:47:12.6498369Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0005s] (out dtype not implemented) [ 97%] 2025-09-07T09:47:12.6498601Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_int8 SKIPPED [0.0004s] (out dtype not implemented) [ 97%] 2025-09-07T09:47:12.6498891Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_float16 SKIPPED [0.0004s] (Redundant test: _int_bsr_dense_addmm on torch.float16 tensors) [ 97%] 2025-09-07T09:47:12.6499102Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op__int_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_int8 PASSED [24.0495s] [ 97%] 2025-09-07T09:47:12.6499335Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0010s] (incompatible out dtype) [ 97%] 2025-09-07T09:47:12.6499563Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16_out_dtype_int32_cuda_float16 SKIPPED [0.0005s] (incompatible out dtype) [ 97%] 2025-09-07T09:47:12.6499794Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16_out_dtype_int32_cuda_float32 SKIPPED [0.0004s] (incompatible out dtype) [ 97%] 2025-09-07T09:47:12.6500046Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0004s] (incompatible out dtype) [ 97%] 2025-09-07T09:47:12.6500282Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_float16 SKIPPED [0.0007s] (incompatible out dtype) [ 97%] 2025-09-07T09:47:12.6500517Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_16x32_out_dtype_int32_cuda_float32 SKIPPED [0.0005s] (incompatible out dtype) [ 97%] 2025-09-07T09:47:12.6500746Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0004s] (incompatible out dtype) [ 97%] 2025-09-07T09:47:12.6500989Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_float16 SKIPPED [0.0006s] (incompatible out dtype) [ 98%] 2025-09-07T09:47:12.6501189Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_int32_cuda_int8 PASSED [1.3438s] [ 98%] 2025-09-07T09:47:12.6502354Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_float16 PASSED [20.5840s] [ 98%] 2025-09-07T09:47:12.6502560Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_addmm_blocksize_32_out_dtype_unspecified_cuda_int8 PASSED [20.4474s] [ 98%] 2025-09-07T09:47:12.6502795Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0009s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6503024Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_int32_cuda_int8 SKIPPED [0.0005s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6503297Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_unspecified_cuda_bfloat16 PASSED [0.0545s] [ 98%] 2025-09-07T09:47:12.6503523Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_unspecified_cuda_float32 PASSED [0.0455s] [ 98%] 2025-09-07T09:47:12.6503777Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16_out_dtype_unspecified_cuda_int8 SKIPPED [0.0005s] (bsr_dense_linear does not support int8) [ 98%] 2025-09-07T09:47:12.6504016Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16x32_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0005s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6504257Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16x32_out_dtype_int32_cuda_float32 SKIPPED [0.0004s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6504543Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_16x32_out_dtype_unspecified_cuda_float32 SKIPPED [0.0005s] (bsr_dense_linear does not support non-square blocks) [ 98%] 2025-09-07T09:47:12.6504778Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_32_out_dtype_int32_cuda_float16 SKIPPED [0.0006s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6504983Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_32_out_dtype_unspecified_cuda_bfloat16 PASSED [0.0471s] [ 98%] 2025-09-07T09:47:12.6505189Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_linear_blocksize_32_out_dtype_unspecified_cuda_float16 PASSED [0.0468s] [ 98%] 2025-09-07T09:47:12.6505436Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0005s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6505665Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_int32_cuda_float16 SKIPPED [0.0005s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6505888Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_int32_cuda_int8 SKIPPED [0.0004s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6506088Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16_out_dtype_unspecified_cuda_float32 PASSED [0.7109s] [ 98%] 2025-09-07T09:47:12.6506335Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16x32_out_dtype_int32_cuda_int8 SKIPPED [0.0009s] (out dtype not implemented) [ 98%] 2025-09-07T09:47:12.6506543Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16x32_out_dtype_unspecified_cuda_bfloat16 PASSED [0.7172s] [ 98%] 2025-09-07T09:47:12.6506746Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_16x32_out_dtype_unspecified_cuda_float16 PASSED [0.7111s] [ 98%] 2025-09-07T09:47:12.6506977Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0009s] (out dtype not implemented) [ 99%] 2025-09-07T09:47:12.6508183Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_int32_cuda_float16 SKIPPED [0.0005s] (out dtype not implemented) [ 99%] 2025-09-07T09:47:12.6508386Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_unspecified_cuda_float32 PASSED [0.7114s] [ 99%] 2025-09-07T09:47:12.6508605Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_kernel_op_bsr_dense_mm_blocksize_32_out_dtype_unspecified_cuda_int8 PASSED [0.0349s] [ 99%] 2025-09-07T09:47:12.6508793Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_sampled_addmm_block_size_64_cuda_bfloat16 PASSED [15.8137s] [ 99%] 2025-09-07T09:47:12.6508961Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_sampled_addmm_block_size_64_cuda_float16 PASSED [15.9930s] [ 99%] 2025-09-07T09:47:12.6509128Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_sampled_addmm_block_size_64_cuda_float32 PASSED [15.5890s] [ 99%] 2025-09-07T09:47:12.6509318Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_16_cuda_bfloat16 PASSED [5.9316s] [ 99%] 2025-09-07T09:47:12.6509508Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_32_cuda_bfloat16 PASSED [5.3319s] [ 99%] 2025-09-07T09:47:12.6509695Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_32_cuda_float16 PASSED [5.6111s] [ 99%] 2025-09-07T09:47:12.6509880Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_64_cuda_bfloat16 PASSED [5.7276s] [ 99%] 2025-09-07T09:47:12.6510066Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scaled_dot_product_attention_block_size_64_cuda_float32 PASSED [6.4357s] [ 99%] 2025-09-07T09:47:12.6510216Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_scatter_mm_cuda_float16 PASSED [0.4048s] [ 99%] 2025-09-07T09:47:12.6510441Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0009s] (out dtype not implemented) [ 99%] 2025-09-07T09:47:12.6510663Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_float16 SKIPPED [0.0005s] (out dtype not implemented) [ 99%] 2025-09-07T09:47:12.6510906Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_float32 SKIPPED [0.0004s] (out dtype not implemented) [ 99%] 2025-09-07T09:47:12.6511124Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_int32_cuda_int8 SKIPPED [0.0004s] (out dtype not implemented) [ 99%] 2025-09-07T09:47:12.6511319Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op__int_bsr_dense_addmm_out_dtype_unspecified_cuda_float16 PASSED [5.3671s] [ 99%] 2025-09-07T09:47:12.6511534Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_int32_cuda_bfloat16 SKIPPED [0.0008s] (incompatible out dtype) [ 99%] 2025-09-07T09:47:12.6511729Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_int32_cuda_int8 PASSED [4.0799s] [ 99%] 2025-09-07T09:47:12.6511923Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_unspecified_cuda_bfloat16 PASSED [4.2379s] [ 99%] 2025-09-07T09:47:12.6512108Z test_sparse_csr.py::TestSparseCompressedTritonKernelsCUDA::test_triton_tune_op_bsr_dense_addmm_out_dtype_unspecified_cuda_int8 PASSED [5.3574s] [100%] 2025-09-07T09:47:12.6512112Z 2025-09-07T09:47:12.6513332Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_sparse_csr/test_sparse_csr-44dd32f10c369488.xml - 2025-09-07T09:47:12.6513417Z ======== 1887 passed, 264 skipped, 266 deselected in 252.26s (0:04:12) ========= 2025-09-07T09:47:12.6513610Z The following tests failed and then succeeded when run in a new process['test/test_sparse_csr.py::TestSparseCSRCUDA::test_select_SparseBSC_int32_cuda_float16'] 2025-09-07T09:47:12.6513641Z 2025-09-07T09:47:12.6513773Z FINISHED PRINTING LOG FILE of test_sparse_csr 2/2 (test/test-reports/test_sparse_csr_2.2_b69370d88dea38b2_.log) 2025-09-07T09:47:12.6513775Z 2025-09-07T09:47:12.6513846Z Running xpu/test_fusion 1/1 ... [2025-09-07 09:47:12.514813] 2025-09-07T09:47:12.6513894Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-09-07T09:47:12.6514203Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'xpu/test_fusion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2025-09-07 09:47:12.515012] 2025-09-07T09:47:14.8094606Z 2025-09-07T09:47:14.8095181Z xpu/test_fusion 1/1 was successful, full logs can be found in artifacts with path test/test-reports/xpu.test_fusion_1.1_36df0856f7d8e51b_.log 2025-09-07T09:47:14.8095517Z Running 0 items in this shard: 2025-09-07T09:47:14.8095605Z 2025-09-07T09:47:16.0944856Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/hypothesis/entry_points.py:23: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81. 2025-09-07T09:47:16.0946116Z import pkg_resources 2025-09-07T09:47:16.8670619Z Running test batch 'tests to run' cost 10934.39 seconds 2025-09-07T09:47:16.8677039Z Emiting td_test_failure_stats_v2 2025-09-07T09:47:16.8679770Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1757238436_a3a8111e8bcf11f0bc08365ca561ee71 2025-09-07T09:47:16.9170584Z /var/lib/jenkins/pytorch/tools/stats/upload_metrics.py:156: UserWarning: Error uploading metric td_test_failure_stats_v2 to DynamoDB: Unable to locate credentials 2025-09-07T09:47:16.9171547Z warn(f"Error uploading metric {metric_name} to DynamoDB: {e}") 2025-09-07T09:47:16.9171978Z inductor/test_control_flow 2/2 failed! 2025-09-07T09:47:17.4564267Z 2025-09-07T09:47:17.4564588Z real 182m17.154s 2025-09-07T09:47:17.4565144Z user 3131m9.102s 2025-09-07T09:47:17.4565390Z sys 89m19.561s 2025-09-07T09:47:17.4565646Z + sccache_epilogue 2025-09-07T09:47:17.4565972Z + echo '::group::Sccache Compilation Log' 2025-09-07T09:47:17.4566679Z ##[group]Sccache Compilation Log 2025-09-07T09:47:17.4567075Z + echo '=================== sccache compilation log ===================' 2025-09-07T09:47:17.4567510Z =================== sccache compilation log =================== 2025-09-07T09:47:17.4568128Z + python /var/lib/jenkins/pytorch/.ci/pytorch/print_sccache_log.py /var/lib/jenkins/sccache_error.log 2025-09-07T09:47:17.4643582Z + echo '=========== If your build fails, please take a look at the log above for possible reasons ===========' 2025-09-07T09:47:17.4644037Z =========== If your build fails, please take a look at the log above for possible reasons =========== 2025-09-07T09:47:17.4644401Z + sccache --show-stats 2025-09-07T09:47:17.4671879Z Compile requests 9792 2025-09-07T09:47:17.4673591Z Compile requests executed 602 2025-09-07T09:47:17.4673936Z Cache hits 110 2025-09-07T09:47:17.4674158Z Cache hits (C/C++) 110 2025-09-07T09:47:17.4674384Z Cache misses 472 2025-09-07T09:47:17.4674623Z Cache misses (C/C++) 463 2025-09-07T09:47:17.4674846Z Cache misses (HIP) 9 2025-09-07T09:47:17.4675075Z Cache hits rate 18.90 % 2025-09-07T09:47:17.4675312Z Cache hits rate (C/C++) 19.20 % 2025-09-07T09:47:17.4675546Z Cache hits rate (HIP) 0.00 % 2025-09-07T09:47:17.4675778Z Cache timeouts 0 2025-09-07T09:47:17.4675997Z Cache read errors 0 2025-09-07T09:47:17.4676215Z Forced recaches 0 2025-09-07T09:47:17.4676431Z Cache write errors 0 2025-09-07T09:47:17.4676648Z Cache errors 0 2025-09-07T09:47:17.4676966Z Compilations 472 2025-09-07T09:47:17.4677191Z Compilation failures 20 2025-09-07T09:47:17.4677429Z Non-cacheable compilations 0 2025-09-07T09:47:17.4677651Z Non-cacheable calls 307 2025-09-07T09:47:17.4677879Z Non-compilation calls 8883 2025-09-07T09:47:17.4678181Z Unsupported compiler calls 0 2025-09-07T09:47:17.4678410Z Average cache write 0.000 s 2025-09-07T09:47:17.4678647Z Average compiler 1.772 s 2025-09-07T09:47:17.4678875Z Average cache read hit 0.000 s 2025-09-07T09:47:17.4679110Z Failed distributed compilations 0 2025-09-07T09:47:17.4679275Z 2025-09-07T09:47:17.4679364Z Non-cacheable reasons: 2025-09-07T09:47:17.4679570Z unknown source language 253 2025-09-07T09:47:17.4679787Z -E 54 2025-09-07T09:47:17.4679947Z 2025-09-07T09:47:17.4680095Z Cache location Local disk: "/var/lib/jenkins/.cache/sccache" 2025-09-07T09:47:17.4680415Z Use direct/preprocessor mode? yes 2025-09-07T09:47:17.4680660Z Version (client) 0.10.0 2025-09-07T09:47:17.4680891Z Cache size 38 MiB 2025-09-07T09:47:17.4681129Z Max cache size 10 GiB 2025-09-07T09:47:17.4681368Z + sccache --stop-server 2025-09-07T09:47:17.4688092Z Stopping sccache server... 2025-09-07T09:47:17.4691123Z Compile requests 9792 2025-09-07T09:47:17.4691369Z Compile requests executed 602 2025-09-07T09:47:17.4691578Z Cache hits 110 2025-09-07T09:47:17.4691774Z Cache hits (C/C++) 110 2025-09-07T09:47:17.4691983Z Cache misses 472 2025-09-07T09:47:17.4692165Z Cache misses (C/C++) 463 2025-09-07T09:47:17.4692355Z Cache misses (HIP) 9 2025-09-07T09:47:17.4692554Z Cache hits rate 18.90 % 2025-09-07T09:47:17.4692756Z Cache hits rate (C/C++) 19.20 % 2025-09-07T09:47:17.4692967Z Cache hits rate (HIP) 0.00 % 2025-09-07T09:47:17.4693364Z Cache timeouts 0 2025-09-07T09:47:17.4693551Z Cache read errors 0 2025-09-07T09:47:17.4693734Z Forced recaches 0 2025-09-07T09:47:17.4693928Z Cache write errors 0 2025-09-07T09:47:17.4694121Z Cache errors 0 2025-09-07T09:47:17.4694298Z Compilations 472 2025-09-07T09:47:17.4694491Z Compilation failures 20 2025-09-07T09:47:17.4694685Z Non-cacheable compilations 0 2025-09-07T09:47:17.4694870Z Non-cacheable calls 307 2025-09-07T09:47:17.4695058Z Non-compilation calls 8883 2025-09-07T09:47:17.4695247Z Unsupported compiler calls 0 2025-09-07T09:47:17.4695430Z Average cache write 0.000 s 2025-09-07T09:47:17.4695627Z Average compiler 1.772 s 2025-09-07T09:47:17.4695826Z Average cache read hit 0.000 s 2025-09-07T09:47:17.4696099Z Failed distributed compilations 0 2025-09-07T09:47:17.4696234Z 2025-09-07T09:47:17.4696296Z Non-cacheable reasons: 2025-09-07T09:47:17.4696467Z unknown source language 253 2025-09-07T09:47:17.4696742Z -E 54 2025-09-07T09:47:17.4696861Z 2025-09-07T09:47:17.4696992Z Cache location Local disk: "/var/lib/jenkins/.cache/sccache" 2025-09-07T09:47:17.4697256Z Use direct/preprocessor mode? yes 2025-09-07T09:47:17.4697456Z Version (client) 0.10.0 2025-09-07T09:47:17.4697648Z Cache size 38 MiB 2025-09-07T09:47:17.4697839Z Max cache size 10 GiB 2025-09-07T09:47:17.4698033Z + echo ::endgroup:: 2025-09-07T09:47:17.4698311Z ##[endgroup] 2025-09-07T09:47:17.4753254Z ##[error]Process completed with exit code 1. 2025-09-07T09:47:17.4779891Z ##[group]Run # copy test results back to the mounted workspace, needed sudo, resulting permissions were correct 2025-09-07T09:47:17.4780257Z # copy test results back to the mounted workspace, needed sudo, resulting permissions were correct 2025-09-07T09:47:17.4780627Z docker exec -t "852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0" sh -c "cd ../pytorch && sudo cp -R test/test-reports ../workspace/test" 2025-09-07T09:47:17.4786463Z shell: /usr/bin/bash -e {0} 2025-09-07T09:47:17.4786573Z env: 2025-09-07T09:47:17.4786665Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:17.4786797Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:17.4786970Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:17.4787131Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:17.4787521Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:17.4787882Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:17.4787998Z AWS_REGION: us-east-1 2025-09-07T09:47:17.4788149Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:17.4788295Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:17.4790720Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:17.4790885Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:17.4791061Z ##[endgroup] 2025-09-07T09:47:17.5479231Z ##[group]Run docker exec -t "852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0" sh -c "sudo chown -R 1001:1001 test" 2025-09-07T09:47:17.5479611Z docker exec -t "852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0" sh -c "sudo chown -R 1001:1001 test" 2025-09-07T09:47:17.5483648Z shell: /usr/bin/bash -e {0} 2025-09-07T09:47:17.5483759Z env: 2025-09-07T09:47:17.5483852Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:17.5483988Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:17.5488389Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:17.5488639Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:17.5489011Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:17.5489378Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:17.5489488Z AWS_REGION: us-east-1 2025-09-07T09:47:17.5489619Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:17.5489762Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:17.5492274Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:17.5492439Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:17.5492610Z ##[endgroup] 2025-09-07T09:47:17.6300815Z ##[group]Run cat test/**/*_toprint.log || true 2025-09-07T09:47:17.6300976Z cat test/**/*_toprint.log || true 2025-09-07T09:47:17.6306765Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-09-07T09:47:17.6306919Z env: 2025-09-07T09:47:17.6307015Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:17.6307151Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:17.6307321Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:17.6307483Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:17.6307860Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:17.6308223Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:17.6308334Z AWS_REGION: us-east-1 2025-09-07T09:47:17.6311101Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:17.6311264Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:17.6314068Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:17.6314236Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:17.6314500Z ##[endgroup] 2025-09-07T09:47:17.6383333Z cat: 'test/**/*_toprint.log': No such file or directory 2025-09-07T09:47:17.6458015Z Prepare all required actions 2025-09-07T09:47:17.6458317Z Getting action download info 2025-09-07T09:47:17.8455446Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2025-09-07T09:47:18.1827309Z Download action repository 'actions/upload-artifact@v4' (SHA:ea165f8d65b6e75b540449e92b4886f43607fa02) 2025-09-07T09:47:18.5816202Z ##[group]Run ./.github/actions/upload-test-artifacts 2025-09-07T09:47:18.5816435Z with: 2025-09-07T09:47:18.5816573Z use-gha: true 2025-09-07T09:47:18.5816787Z file-suffix: test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518 2025-09-07T09:47:18.5816973Z s3-bucket: gha-artifacts 2025-09-07T09:47:18.5817080Z env: 2025-09-07T09:47:18.5817175Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:18.5817306Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:18.5817492Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:18.5817673Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:18.5818090Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:18.5818454Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:18.5818570Z AWS_REGION: us-east-1 2025-09-07T09:47:18.5818714Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:18.5818861Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:18.5821235Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:18.5821401Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:18.5821576Z ##[endgroup] 2025-09-07T09:47:18.5868633Z ##[group]Run actions/upload-artifact@v4 2025-09-07T09:47:18.5868819Z with: 2025-09-07T09:47:18.5869075Z name: test-jsons-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip 2025-09-07T09:47:18.5869473Z retention-days: 14 2025-09-07T09:47:18.5869626Z if-no-files-found: warn 2025-09-07T09:47:18.5869780Z path: test/**/*.json 2025-09-07T09:47:18.5869928Z compression-level: 6 2025-09-07T09:47:18.5870071Z overwrite: false 2025-09-07T09:47:18.5870216Z include-hidden-files: false 2025-09-07T09:47:18.5870346Z env: 2025-09-07T09:47:18.5870434Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:18.5870567Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:18.5870739Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:18.5870899Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:18.5871275Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:18.5871644Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:18.5871754Z AWS_REGION: us-east-1 2025-09-07T09:47:18.5871889Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:18.5872040Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:18.5874529Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:18.5874702Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:18.5874879Z ##[endgroup] 2025-09-07T09:47:18.9937834Z With the provided path, there will be 6 files uploaded 2025-09-07T09:47:18.9941913Z Artifact name is valid! 2025-09-07T09:47:18.9942256Z Root directory input is valid! 2025-09-07T09:47:19.0994697Z Beginning upload of artifact content to blob storage 2025-09-07T09:47:19.3845609Z Uploaded bytes 45591 2025-09-07T09:47:19.4371268Z Finished uploading artifact content to blob storage! 2025-09-07T09:47:19.4372011Z SHA256 digest of uploaded artifact zip is 42907bdaa2cbad4b474c152d4d2820a7a72aefe7c3134783874ddfcb80af1d8f 2025-09-07T09:47:19.4372881Z Finalizing artifact upload 2025-09-07T09:47:19.5397088Z Artifact test-jsons-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip.zip successfully finalized. Artifact ID 3946834990 2025-09-07T09:47:19.5398472Z Artifact test-jsons-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip has been successfully uploaded! Final size is 45591 bytes. Artifact ID is 3946834990 2025-09-07T09:47:19.5401350Z Artifact download URL: https://github.com/pytorch/pytorch/actions/runs/17524754565/artifacts/3946834990 2025-09-07T09:47:19.5543212Z ##[group]Run actions/upload-artifact@v4 2025-09-07T09:47:19.5543356Z with: 2025-09-07T09:47:19.5543541Z name: test-reports-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip 2025-09-07T09:47:19.5543744Z retention-days: 14 2025-09-07T09:47:19.5543852Z if-no-files-found: ignore 2025-09-07T09:47:19.5543969Z path: test/**/*.xml test/**/*.csv 2025-09-07T09:47:19.5544091Z compression-level: 6 2025-09-07T09:47:19.5544192Z overwrite: false 2025-09-07T09:47:19.5544299Z include-hidden-files: false 2025-09-07T09:47:19.5544406Z env: 2025-09-07T09:47:19.5544501Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:19.5544650Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:19.5544823Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:19.5544983Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:19.5545368Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:19.5545733Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:19.5545847Z AWS_REGION: us-east-1 2025-09-07T09:47:19.5546003Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:19.5546158Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:19.5548688Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:19.5548855Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:19.5549037Z ##[endgroup] 2025-09-07T09:47:19.9962648Z With the provided path, there will be 131 files uploaded 2025-09-07T09:47:19.9964043Z Artifact name is valid! 2025-09-07T09:47:19.9965192Z Root directory input is valid! 2025-09-07T09:47:20.1012511Z Beginning upload of artifact content to blob storage 2025-09-07T09:47:20.5889603Z Uploaded bytes 695501 2025-09-07T09:47:20.6384820Z Finished uploading artifact content to blob storage! 2025-09-07T09:47:20.6385851Z SHA256 digest of uploaded artifact zip is cfd4f3eadb3faefbb25a1ac695396084433277e9e7f1f43efc9337d018e68429 2025-09-07T09:47:20.6386369Z Finalizing artifact upload 2025-09-07T09:47:20.7220617Z Artifact test-reports-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip.zip successfully finalized. Artifact ID 3946835039 2025-09-07T09:47:20.7221967Z Artifact test-reports-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip has been successfully uploaded! Final size is 695501 bytes. Artifact ID is 3946835039 2025-09-07T09:47:20.7223594Z Artifact download URL: https://github.com/pytorch/pytorch/actions/runs/17524754565/artifacts/3946835039 2025-09-07T09:47:20.7383162Z ##[group]Run actions/upload-artifact@v4 2025-09-07T09:47:20.7383302Z with: 2025-09-07T09:47:20.7383468Z name: logs-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip 2025-09-07T09:47:20.7383658Z retention-days: 14 2025-09-07T09:47:20.7383768Z if-no-files-found: ignore 2025-09-07T09:47:20.7383888Z path: usage_log.txt test/**/*.log 2025-09-07T09:47:20.7384012Z compression-level: 6 2025-09-07T09:47:20.7384114Z overwrite: false 2025-09-07T09:47:20.7384219Z include-hidden-files: false 2025-09-07T09:47:20.7384330Z env: 2025-09-07T09:47:20.7384419Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:20.7384555Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:20.7384736Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:20.7384899Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:20.7385480Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:20.7385864Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:20.7385989Z AWS_REGION: us-east-1 2025-09-07T09:47:20.7386149Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:20.7386311Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:20.7389060Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:20.7389241Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:20.7389430Z ##[endgroup] 2025-09-07T09:47:21.1927939Z Multiple search paths detected. Calculating the least common ancestor of all paths 2025-09-07T09:47:21.1928492Z The least common ancestor is /home/runner/_work/pytorch/pytorch. This will be the root directory of the artifact 2025-09-07T09:47:21.1928794Z With the provided path, there will be 81 files uploaded 2025-09-07T09:47:21.1935494Z Artifact name is valid! 2025-09-07T09:47:21.1935634Z Root directory input is valid! 2025-09-07T09:47:21.2924062Z Beginning upload of artifact content to blob storage 2025-09-07T09:47:21.8152000Z Uploaded bytes 670260 2025-09-07T09:47:21.8673002Z Finished uploading artifact content to blob storage! 2025-09-07T09:47:21.8673862Z SHA256 digest of uploaded artifact zip is 31683038704953b43e88c7274ab65809a28136f330fb3b7337c10b4e5e944b8a 2025-09-07T09:47:21.8674474Z Finalizing artifact upload 2025-09-07T09:47:21.9708653Z Artifact logs-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip.zip successfully finalized. Artifact ID 3946835088 2025-09-07T09:47:21.9709900Z Artifact logs-runattempt1-test-default-4-6-linux.rocm.gpu.gfx942.1_49774353518.zip has been successfully uploaded! Final size is 670260 bytes. Artifact ID is 3946835088 2025-09-07T09:47:21.9713360Z Artifact download URL: https://github.com/pytorch/pytorch/actions/runs/17524754565/artifacts/3946835088 2025-09-07T09:47:21.9867027Z ##[group]Run # shellcheck disable=SC2156 2025-09-07T09:47:21.9867256Z # shellcheck disable=SC2156 2025-09-07T09:47:21.9867487Z find . -iname "core.[1-9]*" -exec docker exec "${CONTAINER_NAME}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2025-09-07T09:47:21.9873141Z shell: /usr/bin/bash -e {0} 2025-09-07T09:47:21.9873274Z env: 2025-09-07T09:47:21.9873374Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:21.9873519Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:21.9873712Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:21.9873884Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:21.9874272Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:21.9874645Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:21.9874790Z AWS_REGION: us-east-1 2025-09-07T09:47:21.9874954Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:21.9875120Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:21.9877530Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:21.9877712Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:21.9877899Z ##[endgroup] 2025-09-07T09:47:22.1430279Z ##[group]Run actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 2025-09-07T09:47:22.1430463Z with: 2025-09-07T09:47:22.1430590Z name: coredumps-default-4-6-linux.rocm.gpu.gfx942.1 2025-09-07T09:47:22.1430743Z retention-days: 14 2025-09-07T09:47:22.1430858Z if-no-files-found: ignore 2025-09-07T09:47:22.1430975Z path: ./**/core.[1-9]* 2025-09-07T09:47:22.1431090Z compression-level: 6 2025-09-07T09:47:22.1431196Z overwrite: false 2025-09-07T09:47:22.1431308Z include-hidden-files: false 2025-09-07T09:47:22.1431424Z env: 2025-09-07T09:47:22.1436015Z GIT_DEFAULT_BRANCH: main 2025-09-07T09:47:22.1436265Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-09-07T09:47:22.1436456Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-09-07T09:47:22.1436631Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-09-07T09:47:22.1437024Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 992 --device /dev/dri/renderD185 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-09-07T09:47:22.1437390Z AWS_DEFAULT_REGION: us-east-1 2025-09-07T09:47:22.1437512Z AWS_REGION: us-east-1 2025-09-07T09:47:22.1437649Z AWS_ACCESS_KEY_ID: *** 2025-09-07T09:47:22.1437802Z AWS_SECRET_ACCESS_KEY: *** 2025-09-07T09:47:22.1440200Z AWS_SESSION_TOKEN: *** 2025-09-07T09:47:22.1440371Z CONTAINER_NAME: 852b8dee4ab4ee08dff784cb84c7188814f42916aa66019374355aa2d2789fc0 2025-09-07T09:47:22.1440551Z ##[endgroup] 2025-09-07T09:47:26.7638180Z No files were found with the provided path: ./**/core.[1-9]*. No artifacts will be uploaded. 2025-09-07T09:47:26.7812921Z Post job cleanup. 2025-09-07T09:47:26.8034181Z Logging out of registry 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-09-07T09:47:26.8282042Z Post job cleanup. 2025-09-07T09:47:26.8922285Z Post job cleanup. 2025-09-07T09:47:26.8955333Z Post job cleanup. 2025-09-07T09:47:26.9454651Z [command]/usr/bin/git version 2025-09-07T09:47:26.9473242Z git version 2.51.0 2025-09-07T09:47:26.9490922Z Copying '/home/runner/.gitconfig' to '/home/runner/_work/_temp/96943d56-bf68-4b45-aa02-7b21e465ea16/.gitconfig' 2025-09-07T09:47:26.9498443Z Temporarily overriding HOME='/home/runner/_work/_temp/96943d56-bf68-4b45-aa02-7b21e465ea16' before making global git config changes 2025-09-07T09:47:26.9499016Z Adding repository directory to the temporary git global config as a safe directory 2025-09-07T09:47:26.9500749Z [command]/usr/bin/git config --global --add safe.directory /home/runner/_work/pytorch/pytorch 2025-09-07T09:47:26.9537756Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-09-07T09:47:26.9556900Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-09-07T09:47:26.9791634Z Entering 'android/libs/fbjni' 2025-09-07T09:47:26.9833442Z Entering 'third_party/FP16' 2025-09-07T09:47:26.9875166Z Entering 'third_party/FXdiv' 2025-09-07T09:47:26.9922624Z Entering 'third_party/NNPACK' 2025-09-07T09:47:26.9958398Z Entering 'third_party/NVTX' 2025-09-07T09:47:26.9988836Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T09:47:27.0022399Z Entering 'third_party/XNNPACK' 2025-09-07T09:47:27.0074462Z Entering 'third_party/aiter' 2025-09-07T09:47:27.0103529Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T09:47:27.0136557Z Entering 'third_party/benchmark' 2025-09-07T09:47:27.0170290Z Entering 'third_party/composable_kernel' 2025-09-07T09:47:27.0203635Z Entering 'third_party/cpp-httplib' 2025-09-07T09:47:27.0234170Z Entering 'third_party/cpuinfo' 2025-09-07T09:47:27.0259075Z Entering 'third_party/cudnn_frontend' 2025-09-07T09:47:27.0285772Z Entering 'third_party/cutlass' 2025-09-07T09:47:27.0327004Z Entering 'third_party/fbgemm' 2025-09-07T09:47:27.0362207Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T09:47:27.0396995Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T09:47:27.0447422Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T09:47:27.0473408Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T09:47:27.0508032Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T09:47:27.0533903Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T09:47:27.0556281Z Entering 'third_party/fbgemm/external/json' 2025-09-07T09:47:27.0584506Z Entering 'third_party/flash-attention' 2025-09-07T09:47:27.0612531Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T09:47:27.0640288Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T09:47:27.0671249Z Entering 'third_party/flatbuffers' 2025-09-07T09:47:27.0710545Z Entering 'third_party/fmt' 2025-09-07T09:47:27.0736542Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T09:47:27.0768570Z Entering 'third_party/gloo' 2025-09-07T09:47:27.0806308Z Entering 'third_party/googletest' 2025-09-07T09:47:27.0839353Z Entering 'third_party/ideep' 2025-09-07T09:47:27.0871779Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T09:47:27.0899715Z Entering 'third_party/ittapi' 2025-09-07T09:47:27.0932363Z Entering 'third_party/kineto' 2025-09-07T09:47:27.0957312Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T09:47:27.0995996Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T09:47:27.1017557Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T09:47:27.1043221Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T09:47:27.1069940Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T09:47:27.1100656Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T09:47:27.1139644Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T09:47:27.1170026Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T09:47:27.1199782Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T09:47:27.1227366Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T09:47:27.1262333Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T09:47:27.1290449Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T09:47:27.1316616Z Entering 'third_party/kleidiai' 2025-09-07T09:47:27.1347009Z Entering 'third_party/mimalloc' 2025-09-07T09:47:27.1373243Z Entering 'third_party/nlohmann' 2025-09-07T09:47:27.1400579Z Entering 'third_party/onnx' 2025-09-07T09:47:27.1435803Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T09:47:27.1473193Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T09:47:27.1505554Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T09:47:27.1536302Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T09:47:27.1559909Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T09:47:27.1585752Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T09:47:27.1618190Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T09:47:27.1641535Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T09:47:27.1670334Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T09:47:27.1695891Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T09:47:27.1723489Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T09:47:27.1754556Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T09:47:27.1799269Z Entering 'third_party/pocketfft' 2025-09-07T09:47:27.1826125Z Entering 'third_party/protobuf' 2025-09-07T09:47:27.1854160Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T09:47:27.1879887Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T09:47:27.1918926Z Entering 'third_party/psimd' 2025-09-07T09:47:27.1950877Z Entering 'third_party/pthreadpool' 2025-09-07T09:47:27.1979464Z Entering 'third_party/pybind11' 2025-09-07T09:47:27.2005221Z Entering 'third_party/python-peachpy' 2025-09-07T09:47:27.2039067Z Entering 'third_party/sleef' 2025-09-07T09:47:27.2076792Z Entering 'third_party/tensorpipe' 2025-09-07T09:47:27.2103716Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T09:47:27.2137340Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T09:47:27.2158652Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T09:47:27.2181395Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T09:47:27.2207909Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T09:47:27.2257294Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-09-07T09:47:27.2280166Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2289517Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-09-07T09:47:27.2313579Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-09-07T09:47:27.2485833Z Entering 'android/libs/fbjni' 2025-09-07T09:47:27.2493519Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2514183Z Entering 'third_party/FP16' 2025-09-07T09:47:27.2529247Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2549955Z Entering 'third_party/FXdiv' 2025-09-07T09:47:27.2575950Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2595517Z Entering 'third_party/NNPACK' 2025-09-07T09:47:27.2610219Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2632638Z Entering 'third_party/NVTX' 2025-09-07T09:47:27.2647668Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2671478Z Entering 'third_party/VulkanMemoryAllocator' 2025-09-07T09:47:27.2690569Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2713016Z Entering 'third_party/XNNPACK' 2025-09-07T09:47:27.2729247Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2755431Z Entering 'third_party/aiter' 2025-09-07T09:47:27.2775913Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2803398Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-09-07T09:47:27.2817775Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2850123Z Entering 'third_party/benchmark' 2025-09-07T09:47:27.2864841Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2890325Z Entering 'third_party/composable_kernel' 2025-09-07T09:47:27.2906071Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2931804Z Entering 'third_party/cpp-httplib' 2025-09-07T09:47:27.2950358Z http.https://github.com/.extraheader 2025-09-07T09:47:27.2976570Z Entering 'third_party/cpuinfo' 2025-09-07T09:47:27.2992401Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3016849Z Entering 'third_party/cudnn_frontend' 2025-09-07T09:47:27.3031033Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3057551Z Entering 'third_party/cutlass' 2025-09-07T09:47:27.3076115Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3101623Z Entering 'third_party/fbgemm' 2025-09-07T09:47:27.3125488Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3146799Z Entering 'third_party/fbgemm/external/asmjit' 2025-09-07T09:47:27.3165786Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3184092Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-09-07T09:47:27.3206666Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3227377Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-09-07T09:47:27.3246349Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3264537Z Entering 'third_party/fbgemm/external/cutlass' 2025-09-07T09:47:27.3284792Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3305994Z Entering 'third_party/fbgemm/external/googletest' 2025-09-07T09:47:27.3321694Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3346640Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-09-07T09:47:27.3360225Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3380244Z Entering 'third_party/fbgemm/external/json' 2025-09-07T09:47:27.3397404Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3417844Z Entering 'third_party/flash-attention' 2025-09-07T09:47:27.3432581Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3452265Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-09-07T09:47:27.3465959Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3493980Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-09-07T09:47:27.3515864Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3535568Z Entering 'third_party/flatbuffers' 2025-09-07T09:47:27.3558274Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3588895Z Entering 'third_party/fmt' 2025-09-07T09:47:27.3608417Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3630086Z Entering 'third_party/gemmlowp/gemmlowp' 2025-09-07T09:47:27.3652405Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3674239Z Entering 'third_party/gloo' 2025-09-07T09:47:27.3697157Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3724873Z Entering 'third_party/googletest' 2025-09-07T09:47:27.3736882Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3759029Z Entering 'third_party/ideep' 2025-09-07T09:47:27.3774953Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3795231Z Entering 'third_party/ideep/mkl-dnn' 2025-09-07T09:47:27.3814285Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3836561Z Entering 'third_party/ittapi' 2025-09-07T09:47:27.3855948Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3874789Z Entering 'third_party/kineto' 2025-09-07T09:47:27.3895724Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3913587Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-09-07T09:47:27.3931925Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3949027Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-09-07T09:47:27.3966694Z http.https://github.com/.extraheader 2025-09-07T09:47:27.3989852Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-09-07T09:47:27.4004488Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4029324Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-09-07T09:47:27.4049486Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4073551Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-09-07T09:47:27.4084419Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4107067Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-09-07T09:47:27.4128572Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4150949Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-09-07T09:47:27.4166266Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4196884Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-09-07T09:47:27.4210811Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4229325Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-09-07T09:47:27.4244472Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4264331Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-09-07T09:47:27.4278448Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4300181Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-09-07T09:47:27.4317947Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4339704Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-09-07T09:47:27.4356877Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4388853Z Entering 'third_party/kleidiai' 2025-09-07T09:47:27.4404639Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4424921Z Entering 'third_party/mimalloc' 2025-09-07T09:47:27.4442161Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4466576Z Entering 'third_party/nlohmann' 2025-09-07T09:47:27.4486882Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4510548Z Entering 'third_party/onnx' 2025-09-07T09:47:27.4536409Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4558761Z Entering 'third_party/onnx/third_party/pybind11' 2025-09-07T09:47:27.4574025Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4596325Z Entering 'third_party/opentelemetry-cpp' 2025-09-07T09:47:27.4616960Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4637156Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-09-07T09:47:27.4651247Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4668388Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-09-07T09:47:27.4681750Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4707911Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-09-07T09:47:27.4725644Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4748366Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-09-07T09:47:27.4761704Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4782803Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-09-07T09:47:27.4799627Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4818102Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-09-07T09:47:27.4830793Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4856388Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-09-07T09:47:27.4868494Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4890975Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-09-07T09:47:27.4909363Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4937877Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-09-07T09:47:27.4952889Z http.https://github.com/.extraheader 2025-09-07T09:47:27.4974979Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-09-07T09:47:27.4991428Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5025813Z Entering 'third_party/pocketfft' 2025-09-07T09:47:27.5040497Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5058843Z Entering 'third_party/protobuf' 2025-09-07T09:47:27.5076171Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5100870Z Entering 'third_party/protobuf/third_party/benchmark' 2025-09-07T09:47:27.5115484Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5138090Z Entering 'third_party/protobuf/third_party/googletest' 2025-09-07T09:47:27.5160044Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5178967Z Entering 'third_party/psimd' 2025-09-07T09:47:27.5198687Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5220039Z Entering 'third_party/pthreadpool' 2025-09-07T09:47:27.5234931Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5258516Z Entering 'third_party/pybind11' 2025-09-07T09:47:27.5278217Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5299504Z Entering 'third_party/python-peachpy' 2025-09-07T09:47:27.5315505Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5337854Z Entering 'third_party/sleef' 2025-09-07T09:47:27.5350582Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5370645Z Entering 'third_party/tensorpipe' 2025-09-07T09:47:27.5396252Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5418086Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-09-07T09:47:27.5431926Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5456861Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-09-07T09:47:27.5469302Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5489581Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-09-07T09:47:27.5503808Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5521639Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-09-07T09:47:27.5537807Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5556184Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-09-07T09:47:27.5570322Z http.https://github.com/.extraheader 2025-09-07T09:47:27.5707138Z Cleaning up orphan processes